00000100:00100000:2.0:1786002498.911507:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e15c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560830208:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786002498.911601:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002498.911609:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578412c8a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412c91 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911620:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578412c8a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578412c91 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911628:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578412c8a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578412c91 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911644:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002498.911648:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002498.911652:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47e00/0x7cee4af578412c98 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412c9f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911660:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47e00/0x7cee4af578412c98 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578412c9f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911668:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47e00/0x7cee4af578412c98 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578412c9f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911679:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786002498.911731:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17678:x1872758530805376:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 37825us (38124us total) trans 4294968424 rc -5/-5 00000100:00100000:2.0:1786002498.911738:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23580 00010000:00010000:2.0:1786002498.911756:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002498.911761:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578412c8a lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578412c91 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911774:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002498.911779:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578412c8a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578412c91 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002498.911788:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578412c8a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578412c91 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911812:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578412c8a lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412c91 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911818:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002498.911864:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578412c8a lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412c91 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911873:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578412c8a lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412c91 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911890:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002498.911894:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47e00/0x7cee4af578412c98 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578412c9f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911901:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47e00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002498.911905:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47e00/0x7cee4af578412c98 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578412c9f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002498.911920:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47e00/0x7cee4af578412c98 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578412c9f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911941:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47e00/0x7cee4af578412c98 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412c9f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911948:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002498.911954:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47e00/0x7cee4af578412c98 lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412c9f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911961:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47e00/0x7cee4af578412c98 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412c9f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002498.911974:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002498.911975:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002498.911977:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002498.912946:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002498.932995:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560830976 00000100:00100000:2.0:1786002498.933002:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560830976 00000100:00100000:2.0:1786002498.933045:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1786002498.933054:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560830976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002498.933070:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1786002498.933110:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560830976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002498.933117:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1786002498.933136:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758560831360:0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.933161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002498.933179:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758560831872:0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.933194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002498.933209:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786002498.933214:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560831232:0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.933234:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002498.933248:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560831744:0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.933266:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002498.933287:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560831104 00000100:00100000:2.0:1786002498.933290:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560831104 00000100:00100000:2.0:1786002498.933314:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560831488 00000100:00100000:2.0:1786002498.933316:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560831488 00000100:00100000:2.0:1786002498.933327:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560831360 00000100:00100000:2.0:1786002498.933329:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560831360 00000100:00100000:2.0:1786002498.933339:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560831872 00000100:00100000:2.0:1786002498.933342:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560831872 00000100:00100000:2.0:1786002498.933354:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1786002498.933359:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758560831104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.933387:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758560831104:12345-0@lo:400:kworker.0 Request processed in 27us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002498.933392:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1786002498.933402:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:2.0:1786002498.933408:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758560831488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.933429:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758560831488:12345-0@lo:400:kworker.0 Request processed in 22us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002498.933434:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:2.0:1786002498.933444:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:2.0:1786002498.933449:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758560831360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.933475:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758560831360:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002498.933481:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:2.0:1786002498.933493:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1786002498.933499:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758560831872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.933523:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758560831872:12345-0@lo:400:kworker.0 Request processed in 25us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002498.933528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1786002498.933558:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758560831360:0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.933567:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758560831872:0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.939619:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758560832000:0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.939688:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002498.939763:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758560831488:0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.939775:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758560831104:0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.939795:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560830976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002498.940149:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758560832000:0@lo:400:kworker.0 00000100:00100000:2.0:1786002498.947928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002498.990116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002499.031752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002499.078271:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f573100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560832128:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002499.078316:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560832256:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002499.078341:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002499.078369:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1786002499.115014:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af578412d32 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.115038:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af578412d32 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.115048:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af578412d32 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.115084:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.115090:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.115101:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002499.115123:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560833920:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786002499.115184:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002499.115212:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a900 going to sleep for 11 seconds 00000100:00100000:2.0:1786002499.115893:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560833920 00000100:00100000:2.0:1786002499.115900:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560833920 00000100:00100000:2.0:1786002499.115955:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3328 00000100:00100000:2.0:1786002499.115965:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:10360:x1872758560833920:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002499.115984:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002499.115999:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578412d40 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578412d39 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116021:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578412d40 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578412d39 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116040:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578412d40 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578412d39 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116049:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xce:0x0].0x0 (ffff9ed24559fa00) 00010000:00010000:2.0:1786002499.116052:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002499.116056:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556be00, rc 0) 00000100:00100000:2.0:1786002499.116092:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:10360:x1872758560833920:12345-0@lo:101:mdt00_003.0 Request processed in 129us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.116098:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3328 00000100:00100000:2.0:1786002499.116138:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560833920:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002499.116152:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412d40 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116161:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412d40 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002499.116182:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020ebbbf2 reply state 000000004b38a60e transno 4294983444 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af578412d32 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116193:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af578412d32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116200:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xce:0x0].0x0 (ffff9ed24559fc00) 00010000:00010000:2.0:1786002499.116202:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002499.116205:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002499.116210:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412d40 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116222:0:10360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412d40 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002499.116233:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xce:0x0] 00000004:00010000:2.0:1786002499.116240:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020ebbbf2 reply state 000000004b38a60e transno 4294983444 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578412d2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116248:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578412d2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116254:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:2.0:1786002499.116256:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002499.116257:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1786002499.116263:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152a:0x0]: returning size 4096 00000004:00080000:2.0:1786002499.116270:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1786002499.116281:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578412d0f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412d16 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116288:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578412d0f lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578412d16 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116296:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578412d0f lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578412d16 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116313:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002499.116317:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1786002499.116322:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578412d1d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412d24 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.116334:0:10360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578412d1d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xff310312 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412d24 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002499.116396:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17684:x1872758530806656:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 38776us (39292us total) trans 4294983444 rc 0/0 00000100:00100000:2.0:1786002499.116403:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23586 00000100:00100000:2.0:1786002499.259901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002499.259977:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530807424 00000100:00100000:2.0:1786002499.259986:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530807424 00000100:00100000:2.0:1786002499.260035:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23590 00000100:00100000:2.0:1786002499.260044:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17692:x1872758530807424:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002499.260063:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002499.260082:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af578412d71 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a45b expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.260136:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412d78 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.260149:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412d78 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.260160:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412d78 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002499.260205:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xce:0x0]: returning size 4096 00000004:00200000:2.0:1786002499.260211:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002499.260973:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af578412d71 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a45b expref: 26 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.260997:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412d78 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a45b expref: 25 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.261007:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xce:0x0].0x0 (ffff9ed24559fc00) 00010000:00010000:2.0:1786002499.261010:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002499.261014:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b400, rc 0) 00000100:00100000:2.0:1786002499.261072:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17692:x1872758530807424:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 1029us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.261079:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23590 00000100:00100000:2.0:1786002499.294036:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530807552 00000100:00100000:2.0:1786002499.294048:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530807552 00000100:00100000:2.0:1786002499.294139:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23591 00000100:00100000:2.0:1786002499.294150:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17692:x1872758530807552:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002499.294169:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002499.294188:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af578412d7f lrc: 2/0,0 mode: --/CR res: [0x240000401:0xce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a462 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.294244:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578412d86 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.294269:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578412d40 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578412d39 expref: 5 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.294277:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578412d86 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.294310:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578412d40 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578412d39 expref: 5 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002499.294325:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560834560:0@lo:104: 00000100:00100000:2.0:1786002499.294379:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002499.294412:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a480 going to sleep for 11 seconds 00000100:00100000:2.0:1786002499.294661:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560834560 00000100:00100000:2.0:1786002499.294665:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560834560 00000100:00100000:2.0:1786002499.294700:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1786002499.294708:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6521:x1872758560834560:12345-0@lo:104: 00010000:00010000:2.0:1786002499.294720:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578412d40 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.294767:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786002499.294774:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6521:x1872758560834560:12345-0@lo:104: Request processed in 67us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.294780:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00010000:00010000:2.0:1786002499.294800:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002499.294805:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578412d40 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.294813:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002499.294818:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578412d40 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002499.294827:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578412d40 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.294876:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578412d40 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.294889:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002499.294907:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578412d40 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.294925:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556b000/0x7cee4af578412d39 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578412d40 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.294941:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002499.294943:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002499.294944:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002499.294955:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560834688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002499.294981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002499.295063:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560834560:0@lo:104: 00010000:00010000:2.0:1786002499.295082:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578412d86 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.312681:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578412d40 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578412d39 expref: 6 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.312705:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xce:0x0].0x0 (ffff9ed24559fa00) 00010000:00010000:2.0:1786002499.312710:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578412d86 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.312721:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578412d86 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.312728:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578412d86 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.312762:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002499.312840:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758560834688:12345-0@lo:103:ldlm_bl.0 Request processed in 16424us (17856us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.312870:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1577 00010000:00010000:2.0:1786002499.418343:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002499.418355:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578412dc5 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578412dcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.418368:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002499.418376:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578412dc5 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578412dcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002499.418387:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578412dc5 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578412dcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.418428:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578412dc5 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412dcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.418434:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002499.418460:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578412dc5 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412dcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.418467:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578412dc5 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412dcc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.418487:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002499.418490:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af578412da9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578412db0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.418501:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002499.418505:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af578412da9 lrc: 5/0,0 mode: EX/EX res: [0x200000402:0x152a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578412db0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002499.418512:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af578412da9 lrc: 5/0,0 mode: EX/EX res: [0x200000402:0x152a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578412db0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.418527:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af578412da9 lrc: 4/0,0 mode: --/EX res: [0x200000402:0x152a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412db0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.418533:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002499.418538:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af578412da9 lrc: 3/0,0 mode: --/EX res: [0x200000402:0x152a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412db0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.418545:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002499.418546:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002499.418549:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002499.419378:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560836352 00000100:00100000:2.0:1786002499.419387:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560836352 00000100:00100000:2.0:1786002499.419430:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560836480 00000100:00100000:2.0:1786002499.419433:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560836480 00000100:00100000:2.0:1786002499.419454:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:2.0:1786002499.419462:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+11:3646:x1872758560836352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002499.419475:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002499.419494:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46a00/0x7cee4af578412dcc lrc: 0/0,0 mode: --/EX res: [0x240000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578412dc5 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.419507:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xce:0x0].0x0 (ffff9ed24559fa00) 00010000:00010000:2.0:1786002499.419518:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002499.419555:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+10:3646:x1872758560836352:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.419562:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:2.0:1786002499.419577:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:2.0:1786002499.419583:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3646:x1872758560836480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002499.419590:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002499.419601:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578412db0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578412da9 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.419611:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152a:0x0].0x0 (ffff9ed2456f9000) 00010000:00010000:2.0:1786002499.419617:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002499.419648:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3646:x1872758560836480:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.419654:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:2.0:1786002499.442266:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530808320 00000100:00100000:2.0:1786002499.442275:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530808320 00000100:00100000:2.0:1786002499.442335:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23593 00000100:00100000:2.0:1786002499.442345:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17693:x1872758530808320:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002499.442372:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002499.442393:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578412dd3 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a469 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442451:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578412dda lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442465:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578412dda lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442480:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578412dda lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442496:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412de1 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442503:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412de1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442509:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412de1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442549:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578412dda lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442555:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578412dda lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442561:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578412dda lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442567:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578412dda lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442573:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002499.442576:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578412dda lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442583:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578412dda lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442593:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24206a500) 00010000:00010000:2.0:1786002499.442596:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002499.442600:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578412dda lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442606:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578412dda lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442620:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412de1 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442625:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412de1 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442630:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412de1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442634:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002499.442637:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412de1 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442642:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412de1 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442648:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xbefb5018 (ffff9ed24559fa00) 00010000:00010000:2.0:1786002499.442651:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002499.442653:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412de1 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442659:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578412de1 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442685:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578412dd3 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a469 expref: 25 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442695:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24206a500) 00010000:00010000:2.0:1786002499.442697:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002499.442701:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578412dd3 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a469 expref: 25 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.442709:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a200, rc 0) 00000100:00100000:2.0:1786002499.442754:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17693:x1872758530808320:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 411us (582us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002499.442761:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23593 00000100:00100000:2.0:1786002499.484168:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560837888 00000100:00100000:2.0:1786002499.484174:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560837888 00000100:00100000:2.0:1786002499.484215:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3345 00000100:00100000:2.0:1786002499.484224:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560837888:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786002499.484294:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560837888:12345-0@lo:1000:mdt00_000.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.484300:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3345 00000100:00100000:2.0:1786002499.485539:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560838016 00000100:00100000:2.0:1786002499.485545:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560838016 00000100:00100000:2.0:1786002499.485585:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3346 00000100:00100000:2.0:1786002499.485593:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560838016:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786002499.485674:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560838016:12345-0@lo:1000:mdt00_000.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.485681:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3346 00000004:00080000:2.0:1786002499.489371:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 733 rpc_version 733 00000020:00100000:2.0:1786002499.489407:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002499.489417:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243e16680 x1872758560838784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002499.489437:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560838784:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002499.489490:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002499.489519:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a480 going to sleep for 11 seconds 00000100:00100000:2.0:1786002499.498717:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e16680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560838784:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002499.530512:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002499.567005:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002499.584945:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530809344 00000100:00100000:2.0:1786002499.584955:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530809344 00000100:00100000:2.0:1786002499.585008:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23598 00000100:00100000:2.0:1786002499.585019:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:17695:x1872758530809344:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002499.585043:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002499.585062:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578412e4a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a47e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.585121:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578412e51 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.585134:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578412e51 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.585144:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578412e51 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002499.585228:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x188:0x0]: returning size 4096 00000004:00200000:2.0:1786002499.585232:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002499.585275:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578412e4a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a47e expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.585297:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578412e51 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x188:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a47e expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.585305:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x188:0x0].0x0 (ffff9ed35a569600) 00010000:00010000:2.0:1786002499.585308:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002499.585312:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b400, rc 0) 00000100:00100000:2.0:1786002499.585367:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17695:x1872758530809344:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 350us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.585374:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23598 00000100:00100000:2.0:1786002499.588362:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530809472 00000100:00100000:2.0:1786002499.588372:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530809472 00000100:00100000:2.0:1786002499.588428:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23599 00000100:00100000:2.0:1786002499.588445:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17695:x1872758530809472:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002499.588464:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002499.588484:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578412e58 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a485 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.588538:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af578412e5f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.588551:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af578412e5f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.588562:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af578412e5f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002499.588605:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xcc:0x0]: returning size 4096 00000004:00200000:2.0:1786002499.588610:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002499.588639:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578412e58 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a485 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.588655:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af578412e5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a485 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.588662:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcc:0x0].0x0 (ffff9ed35a569500) 00010000:00010000:2.0:1786002499.588665:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002499.588668:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556bc00, rc 0) 00000100:00100000:2.0:1786002499.588713:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:17695:x1872758530809472:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 270us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.588719:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23599 00000100:00100000:2.0:1786002499.612397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002499.623552:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560840320:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786002499.623565:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 725 rpc_version 725 00000020:00100000:2.0:1786002499.623583:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002499.623590:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243e16d80 x1872758560840576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002499.623606:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560840576:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002499.623642:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002499.623658:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1786002499.624834:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e16d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560840576:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786002499.624843:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 726 rpc_version 726 00000020:00100000:2.0:1786002499.624870:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002499.624875:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243e14380 x1872758560840832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002499.624889:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e14380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560840832:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002499.624924:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002499.624945:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1786002499.625172:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e14380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560840832:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002499.654718:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560841088:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1786002499.654747:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578412e82 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412e89 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.654762:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578412e82 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xbefb5018 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412e89 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002499.654784:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:3.0:1786002499.654835:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560841216:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002499.654926:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002499.654951:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611300 going to sleep for 11 seconds 00000100:00100000:3.0:1786002499.654974:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560841216 00000100:00100000:3.0:1786002499.654980:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560841216 00000100:00100000:3.0:1786002499.655020:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3360 00000100:00100000:3.0:1786002499.655028:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6521:x1872758560841216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002499.655093:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6521:x1872758560841216:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002499.655100:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3360 00000100:00100000:3.0:1786002499.655132:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560841216:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002499.655167:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560841344:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002499.655187:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002499.655200:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611300 going to sleep for 11 seconds 00000100:00100000:3.0:1786002499.655211:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560841344 00000100:00100000:3.0:1786002499.655214:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560841344 00000100:00100000:3.0:1786002499.655234:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3361 00000100:00100000:3.0:1786002499.655240:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6521:x1872758560841344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002499.655308:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6521:x1872758560841344:12345-0@lo:1000:mdt00_001.0 Request processed in 68us (120us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002499.655315:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3361 00000100:00100000:3.0:1786002499.655339:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560841344:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1786002499.655384:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578412e90 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655392:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578412e90 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655401:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578412e90 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002499.655412:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560841472:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1786002499.655432:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002499.655446:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002499.655456:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560841472 00000100:00100000:3.0:1786002499.655460:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560841472 00000100:00100000:3.0:1786002499.655481:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3362 00000100:00100000:3.0:1786002499.655487:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6521:x1872758560841472:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1786002499.655495:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002499.655510:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412e97 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578412e90 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655529:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412e97 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578412e90 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655541:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412e97 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578412e90 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655553:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x188:0x0].0x0 (ffff9ed2456f9900) 00010000:00010000:3.0:1786002499.655557:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002499.655560:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:3.0:1786002499.655585:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6521:x1872758560841472:12345-0@lo:101:mdt00_001.0 Request processed in 99us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002499.655591:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3362 00000100:00100000:3.0:1786002499.655614:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560841472:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1786002499.655623:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578412e90 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412e97 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655632:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578412e90 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412e97 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655651:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578412e9e lrc: 3/0,1 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655660:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578412e9e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655668:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578412e9e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655683:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578412ea5 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655694:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af578412e5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a485 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655708:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578412ea5 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655727:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af578412e5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a485 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.655740:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af578412e5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a485 expref: 11 pid: 6521 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002499.655751:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560841600:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002499.655803:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611d80 going to sleep for 11 seconds 00010000:00010000:3.0:1786002499.675658:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af578412e5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a485 expref: 11 pid: 6521 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002499.675679:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560841600:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002499.675698:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578412ea5 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.675707:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578412ea5 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.675713:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578412ea5 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.675755:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.675762:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.675773:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002499.675792:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560841728:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1786002499.675840:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002499.675895:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002499.685222:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560841728:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1786002499.685238:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 4/0,1 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.685249:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 4/0,1 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002499.687419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002499.687485:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530810240 00000100:00100000:3.0:1786002499.687494:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530810240 00010000:00010000:3.0:1786002499.687526:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578412e6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a48c expref: 13 pid: 6522 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002499.687566:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1584 00000100:00100000:3.0:1786002499.687575:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758530810240:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002499.687590:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002499.687597:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578412e6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a48c expref: 13 pid: 6522 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.687609:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578412e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a48c expref: 13 pid: 6522 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.687635:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578412e6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a48c expref: 13 pid: 6522 timeout: 959 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.687647:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcc:0x0].0x0 (ffff9ed2456f9a00) 00010000:00010000:3.0:1786002499.687653:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578412eb3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578412eac expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.687664:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578412eb3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578412eac expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.687672:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578412eb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578412eac expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.687700:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578412eb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578412eac expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002499.687713:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6505:1872758560841984:0@lo:105: 00000100:00100000:3.0:1786002499.687750:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002499.687782:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002499.687798:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560841984 00000100:00100000:3.0:1786002499.687801:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560841984 00000100:00100000:3.0:1786002499.687827:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1786002499.687833:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6505:x1872758560841984:12345-0@lo:105: 00010000:00010000:3.0:1786002499.687843:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 5/0,1 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.687874:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 5/0,1 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.687883:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 5/0,1 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.687890:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.687897:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.687905:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.687932:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f34e00) 00000100:00100000:3.0:1786002499.687962:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6505:x1872758560841984:12345-0@lo:105: Request processed in 128us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002499.687968:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1786002499.688002:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6505:1872758560841984:0@lo:105: 00010000:00010000:3.0:1786002499.688014:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002499.688042:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530810240:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 468us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002499.688048:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1584 00010000:00010000:3.0:1786002499.688112:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.688133:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002499.688772:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560842112:0@lo:403:mdt00_001.0 00000100:00100000:3.0:1786002499.688810:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002499.688829:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002499.688863:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560842112 00000100:00100000:3.0:1786002499.688867:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560842112 00000100:00100000:3.0:1786002499.688895:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3364 00000100:00100000:3.0:1786002499.688901:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6521:x1872758560842112:12345-0@lo:403:mdt00_001.0 00000100:00100000:3.0:1786002499.690410:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6521:x1872758560842112:12345-0@lo:403:mdt00_001.0 Request processed in 1506us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002499.690418:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3364 00000100:00100000:3.0:1786002499.690464:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560842112:0@lo:403:mdt00_001.0 00000040:00080000:3.0:1786002499.701094:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].386, 664 off592656 00000040:00080000:3.0:1786002499.701428:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].385, 744 off639472 00000004:00080000:3.0:1786002499.701434:0:6521:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed36e611d80 with version 734 00000100:00100000:2.0:1786002499.711293:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560842368 00000100:00100000:2.0:1786002499.711305:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560842368 00000100:00100000:2.0:1786002499.722341:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f3b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560842368:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1786002499.722903:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786002499.722918:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.722926:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002499.722930:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002499.722937:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.722966:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 2/0,0 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.722972:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002499.723953:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 1/0,0 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.723963:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af578412eac lrc: 0/0,0 mode: --/EX res: [0x200000401:0xcc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412eb3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.723980:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002499.723983:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578412e74 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578412e7b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.723989:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002499.723993:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578412e74 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578412e7b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002499.724000:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578412e74 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578412e7b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.724020:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578412e74 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412e7b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.724026:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002499.724042:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578412e74 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412e7b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.724049:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578412e74 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412e7b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.724059:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002499.724061:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002499.724062:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002499.724073:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560842624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002499.724102:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786002499.724251:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002499.727318:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1786002499.727339:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34bc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3646:x1872758560842624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002499.727355:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002499.727378:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578412e7b lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578412e74 expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.727394:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed35a569300) 00010000:00010000:2.0:1786002499.727403:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002499.727467:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34bc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3646:x1872758560842624:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (3363us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.727475:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1786002499.727498:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:2.0:1786002499.727505:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3647:x1872758560842752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002499.727513:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002499.727525:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412e97 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x188:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578412e90 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.727536:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x188:0x0].0x0 (ffff9ed2456f9900) 00010000:00010000:2.0:1786002499.727545:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002499.727576:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758560842752:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.727582:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:3.0:1786002499.727728:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560842624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002499.763500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002499.788067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002499.809346:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530810880 00000100:00100000:3.0:1786002499.809355:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530810880 00000100:00100000:3.0:1786002499.809413:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23605 00000100:00100000:3.0:1786002499.809424:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:17696:x1872758530810880:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:3.0:1786002499.809478:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002499.809504:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578412eeb lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4a1 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.809521:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed35a569400) 00010000:00010000:3.0:1786002499.809530:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002499.809589:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412ef2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.809602:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.809611:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.809623:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578412ef9 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.809631:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578412ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.809637:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578412ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002499.811576:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].381, 2168 off579336 00000040:00080000:3.0:1786002499.811647:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].381, 2368 off628072 00000004:00080000:3.0:1786002499.811653:0:6520:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed366d7df00 with version 727 00000100:00100000:3.0:1786002499.822379:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560843008 00000100:00100000:3.0:1786002499.822387:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560843008 00000100:00100000:3.0:1786002499.822440:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3366 00000100:00100000:3.0:1786002499.822449:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560843008:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002499.822981:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7805:x1872758560843008:12345-0@lo:1000:osp_up1-0.0 Request processed in 531us (733us total) trans 4294968433 rc 0/0 00000100:00100000:3.0:1786002499.822992:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3366 00010000:00010000:3.0:1786002499.825506:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578412f00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.825521:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578412f00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.825533:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578412f00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.825549:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578412f07 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.825556:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578412f07 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.825563:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578412f07 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.825593:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 3/0,1 mode: --/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.825600:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 3/0,1 mode: --/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.825610:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 3/0,1 mode: --/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002499.825627:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560843136:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1786002499.825670:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002499.825707:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d600 going to sleep for 11 seconds 00000100:00100000:2.0:1786002499.826117:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560843136:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786002499.826139:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412f15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826149:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412f15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002499.826172:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036610b9e reply state 00000000459a8376 transno 4294983448 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578412f07 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826183:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578412f07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826189:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcf:0x0].0x0 (ffff9ed2456f9500) 00010000:00010000:2.0:1786002499.826192:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002499.826194:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002499.826200:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412f15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826207:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412f15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002499.826216:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xcf:0x0] 00000004:00010000:2.0:1786002499.826221:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036610b9e reply state 00000000459a8376 transno 4294983448 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578412f00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826227:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578412f00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826232:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152c:0x0].0x0 (ffff9ed2456f9f00) 00010000:00010000:2.0:1786002499.826234:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002499.826236:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1786002499.826240:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152c:0x0]: returning size 4096 00010000:00010000:2.0:1786002499.826249:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412ef2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826255:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412ef2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826261:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412ef2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826266:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412ef2 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826272:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002499.826277:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412ef2 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826284:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412ef2 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826294:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed2456f9700) 00010000:00010000:2.0:1786002499.826295:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002499.826299:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412ef2 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826304:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412ef2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002499.826319:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036610b9e reply state 00000000459a8376 transno 4294983448 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578412ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826328:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578412ef9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.826333:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x99bb250f (ffff9ed2456f9d00) 00010000:00010000:2.0:1786002499.826335:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002499.826337:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1786002499.826406:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:17696:x1872758530810880:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 16982us (17476us total) trans 4294983448 rc 0/0 00000100:00100000:2.0:1786002499.826414:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23605 00000100:00100000:3.0:1786002499.879150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002499.879208:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530811264 00000100:00100000:2.0:1786002499.879218:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530811264 00000100:00100000:2.0:1786002499.879277:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23607 00000100:00100000:2.0:1786002499.879296:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:17698:x1872758530811264:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002499.879317:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002499.879340:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578412f1c lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a4a8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879403:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412f23 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879417:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412f23 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879428:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412f23 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879439:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578412f2a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x99bb250f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879447:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578412f2a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879454:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578412f2a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879528:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af578412f31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879539:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af578412f31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879546:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af578412f31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002499.879623:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152c:0x0]: returning size 4096 00000004:00200000:2.0:1786002499.879628:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1786002499.879646:0:10360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af578412f31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879658:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412f23 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879665:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412f23 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879671:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412f23 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879677:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412f23 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879682:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002499.879686:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412f23 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879692:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412f23 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879703:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24559fa00) 00010000:00010000:2.0:1786002499.879707:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002499.879711:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412f23 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879717:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412f23 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879730:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578412f2a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879735:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578412f2a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879740:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578412f2a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879744:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002499.879747:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578412f2a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879752:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578412f2a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879758:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x99bb250f (ffff9ed2456f9d00) 00010000:00010000:2.0:1786002499.879760:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002499.879762:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578412f2a lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879767:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578412f2a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879789:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578412f1c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4a8 expref: 16 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879810:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af578412f31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4a8 expref: 15 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.879817:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152c:0x0].0x0 (ffff9ed2456f9f00) 00010000:00010000:2.0:1786002499.879819:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786002499.879821:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556ac00, rc 0) 00000100:00100000:2.0:1786002499.879951:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:17698:x1872758530811264:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 657us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.879958:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23607 00000100:00100000:2.0:1786002499.883998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002499.884049:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530811392 00000100:00100000:3.0:1786002499.884059:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530811392 00000100:00100000:3.0:1786002499.884111:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23608 00000100:00100000:3.0:1786002499.884121:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:17698:x1872758530811392:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:3.0:1786002499.884142:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002499.884161:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412f38 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a4af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.884220:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578412f3f lrc: 3/1,0 mode: --/PR res: [0x200000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.884233:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578412f3f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.884379:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578412f3f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002499.884427:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xcf:0x0]: returning size 4096 00000004:00200000:3.0:1786002499.884441:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002499.884483:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412f38 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4af expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.884501:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578412f3f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4af expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.884509:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xcf:0x0].0x0 (ffff9ed2456f9500) 00010000:00010000:3.0:1786002499.884512:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002499.884515:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34600, rc 0) 00000100:00100000:3.0:1786002499.884571:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17698:x1872758530811392:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 451us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002499.884579:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23608 00000100:00100000:3.0:1786002499.895415:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530811520 00000100:00100000:3.0:1786002499.895424:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530811520 00000100:00100000:3.0:1786002499.895671:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23609 00000100:00100000:3.0:1786002499.895682:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17698:x1872758530811520:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:3.0:1786002499.895704:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002499.895723:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578412f46 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a4b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.895777:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578412f4d lrc: 3/1,0 mode: --/PR res: [0x240000401:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.895792:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578412f15 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578412f0e expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.895800:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578412f4d lrc: 4/1,0 mode: --/PR res: [0x240000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.895829:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578412f15 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578412f0e expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002499.895865:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560843264:0@lo:104: 00000100:00100000:3.0:1786002499.895920:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002499.895962:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362de40 going to sleep for 11 seconds 00000100:00100000:2.0:1786002499.896051:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560843264 00000100:00100000:2.0:1786002499.896055:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560843264 00000100:00100000:2.0:1786002499.896100:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1786002499.896107:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6521:x1872758560843264:12345-0@lo:104: 00010000:00010000:2.0:1786002499.896173:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578412f15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.896229:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786002499.896235:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6521:x1872758560843264:12345-0@lo:104: Request processed in 130us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002499.896242:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00010000:00010000:2.0:1786002499.896261:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002499.896267:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578412f15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.896275:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002499.896897:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578412f15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002499.896916:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578412f15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.896943:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 2/0,0 mode: --/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578412f15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.896950:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002499.896976:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 1/0,0 mode: --/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578412f15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.896983:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578412f0e lrc: 0/0,0 mode: --/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578412f15 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.897001:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002499.897003:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002499.897005:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002499.897890:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560843392 00000100:00100000:2.0:1786002499.897896:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560843392 00010000:00010000:2.0:1786002499.897927:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578412f15 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578412f0e expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002499.897957:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:2.0:1786002499.897964:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+12:3645:x1872758560843392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002499.897973:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:3.0:1786002499.903023:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 735 rpc_version 735 00000020:00100000:3.0:1786002499.903050:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002499.903058:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243dd7800 x1872758560843776/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002499.903082:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560843776:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002499.903124:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002499.903151:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002499.903195:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560843392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002499.907705:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd7800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560843776:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1786002499.907719:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 736 rpc_version 736 00000020:00100000:3.0:1786002499.907737:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002499.907744:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243dd4700 x1872758560844032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002499.907764:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560844032:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002499.907799:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002499.907827:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002499.908351:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560844032:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002499.913878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002499.913918:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530811776 00000100:00100000:3.0:1786002499.913925:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530811776 00000100:00100000:3.0:1786002499.913966:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23610 00000100:00100000:3.0:1786002499.913976:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17698:x1872758530811776:12345-192.168.203.49@tcp:36:rmdir.0 00010000:00010000:3.0:1786002499.914027:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002499.914051:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af578412f31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4a8 expref: 16 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914067:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152c:0x0].0x0 (ffff9ed2456f9f00) 00010000:00010000:3.0:1786002499.914071:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002499.914095:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412f54 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914107:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412f54 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914117:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412f54 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914127:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578412f5b lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914134:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578412f5b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914140:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578412f5b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x99bb250f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914214:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578412f62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914222:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578412f62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914230:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578412f62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914257:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578412f69 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914267:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578412f3f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4af expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914279:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578412f69 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914309:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578412f3f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4af expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.914322:0:14496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578412f3f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4af expref: 15 pid: 6520 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002499.914336:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560844160:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002499.914400:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002499.914998:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560843520:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1786002499.918524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002499.925381:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560844160:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002499.925410:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578412f69 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002499.943689:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002499.943711:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530812032 00000100:00100000:2.0:1786002499.943719:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530812032 00010000:00010000:2.0:1786002499.943763:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578412f4d lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4b6 expref: 9 pid: 6521 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002499.943792:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1587 00000100:00100000:2.0:1786002499.943802:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758530812032:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002499.943815:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002499.943822:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578412f4d lrc: 5/0,0 mode: PR/PR res: [0x240000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4b6 expref: 9 pid: 6521 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.943835:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578412f4d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4b6 expref: 9 pid: 6521 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.943874:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcf:0x0].0x0 (ffff9ed35a569700) 00010000:00010000:2.0:1786002499.943881:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af578412f77 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578412f70 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.943892:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af578412f77 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7cee4af578412f70 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.943900:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af578412f77 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7cee4af578412f70 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002499.943941:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af578412f77 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578412f70 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002499.943955:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6507:1872758560844544:0@lo:105: 00000100:00100000:2.0:1786002499.943996:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002499.944026:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2ac00 going to sleep for 11 seconds 00010000:00010000:3.0:1786002499.944443:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578412f4d lrc: 0/0,0 mode: --/PR res: [0x240000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4b6 expref: 9 pid: 6521 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002499.944458:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6526:1872758560844416:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002499.944482:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af578412f77 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578412f70 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.944490:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcf:0x0].0x0 (ffff9ed35a569700) 00010000:00010000:3.0:1786002499.944493:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002499.944496:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f400, rc 0) 00000100:00100000:3.0:1786002499.944539:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14496:x1872758560844288:12345-0@lo:101:mdt00_004.0 Request processed in 11549us (11632us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002499.944547:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370 00000100:00100000:3.0:1786002499.944572:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560844544 00000100:00100000:3.0:1786002499.944576:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560844544 00000100:00100000:3.0:1786002499.944615:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1786002499.944622:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6507:x1872758560844544:12345-0@lo:105: 00010000:00010000:3.0:1786002499.944633:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af578412f70 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412f77 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.944642:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af578412f70 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412f77 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.944650:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af578412f70 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412f77 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.944657:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af578412f70 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578412f77 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.944663:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af578412f70 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578412f77 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.944670:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af578412f70 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578412f77 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.944682:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245e7fc00) 00000100:00100000:3.0:1786002499.944719:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6507:x1872758560844544:12345-0@lo:105: Request processed in 97us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002499.944726:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1786002499.944757:0:14496:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968433 gen 2 00000004:00080000:3.0:1786002499.944763:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968426 committed transno 4294968433 00000020:00080000:3.0:1786002499.944769:0:14496:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed245d3fe40 refcount 2 committed 0 result 0 batchid 385 00000020:00080000:3.0:1786002499.944772:0:14496:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245747800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d3fa80 00000020:00080000:3.0:1786002499.944775:0:14496:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].380 00000020:00080000:3.0:1786002499.944778:0:14496:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245747300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2465cd800 00000020:00080000:3.0:1786002499.944780:0:14496:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].380 00000004:00080000:3.0:1786002499.944799:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968428 committed transno 4294968433 00000100:00100000:2.0:1786002499.944799:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e16a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6507:1872758560844544:0@lo:105: 00000004:00080000:3.0:1786002499.944807:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968429 committed transno 4294968433 00010000:00010000:2.0:1786002499.944808:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1786002499.944815:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968430 committed transno 4294968433 00000004:00080000:3.0:1786002499.944823:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968431 committed transno 4294968433 00000004:00080000:3.0:1786002499.944831:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968433 committed transno 4294968433 00000100:00100000:2.0:1786002499.944841:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758530812032:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 1041us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002499.944844:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560844288:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002499.944864:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1587 00010000:00010000:3.0:1786002499.944871:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af578412f70 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412f77 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1786002499.945900:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 385 committed batchid 384 00000020:00080000:2.0:1786002499.945964:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 384 00000100:00100000:3.0:1786002499.948078:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560844672:0@lo:403:mdt00_004.0 00000100:00100000:3.0:1786002499.948142:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002499.949039:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002499.953565:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560844672:0@lo:403:mdt00_004.0 00000040:00080000:3.0:1786002499.954521:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].382, 664 off580000 00000040:00080000:3.0:1786002499.954664:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].382, 744 off628816 00000004:00080000:3.0:1786002499.954669:0:14496:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed24362d9c0 with version 728 00000100:00100000:2.0:1786002499.958289:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560844928 00000100:00100000:2.0:1786002499.958302:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560844928 00000100:00100000:2.0:1786002499.958356:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3372 00000100:00100000:2.0:1786002499.958365:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1872758560844928:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002499.958613:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560844928:12345-0@lo:1000:osp_up1-0.0 Request processed in 249us (3746us total) trans 4294968434 rc 0/0 00000100:00100000:2.0:1786002499.958621:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3372 00000100:00100000:2.0:1786002499.971036:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560845056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002499.971097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002499.972835:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560845056 00000100:00100000:3.0:1786002499.972872:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560845056 00000100:00100000:3.0:1786002499.972932:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1786002499.972942:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1872758560845056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002499.972956:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002499.972976:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af578412f77 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578412f70 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002499.972991:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xcf:0x0].0x0 (ffff9ed35a569700) 00010000:00010000:3.0:1786002499.973000:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002499.973049:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1872758560845056:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002499.973056:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1786002499.973180:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560845056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002499.995506:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002500.001130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002500.014210:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530812416 00000100:00100000:3.0:1786002500.014220:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530812416 00000100:00100000:3.0:1786002500.014315:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23613 00000100:00100000:3.0:1786002500.014325:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17699:x1872758530812416:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002500.014344:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002500.014364:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fa8 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a4cb expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.014416:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412faf lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.014428:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412faf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.014439:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412faf lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002500.014486:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1786002500.014490:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002500.014521:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fa8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4cb expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.014535:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412faf lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4cb expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.014543:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:3.0:1786002500.014546:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002500.014549:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:3.0:1786002500.014605:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:17699:x1872758530812416:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 281us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.014613:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23613 00000100:00100000:2.0:1786002500.031427:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530812672 00000100:00100000:2.0:1786002500.031440:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530812672 00000100:00100000:2.0:1786002500.032179:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560845184:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786002500.032220:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560845312:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786002500.032245:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002500.045448:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a600 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.062409:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786002500.062422:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560845696 00000100:00100000:2.0:1786002500.063381:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560845440:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786002500.063398:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47800/0x7cee4af578412fb6 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412fbd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.063409:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47800/0x7cee4af578412fb6 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412fbd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.069950:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560845696 00000100:00100000:3.0:1786002500.070299:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1786002500.070310:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243665050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10399:x1872758560845696:12345-0@lo:105: 00010000:00010000:3.0:1786002500.070336:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47800/0x7cee4af578412fb6 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412fbd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.070347:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47800/0x7cee4af578412fb6 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578412fbd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.070357:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47800/0x7cee4af578412fb6 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578412fbd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.070368:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47800/0x7cee4af578412fb6 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578412fbd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.070377:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47800/0x7cee4af578412fb6 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578412fbd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.070385:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47800/0x7cee4af578412fb6 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578412fbd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.070415:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245c47800) 00000100:00100000:3.0:1786002500.070502:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243665050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10399:x1872758560845696:12345-0@lo:105: Request processed in 194us (9102us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.070509:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:2.0:1786002500.070583:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:10399:1872758560845696:0@lo:105: 00010000:00010000:2.0:1786002500.070600:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002500.070650:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34bc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758530812800:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 10244us (13630us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002500.070660:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1588 00000100:00100000:2.0:1786002500.071347:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560845824 00000100:00100000:2.0:1786002500.071352:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560845824 00000100:00100000:2.0:1786002500.071390:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3376 00000100:00100000:2.0:1786002500.071397:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6520:x1872758560845824:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786002500.071411:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002500.071425:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412fcb lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578412fc4 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.071446:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412fcb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578412fc4 expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.071458:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578412fcb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578412fc4 expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.071471:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xebb9ffb1 (ffff9ed24559fa00) 00010000:00010000:2.0:1786002500.071474:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002500.071476:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556be00, rc 0) 00000100:00100000:2.0:1786002500.071504:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560845824:12345-0@lo:101:mdt00_000.0 Request processed in 109us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002500.071510:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3376 00000100:00100000:2.0:1786002500.080063:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560846464 00000100:00100000:2.0:1786002500.080078:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560846464 00000100:00100000:2.0:1786002500.080130:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3381 00000100:00100000:2.0:1786002500.080140:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560846464:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786002500.080276:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560846464:12345-0@lo:1000:mdt00_000.0 Request processed in 137us (6244us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002500.081926:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3381 00000100:00100000:3.0:1786002500.086443:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560846720 00000100:00100000:3.0:1786002500.086456:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560846720 00000100:00100000:3.0:1786002500.086515:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:3.0:1786002500.086524:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3647:x1872758560846720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002500.086538:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002500.086561:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578412fbd lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578412fb6 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.086575:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:3.0:1786002500.086586:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002500.086653:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3647:x1872758560846720:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (5487us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.086660:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:3.0:1786002500.086700:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560846720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002500.089447:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002500.089458:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af578412fc4 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578412fcb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.089470:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002500.089477:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af578412fc4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578412fcb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002500.089487:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af578412fc4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578412fcb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.089524:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af578412fc4 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412fcb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.089534:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002500.089560:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af578412fc4 lrc: 1/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412fcb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.089568:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af578412fc4 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578412fcb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.089586:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002500.089588:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002500.089589:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002500.108286:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530813056 00000100:00100000:3.0:1786002500.108296:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530813056 00000100:00100000:3.0:1786002500.108356:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23615 00000100:00100000:3.0:1786002500.108366:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17700:x1872758530813056:12345-192.168.203.49@tcp:36:mkdir.0 00010000:00010000:3.0:1786002500.108488:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fd2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.108503:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fd2 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.108514:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fd2 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.108526:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578412fd9 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.108533:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578412fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.108540:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578412fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.108935:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578412fe0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.108943:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578412fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.108950:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578412fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002500.108968:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e48ca5cf reply state 000000001c2fc8fe transno 4294983452 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578412fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.108978:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578412fe0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.108984:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff9ed2456f9800) 00010000:00010000:3.0:1786002500.108987:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002500.108990:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1786002500.108994:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152e:0x0]: returning size 4096 00010000:00010000:3.0:1786002500.109001:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fd2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.109007:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fd2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.109013:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fd2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.109019:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fd2 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.109025:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002500.109029:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fd2 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.109036:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fd2 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.109046:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:3.0:1786002500.109048:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002500.109052:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fd2 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.109057:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fd2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002500.109074:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e48ca5cf reply state 000000001c2fc8fe transno 4294983452 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578412fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.109082:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578412fd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.109088:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xebb9ffb1 (ffff9ed2456f9000) 00010000:00010000:3.0:1786002500.109090:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002500.109092:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1786002500.109162:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17700:x1872758530813056:12345-192.168.203.49@tcp:36:mkdir.0 Request processed in 796us (958us total) trans 4294983452 rc 0/0 00000100:00100000:3.0:1786002500.109169:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23615 00000100:00100000:3.0:1786002500.129886:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530813184 00000100:00100000:3.0:1786002500.129896:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530813184 00000100:00100000:3.0:1786002500.129956:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23616 00000100:00100000:3.0:1786002500.129966:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17702:x1872758530813184:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:3.0:1786002500.129986:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002500.130007:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fe7 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a4d2 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130065:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412fee lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130077:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412fee lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130091:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412fee lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130100:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412ff5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130107:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130113:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130177:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578412ffc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130185:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578412ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130192:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578412ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002500.130225:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152e:0x0]: returning size 4096 00000004:00200000:3.0:1786002500.130229:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786002500.130256:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578412ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130268:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412fee lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130274:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412fee lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130343:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412fee lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130350:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412fee lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130356:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002500.130360:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412fee lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130367:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412fee lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130378:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:3.0:1786002500.130381:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002500.130385:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412fee lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130391:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578412fee lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130403:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130408:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130414:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130418:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002500.130421:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130427:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130440:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xebb9ffb1 (ffff9ed2456f9000) 00010000:00010000:3.0:1786002500.130443:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002500.130445:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412ff5 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130450:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578412ff5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130473:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578412fe7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4d2 expref: 20 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130492:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578412ffc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4d2 expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.130500:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff9ed2456f9800) 00010000:00010000:3.0:1786002500.130502:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786002500.130504:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34000, rc 0) 00000100:00100000:3.0:1786002500.130561:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:17702:x1872758530813184:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 595us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.130567:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23616 00000100:00100000:3.0:1786002500.135361:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530813440 00000100:00100000:3.0:1786002500.135371:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530813440 00000100:00100000:3.0:1786002500.135422:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23617 00000100:00100000:3.0:1786002500.135431:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:17702:x1872758530813440:12345-192.168.203.49@tcp:36:rmdir.0 00010000:00010000:3.0:1786002500.135481:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002500.135506:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578412ffc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4d2 expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135524:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff9ed2456f9800) 00010000:00010000:3.0:1786002500.135529:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002500.135550:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413003 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135562:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413003 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135572:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413003 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135583:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841300a lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135590:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841300a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135595:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841300a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135659:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578413011 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135666:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578413011 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135672:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578413011 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002500.135867:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152e:0x0]: returning size 4096 00010000:00010000:3.0:1786002500.135881:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578413011 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135888:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578413011 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135895:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578413011 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135902:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002500.135915:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578413011 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135923:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578413011 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135931:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152e:0x0].0x0 (ffff9ed2456f9800) 00010000:00010000:3.0:1786002500.135934:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002500.135937:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578413011 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135943:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578413011 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x152e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135957:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413003 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135963:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413003 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135972:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413003 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135978:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413003 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135982:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002500.135985:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413003 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135990:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413003 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.135996:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed2456f9300) 00010000:00010000:3.0:1786002500.135998:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002500.136000:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413003 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.136005:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413003 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002500.136020:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005166d827 reply state 00000000fa1ee42f transno 4294983453 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841300a lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.136030:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841300a lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xebb9ffb1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.136036:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xebb9ffb1 (ffff9ed2456f9000) 00010000:00010000:3.0:1786002500.136038:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002500.136040:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002500.193159:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002500.206821:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002500.206923:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530813696 00000100:00100000:2.0:1786002500.206933:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530813696 00000100:00100000:2.0:1786002500.207001:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23619 00000100:00100000:2.0:1786002500.207011:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:17705:x1872758530813696:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002500.207033:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002500.207053:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a000/0x7cee4af57841302d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a4e0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.207107:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578413034 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.207120:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578413034 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.207130:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578413034 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002500.207171:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1786002500.207176:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002500.207208:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a000/0x7cee4af57841302d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4e0 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.207224:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578413034 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4e0 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.207232:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24559f100) 00010000:00010000:2.0:1786002500.207251:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002500.207255:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556be00, rc 0) 00000100:00100000:2.0:1786002500.207316:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:17705:x1872758530813696:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 306us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002500.207322:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23619 00000100:00100000:3.0:1786002500.251307:0:15596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:15596:1872758560847360:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002500.251341:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ea00/0x7cee4af578413042 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841303b expref: 7 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.251354:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed2456f9100) 00010000:00010000:3.0:1786002500.251357:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002500.251361:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ea00/0x7cee4af578413042 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841303b expref: 7 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.251371:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7ea00, rc 0) 00000100:00100000:3.0:1786002500.251423:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6520:x1872758560847232:12345-0@lo:101:mdt00_000.0 Request processed in 12193us (12266us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.251431:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3385 00000004:00080000:3.0:1786002500.293037:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 729 rpc_version 729 00000020:00100000:3.0:1786002500.293078:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002500.293088:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243dd6300 x1872758560848640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002500.293111:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560848640:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002500.293179:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.293208:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.293229:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560848640 00000100:00100000:3.0:1786002500.293235:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560848640 00000100:00100000:3.0:1786002500.293289:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3393 00000100:00100000:3.0:1786002500.293298:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560848640:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002500.293942:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560848640:12345-0@lo:1000:osp_up1-0.0 Request processed in 634us (752us total) trans 4294968435 rc 0/0 00000100:00100000:3.0:1786002500.293954:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3393 00000100:00100000:3.0:1786002500.294018:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560848640:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1786002500.294113:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578413057 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294128:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578413057 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294139:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578413057 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294158:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841305e lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294165:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841305e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294172:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841305e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294197:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294203:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294212:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.294224:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560848768:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1786002500.294248:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.294262:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.294275:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560848768 00000100:00100000:3.0:1786002500.294279:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560848768 00000100:00100000:3.0:1786002500.294301:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3394 00000100:00100000:3.0:1786002500.294308:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6520:x1872758560848768:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786002500.294320:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002500.294333:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841306c lrc: 2/0,0 mode: --/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413065 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294351:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841306c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413065 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294361:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841306c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413065 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294370:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd0:0x0].0x0 (ffff9ed2456f9400) 00010000:00010000:3.0:1786002500.294373:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002500.294377:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34000, rc 0) 00000100:00100000:3.0:1786002500.294402:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560848768:12345-0@lo:101:mdt00_000.0 Request processed in 95us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.294408:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3394 00000100:00100000:3.0:1786002500.294433:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560848768:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786002500.294444:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841306c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294453:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841306c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002500.294476:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031685691 reply state 0000000090ef74f0 transno 4294983454 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841305e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294487:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841305e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294493:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd0:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:3.0:1786002500.294496:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002500.294498:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002500.294504:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841306c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294512:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841306c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002500.294522:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xd0:0x0] 00000004:00010000:3.0:1786002500.294527:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031685691 reply state 0000000090ef74f0 transno 4294983454 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578413057 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x152f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294535:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578413057 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x152f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294541:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff9ed2456f9300) 00010000:00010000:3.0:1786002500.294543:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002500.294545:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1786002500.294549:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152f:0x0]: returning size 4096 00000004:00080000:3.0:1786002500.294555:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1786002500.294561:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e800/0x7cee4af57841303b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413042 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294574:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e800/0x7cee4af57841303b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413042 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294581:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e800/0x7cee4af57841303b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413042 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294603:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002500.294607:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1786002500.294611:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46c00/0x7cee4af578413049 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413050 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.294619:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46c00/0x7cee4af578413049 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413050 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.294693:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17705:x1872758530813952:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 57552us (57698us total) trans 4294983454 rc 0/0 00000100:00100000:3.0:1786002500.294700:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23620 00000100:00100000:3.0:1786002500.346564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002500.346595:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530814336 00000100:00100000:3.0:1786002500.346603:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530814336 00000100:00100000:3.0:1786002500.346651:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23621 00000100:00100000:3.0:1786002500.346661:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:17712:x1872758530814336:12345-192.168.203.49@tcp:36:mkdir.0 00000100:00100000:3.0:1786002500.346793:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:17712:x1872758530814336:12345-192.168.203.49@tcp:36:mkdir.0 Request processed in 134us (238us total) trans 0 rc -17/-17 00000100:00100000:3.0:1786002500.346800:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23621 00000100:00100000:3.0:1786002500.396948:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560849408 00000100:00100000:3.0:1786002500.396958:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560849408 00000100:00100000:3.0:1786002500.397001:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560849536 00000100:00100000:3.0:1786002500.397004:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560849536 00000100:00100000:3.0:1786002500.397022:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3395 00000100:00100000:3.0:1786002500.397030:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7474:x1872758560849408:12345-0@lo:1000:dist_txn-1.0 00000100:00100000:3.0:1786002500.397120:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7474:x1872758560849408:12345-0@lo:1000:dist_txn-1.0 Request processed in 90us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.397128:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3395 00000100:00100000:3.0:1786002500.397144:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3396 00000100:00100000:3.0:1786002500.397151:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:10360:x1872758560849536:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002500.397224:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:10360:x1872758560849536:12345-0@lo:1000:mdt00_003.0 Request processed in 72us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.397230:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3396 00000100:00100000:3.0:1786002500.397910:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c42300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560849536:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1786002500.397963:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578413088 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.397977:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578413088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.397987:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578413088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002500.398007:0:10360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578413088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398020:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af57841307a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398026:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af57841307a lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398033:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af57841307a lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398039:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af57841307a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398044:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002500.398048:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af57841307a lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398055:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af57841307a lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398064:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed35363dd00) 00010000:00010000:3.0:1786002500.398067:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002500.398071:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af57841307a lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398077:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af57841307a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398088:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af578413081 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398094:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af578413081 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398099:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af578413081 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398104:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002500.398107:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af578413081 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398112:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af578413081 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398118:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6bb7d880 (ffff9ed245e3be00) 00010000:00010000:3.0:1786002500.398120:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002500.398122:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af578413081 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398128:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af578413081 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398161:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413073 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4e7 expref: 9 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398178:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578413088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4e7 expref: 8 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.398186:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff9ed2456f9700) 00010000:00010000:3.0:1786002500.398188:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002500.398190:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34a00, rc 0) 00000100:00100000:3.0:1786002500.398269:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17713:x1872758530814464:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 20065us (20181us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.398285:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23622 00000004:00080000:3.0:1786002500.398319:0:7474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 0 committed transno 4294983446 00000100:00100000:3.0:1786002500.398327:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40000 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:7474:1872758560849408:0@lo:1000:dist_txn-1.0 00000020:00080000:3.0:1786002500.398346:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 387 cancel update log [0x200000401:0x3:0x0].384: rc = -2 00000020:00080000:3.0:1786002500.398424:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 387 cancel update log [0x240000400:0x3:0x0].385: rc = 0 00000020:00080000:3.0:1786002500.398435:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 387 00000100:00100000:3.0:1786002500.411572:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002500.411601:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530814592 00000100:00100000:3.0:1786002500.411609:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530814592 00000100:00100000:3.0:1786002500.411652:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23623 00000100:00100000:3.0:1786002500.411661:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17713:x1872758530814592:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:3.0:1786002500.411682:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002500.411701:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af57841308f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a4ee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.411752:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578413096 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.411764:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578413096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.411775:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578413096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002500.411868:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x152f:0x0]: returning size 4096 00000004:00200000:3.0:1786002500.411873:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002500.411914:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af57841308f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x152f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4ee expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.411931:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578413096 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4ee expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.411940:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff9ed2456f9300) 00010000:00010000:3.0:1786002500.411944:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002500.411947:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:3.0:1786002500.411990:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17713:x1872758530814592:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 330us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.411998:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23623 00000100:00100000:3.0:1786002500.417572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002500.417641:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530814720 00000100:00100000:2.0:1786002500.417650:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530814720 00000100:00100000:2.0:1786002500.417714:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23624 00000100:00100000:2.0:1786002500.417724:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17713:x1872758530814720:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002500.417743:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002500.417762:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841309d lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a4f5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.417812:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784130a4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.417824:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784130a4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.417835:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784130a4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002500.417915:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd0:0x0]: returning size 4096 00000004:00200000:2.0:1786002500.417919:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002500.417950:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841309d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4f5 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.417964:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784130a4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4f5 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.417972:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd0:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:2.0:1786002500.417975:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002500.417977:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b000, rc 0) 00000100:00100000:2.0:1786002500.418024:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17713:x1872758530814720:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 301us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002500.418031:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23624 00000100:00100000:3.0:1786002500.424176:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530814848 00000100:00100000:3.0:1786002500.424186:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530814848 00000100:00100000:3.0:1786002500.424246:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23625 00000100:00100000:3.0:1786002500.424256:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17713:x1872758530814848:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:3.0:1786002500.424285:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002500.424306:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784130ab lrc: 2/0,0 mode: --/CR res: [0x240000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a4fc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.424368:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784130b2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.424381:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841306c lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413065 expref: 5 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.424389:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784130b2 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.424419:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841306c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578413065 expref: 5 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.424434:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:10360:1872758560849664:0@lo:104: 00000100:00100000:3.0:1786002500.424477:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.424513:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.424528:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560849664 00000100:00100000:3.0:1786002500.424532:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560849664 00000100:00100000:3.0:1786002500.424555:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1786002500.424561:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10360:x1872758560849664:12345-0@lo:104: 00010000:00010000:3.0:1786002500.424574:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af57841306c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.424616:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786002500.424622:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10360:x1872758560849664:12345-0@lo:104: Request processed in 61us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.424629:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00010000:00010000:3.0:1786002500.424650:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002500.424656:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af57841306c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.424665:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35a00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002500.424671:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af57841306c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002500.424681:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af57841306c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.424704:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af57841306c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.424711:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002500.424728:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af57841306c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.424742:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35a00/0x7cee4af578413065 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af57841306c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.424779:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002500.424781:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002500.424783:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002500.424793:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560849792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002500.424818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.424870:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560849792 00000100:00100000:3.0:1786002500.424874:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560849792 00010000:00010000:3.0:1786002500.424888:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841306c lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578413065 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.424919:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:3.0:1786002500.424926:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1872758560849792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002500.424934:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786002500.425362:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:10360:1872758560849664:0@lo:104: 00010000:00010000:3.0:1786002500.425379:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784130b2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.428883:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784130b2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.428892:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784130b2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002500.428952:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xd0:0x0]: returning size 4096 00000004:00200000:3.0:1786002500.428958:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002500.428995:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784130ab lrc: 0/0,0 mode: --/CR res: [0x240000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4fc expref: 10 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.429008:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784130b2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4fc expref: 9 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.429016:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd0:0x0].0x0 (ffff9ed2456f9400) 00010000:00010000:3.0:1786002500.429019:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002500.429021:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34800, rc 0) 00000100:00100000:3.0:1786002500.429063:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17713:x1872758530814848:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 4808us (4965us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.429069:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23625 00000100:00100000:3.0:1786002500.433150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002500.433690:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560849920 00000100:00100000:3.0:1786002500.433695:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560849920 00000100:00100000:3.0:1786002500.433728:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3397 00000100:00100000:3.0:1786002500.433735:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14496:x1872758560849920:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002500.433745:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002500.433759:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af5784130c0 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784130b9 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.433790:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af5784130c0 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784130b9 expref: 6 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.433803:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af5784130c0 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784130b9 expref: 6 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.433815:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed2456f9b00) 00010000:00010000:3.0:1786002500.433818:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002500.433820:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35a00, rc 0) 00000100:00100000:3.0:1786002500.433986:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:14496:x1872758560849920:12345-0@lo:101:mdt00_004.0 Request processed in 251us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.433994:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3397 00000100:00100000:3.0:1786002500.434068:0:14496:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968435 gen 2 00000004:00080000:3.0:1786002500.434074:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968434 committed transno 4294968435 00000004:00080000:3.0:1786002500.434092:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968435 committed transno 4294968435 00000100:00100000:3.0:1786002500.434110:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560849920:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002500.434124:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af5784130b9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784130c0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.434135:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af5784130b9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784130c0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002500.434148:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1786002500.434166:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784130c7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.434172:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784130c7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.434179:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784130c7 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.434192:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560850048:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1786002500.434218:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.434232:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.434244:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560850048 00000100:00100000:3.0:1786002500.434248:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560850048 00000100:00100000:3.0:1786002500.434270:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3398 00000100:00100000:2.0:1786002500.434379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002500.434403:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530814976 00000100:00100000:2.0:1786002500.434406:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530814976 00000100:00100000:2.0:1786002500.434438:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1375 00000100:00100000:2.0:1786002500.434445:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34bc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758530814976:12345-192.168.203.49@tcp:103:rmdir.0 00010000:00010000:2.0:1786002500.434454:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002500.434466:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578413088 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x152f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4e7 expref: 9 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.434478:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff9ed2456f9700) 00010000:00010000:2.0:1786002500.434486:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002500.434526:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34bc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758530814976:12345-192.168.203.49@tcp:103:rmdir.0 Request processed in 81us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002500.434533:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1375 00000100:00100000:3.0:1786002500.434594:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14496:x1872758560850048:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002500.434603:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002500.434615:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784130ce lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784130c7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.434628:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784130ce lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784130c7 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.434638:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784130ce lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784130c7 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.434645:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x6bb7d880 (ffff9ed2456f9a00) 00010000:00010000:3.0:1786002500.434647:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002500.434650:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5aa00, rc 0) 00000100:00100000:3.0:1786002500.434683:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14496:x1872758560850048:12345-0@lo:101:mdt00_004.0 Request processed in 407us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.434689:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3398 00000100:00100000:2.0:1786002500.434740:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560850048:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002500.434750:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784130c7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784130ce expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.434759:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784130c7 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x6bb7d880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784130ce expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002500.434769:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:2.0:1786002500.434795:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e14700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560850176:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1786002500.434819:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002500.434838:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.434894:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560850176 00000100:00100000:3.0:1786002500.434898:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560850176 00000100:00100000:3.0:1786002500.434939:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3399 00000100:00100000:3.0:1786002500.434945:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14496:x1872758560850176:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.434998:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14496:x1872758560850176:12345-0@lo:1000:mdt00_004.0 Request processed in 53us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.435008:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3399 00000100:00100000:3.0:1786002500.435030:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e14700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560850176:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.435063:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560850304:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.435085:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.435096:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611600 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.435106:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560850304 00000100:00100000:3.0:1786002500.435109:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560850304 00000100:00100000:3.0:1786002500.435123:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3400 00000100:00100000:3.0:1786002500.435128:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14496:x1872758560850304:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.435190:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14496:x1872758560850304:12345-0@lo:1000:mdt00_004.0 Request processed in 61us (104us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002500.435196:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3400 00000100:00100000:3.0:1786002500.435216:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560850304:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1786002500.435250:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af5784130d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.435257:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af5784130d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.435264:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af5784130d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.435366:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560850432:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1786002500.435391:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.435440:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611240 going to sleep for 11 seconds 00000100:00100000:2.0:1786002500.441516:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560850432 00000100:00100000:2.0:1786002500.441529:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560850432 00000100:00100000:2.0:1786002500.441588:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3401 00000100:00100000:2.0:1786002500.441598:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14496:x1872758560850432:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002500.441619:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002500.441643:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af5784130dc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784130d5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.441671:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af5784130dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784130d5 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.441685:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af5784130dc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784130d5 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.441694:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x152f:0x0].0x0 (ffff9ed24559f000) 00010000:00010000:2.0:1786002500.441697:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002500.441701:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556aa00, rc 0) 00000100:00100000:2.0:1786002500.441763:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:14496:x1872758560850432:12345-0@lo:101:mdt00_004.0 Request processed in 167us (6371us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002500.441770:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3401 00000100:00100000:2.0:1786002500.441814:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560850432:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002500.441832:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af5784130d5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784130dc expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.441867:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af5784130d5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784130dc expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.441896:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784130e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.441916:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784130e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.441923:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784130e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x152f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.441940:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784130ea lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.441951:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784130a4 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4f5 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.441961:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784130ea lrc: 4/0,1 mode: --/EX res: [0x200000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.441988:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784130a4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4f5 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.442003:0:14496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784130a4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4f5 expref: 24 pid: 6522 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002500.442016:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e17100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560850560:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002500.442078:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.451510:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002500.451623:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e17100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560850560:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002500.451649:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784130ea lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.452253:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784130ea lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.452260:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784130ea lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.452310:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556bc00/0x7cee4af5784130f1 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.452318:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556bc00/0x7cee4af5784130f1 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.452328:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556bc00/0x7cee4af5784130f1 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002500.452346:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e17100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560850688:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002500.452383:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002500.452407:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.452530:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560850688 00000100:00100000:3.0:1786002500.452535:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560850688 00000100:00100000:3.0:1786002500.452571:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3402 00000100:00100000:3.0:1786002500.452579:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:14496:x1872758560850688:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002500.452593:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002500.452607:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784130f8 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784130f1 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.452626:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784130b2 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4fc expref: 7 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.452636:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784130f8 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784130f1 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.452658:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784130b2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4fc expref: 7 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.452669:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784130b2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4fc expref: 7 pid: 10360 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.452681:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6526:1872758560850816:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002500.452720:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611600 going to sleep for 11 seconds 00010000:00010000:3.0:1786002500.466050:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784130b2 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4fc expref: 7 pid: 10360 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.466064:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6526:1872758560850816:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002500.466079:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784130f8 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784130f1 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.466092:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd0:0x0].0x0 (ffff9ed2456f9400) 00010000:00010000:3.0:1786002500.466095:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002500.466097:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b600, rc 0) 00000100:00100000:3.0:1786002500.466134:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:14496:x1872758560850688:12345-0@lo:101:mdt00_004.0 Request processed in 13557us (13750us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.466141:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3402 00000100:00100000:3.0:1786002500.466175:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e17100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560850688:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002500.466189:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556bc00/0x7cee4af5784130f1 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784130f8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.466806:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560851072:0@lo:403:mdt00_004.0 00000100:00100000:3.0:1786002500.466840:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.466873:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e611600 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.466887:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560851072 00000100:00100000:3.0:1786002500.466890:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560851072 00000100:00100000:3.0:1786002500.466930:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3403 00000100:00100000:3.0:1786002500.466938:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:14496:x1872758560851072:12345-0@lo:403:mdt00_004.0 00000100:00100000:3.0:1786002500.468474:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:14496:x1872758560851072:12345-0@lo:403:mdt00_004.0 Request processed in 1531us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.468483:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3403 00000100:00100000:3.0:1786002500.468530:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560851072:0@lo:403:mdt00_004.0 00000040:00080000:3.0:1786002500.474670:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].384, 664 off582832 00000040:00080000:3.0:1786002500.474819:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].384, 744 off631928 00000004:00080000:3.0:1786002500.474825:0:14496:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed36e611600 with version 730 00010000:00010000:3.0:1786002500.498354:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002500.501453:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1786002500.501469:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3646:x1872758560851840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002500.501483:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002500.501504:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af5784130c0 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784130b9 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.501517:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed2456f9b00) 00010000:00010000:3.0:1786002500.501526:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002500.501569:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3646:x1872758560851840:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (3483us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.501576:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:2.0:1786002500.530037:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530815616 00000100:00100000:2.0:1786002500.530046:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530815616 00000100:00100000:2.0:1786002500.530131:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23627 00000100:00100000:2.0:1786002500.530142:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17714:x1872758530815616:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002500.530164:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002500.530182:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784130ff lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a503 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530238:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556bc00/0x7cee4af578413106 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530257:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556bc00/0x7cee4af578413106 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530269:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556bc00/0x7cee4af578413106 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530288:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841310d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530295:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841310d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530301:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841310d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530341:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556bc00/0x7cee4af578413106 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530348:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556bc00/0x7cee4af578413106 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530356:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556bc00/0x7cee4af578413106 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530363:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556bc00/0x7cee4af578413106 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530370:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556bc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002500.530375:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556bc00/0x7cee4af578413106 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530382:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556bc00/0x7cee4af578413106 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530393:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24559f100) 00010000:00010000:2.0:1786002500.530396:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002500.530400:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556bc00/0x7cee4af578413106 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530407:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556bc00/0x7cee4af578413106 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530419:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841310d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530426:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841310d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530431:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841310d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530436:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556ac00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002500.530439:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841310d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530450:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841310d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530457:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x8fdbecc8 (ffff9ed24559f800) 00010000:00010000:2.0:1786002500.530460:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002500.530463:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841310d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530469:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841310d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530498:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784130ff lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a503 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530508:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24559f100) 00010000:00010000:2.0:1786002500.530511:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002500.530514:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784130ff lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a503 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.530523:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556aa00, rc 0) 00000100:00100000:2.0:1786002500.530582:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17714:x1872758530815616:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 441us (748us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002500.530590:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23627 00000100:00100000:3.0:1786002500.543881:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002500.565926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002500.576031:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560852096 00000100:00100000:3.0:1786002500.576036:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560852096 00000100:00100000:3.0:1786002500.576070:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3407 00000100:00100000:3.0:1786002500.576078:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:14496:x1872758560852096:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.576144:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:14496:x1872758560852096:12345-0@lo:1000:mdt00_004.0 Request processed in 67us (194us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002500.576151:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3407 00000100:00100000:3.0:1786002500.578452:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560852224 00000100:00100000:3.0:1786002500.578458:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560852224 00000100:00100000:3.0:1786002500.578491:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3408 00000100:00100000:3.0:1786002500.578498:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:14496:x1872758560852224:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002500.578510:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002500.578525:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413129 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413122 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.578553:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578413034 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4e0 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.578562:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413129 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413122 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.578584:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578413034 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4e0 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.578597:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578413034 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a4e0 expref: 23 pid: 6522 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.578608:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419adc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6525:1872758560852352:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002500.578682:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2540 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.594739:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002500.595080:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560852224:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002500.595097:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.595111:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.595626:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560852480 00000100:00100000:3.0:1786002500.595630:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560852480 00000100:00100000:3.0:1786002500.595659:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:3.0:1786002500.595666:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10399:x1872758560852480:12345-0@lo:105: 00010000:00010000:3.0:1786002500.595675:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.595684:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.595692:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.595701:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.595709:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.595716:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.595765:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245e7ee00) 00000100:00100000:3.0:1786002500.595800:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10399:x1872758560852480:12345-0@lo:105: Request processed in 134us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.595806:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00010000:00010000:2.0:1786002500.601876:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.601892:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002500.601925:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002500.601963:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a200/0x7cee4af578413130 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.601971:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a200/0x7cee4af578413130 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.601982:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a200/0x7cee4af578413130 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002500.602005:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560852608:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002500.602057:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002500.602083:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a300 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.602542:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e16680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560852608:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002500.602558:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a200/0x7cee4af578413130 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413137 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.602567:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a200/0x7cee4af578413130 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413137 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002500.602577:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:3.0:1786002500.602606:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560852736:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.602631:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.602653:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560852736 00000100:00100000:3.0:1786002500.602656:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560852736 00000100:00100000:3.0:1786002500.602675:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3410 00000100:00100000:3.0:1786002500.602681:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560852736:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.602727:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560852736:12345-0@lo:1000:mdt00_004.0 Request processed in 45us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.602733:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3410 00000100:00100000:3.0:1786002500.602748:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2540 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.602759:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560852736:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.602790:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560852864:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.602809:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.602825:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560852864 00000100:00100000:3.0:1786002500.602828:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560852864 00000100:00100000:3.0:1786002500.602841:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3411 00000100:00100000:3.0:1786002500.602866:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560852864:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.602926:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560852864:12345-0@lo:1000:mdt00_004.0 Request processed in 79us (116us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002500.602932:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3411 00000100:00100000:3.0:1786002500.602946:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362da80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.602956:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560852864:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.603012:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560852992:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.603032:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.603049:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560852992 00000100:00100000:3.0:1786002500.603052:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560852992 00000100:00100000:3.0:1786002500.603066:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3412 00000100:00100000:3.0:1786002500.603071:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560852992:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.603105:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560852992:12345-0@lo:1000:mdt00_004.0 Request processed in 34us (71us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002500.603114:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3412 00000100:00100000:3.0:1786002500.603128:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362da80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.603139:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560852992:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.603178:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560853120:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.603198:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.603214:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560853120 00000100:00100000:3.0:1786002500.603217:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560853120 00000100:00100000:3.0:1786002500.603232:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3413 00000100:00100000:3.0:1786002500.603237:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560853120:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.603423:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560853120:12345-0@lo:1000:mdt00_004.0 Request processed in 185us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.603530:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3413 00000100:00100000:3.0:1786002500.603548:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362da80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.603559:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560853120:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.603591:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560853248:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002500.603610:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.603656:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362da80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002500.607752:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560853248:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1786002500.607814:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560853376:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1786002500.607842:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002500.615417:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1786002500.617179:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e16680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560853376:0@lo:1000:mdt00_004.0 00000040:00080000:2.0:1786002500.618033:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].387, 2168 off594824 00000040:00080000:2.0:1786002500.618101:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].386, 2368 off641840 00000004:00080000:2.0:1786002500.618106:0:14496:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed244e2a0c0 with version 737 00000100:00100000:2.0:1786002500.618488:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560853632 00000100:00100000:2.0:1786002500.618494:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560853632 00000100:00100000:2.0:1786002500.618527:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3416 00000100:00100000:2.0:1786002500.618535:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:7466:x1872758560853632:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002500.618969:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:7466:x1872758560853632:12345-0@lo:1000:osp_up0-1.0 Request processed in 434us (696us total) trans 4294983456 rc 0/0 00000100:00100000:2.0:1786002500.618976:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3416 00000100:00100000:2.0:1786002500.625388:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560853760 00000100:00100000:2.0:1786002500.625398:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560853760 00000100:00100000:2.0:1786002500.625453:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3417 00000100:00100000:2.0:1786002500.625463:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:14496:x1872758560853760:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002500.625484:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002500.625504:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af578413153 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841314c expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625527:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af578413153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841314c expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625539:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af578413153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841314c expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625547:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xce:0x0].0x0 (ffff9ed24559fd00) 00010000:00010000:2.0:1786002500.625550:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002500.625553:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556ae00, rc 0) 00000100:00100000:2.0:1786002500.625612:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:14496:x1872758560853760:12345-0@lo:101:mdt00_004.0 Request processed in 151us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002500.625618:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3417 00000100:00100000:2.0:1786002500.625662:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560853760:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002500.625678:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af57841314c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413153 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625687:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af57841314c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413153 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002500.625708:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f07cd7a reply state 00000000da2bf23c transno 4294968437 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413145 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625718:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413145 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625724:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xce:0x0].0x0 (ffff9ed245e3b000) 00010000:00010000:2.0:1786002500.625726:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002500.625729:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002500.625734:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af57841314c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413153 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625741:0:14496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af57841314c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413153 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002500.625751:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xce:0x0] 00000004:00010000:2.0:1786002500.625756:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f07cd7a reply state 00000000da2bf23c transno 4294968437 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af57841313e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625763:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af57841313e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625768:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9ed245e3bb00) 00010000:00010000:2.0:1786002500.625770:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002500.625772:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1786002500.625776:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00000004:00080000:2.0:1786002500.625784:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002500.625792:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625800:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625807:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625829:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002500.625833:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002500.625838:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a200/0x7cee4af578413130 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413137 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.625858:0:14496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a200/0x7cee4af578413130 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413137 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.626028:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002500.626036:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.626043:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ee00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002500.626047:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002500.626054:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.626080:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.626086:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002500.626106:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.626114:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ee00/0x7cee4af578413122 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413129 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.626130:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002500.626132:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002500.626134:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002500.626154:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560853888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002500.627671:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:17714:x1872758530816000:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 52179us (61747us total) trans 4294968437 rc 0/0 00000100:00100000:2.0:1786002500.627680:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23629 00000100:00100000:3.0:1786002500.631718:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.631841:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560853888 00000100:00100000:3.0:1786002500.631875:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560853888 00000100:00100000:3.0:1786002500.631933:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1786002500.631943:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34bc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3644:x1872758560853888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002500.631957:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002500.631978:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413129 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413122 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.631993:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24559f100) 00010000:00010000:3.0:1786002500.632003:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002500.632038:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34bc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3644:x1872758560853888:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.632049:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1786002500.632108:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560853888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002500.656110:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002500.656195:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530816384 00000100:00100000:2.0:1786002500.656204:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530816384 00000100:00100000:2.0:1786002500.656262:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23630 00000100:00100000:2.0:1786002500.656281:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17715:x1872758530816384:12345-192.168.203.49@tcp:36:mkdir.0 00000100:00100000:2.0:1786002500.656434:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17715:x1872758530816384:12345-192.168.203.49@tcp:36:mkdir.0 Request processed in 162us (330us total) trans 0 rc -17/-17 00000100:00100000:2.0:1786002500.656442:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23630 00000100:00100000:2.0:1786002500.689482:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530816512 00000100:00100000:2.0:1786002500.689492:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530816512 00000100:00100000:2.0:1786002500.689551:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23631 00000100:00100000:2.0:1786002500.689562:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17716:x1872758530816512:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002500.689581:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002500.689603:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af57841315a lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a511 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.689664:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578413161 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.689676:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578413161 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.689686:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578413161 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.689696:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578413168 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.689705:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af578413137 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413130 expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.689712:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578413168 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.689744:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af578413137 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578413130 expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002500.689759:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560854016:0@lo:104: 00000100:00100000:2.0:1786002500.689796:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002500.689840:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002500.689874:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560854016 00000100:00100000:2.0:1786002500.689878:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560854016 00000100:00100000:2.0:1786002500.689913:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1786002500.689920:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10360:x1872758560854016:12345-0@lo:104: 00010000:00010000:2.0:1786002500.689932:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a200/0x7cee4af578413130 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578413137 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.689975:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786002500.689980:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10360:x1872758560854016:12345-0@lo:104: Request processed in 62us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002500.689988:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1786002500.690022:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e16680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560854016:0@lo:104: 00010000:00010000:2.0:1786002500.690039:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578413168 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.691077:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560854144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002500.691112:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002500.713131:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530816640 00000100:00100000:2.0:1786002500.713139:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530816640 00000100:00100000:2.0:1786002500.713193:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23632 00000100:00100000:2.0:1786002500.713204:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:17716:x1872758530816640:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002500.713224:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002500.713243:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a000/0x7cee4af578413176 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a518 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.713363:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af57841317d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.713379:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af57841317d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.713391:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af57841317d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002500.713497:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18b:0x0]: returning size 4096 00000004:00200000:2.0:1786002500.713502:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002500.713543:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a000/0x7cee4af578413176 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a518 expref: 12 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.713559:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af57841317d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a518 expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.713568:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9ed245e3bb00) 00010000:00010000:2.0:1786002500.713571:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002500.713574:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a200, rc 0) 00000100:00100000:2.0:1786002500.713680:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17716:x1872758530816640:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 477us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002500.713688:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23632 00000100:00100000:3.0:1786002500.724683:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530816768 00000100:00100000:3.0:1786002500.724692:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530816768 00000100:00100000:3.0:1786002500.724738:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23633 00000100:00100000:3.0:1786002500.724748:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17716:x1872758530816768:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:3.0:1786002500.724767:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002500.724785:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b400/0x7cee4af578413184 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a51f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.724834:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841318b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.724861:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841318b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.724872:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841318b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002500.724927:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xce:0x0]: returning size 4096 00000004:00200000:3.0:1786002500.724932:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002500.724963:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b400/0x7cee4af578413184 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a51f expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.724980:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841318b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a51f expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.724989:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xce:0x0].0x0 (ffff9ed245e3b000) 00010000:00010000:3.0:1786002500.724992:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002500.724996:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5ba00, rc 0) 00000100:00100000:3.0:1786002500.725049:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:17716:x1872758530816768:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 302us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.725056:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23633 00000100:00100000:3.0:1786002500.732807:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786002500.732818:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560854784 00000100:00100000:3.0:1786002500.732822:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560854784 00000100:00100000:3.0:1786002500.732868:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1786002500.732876:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10360:x1872758560854784:12345-0@lo:104: 00010000:00010000:3.0:1786002500.732888:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af57841314c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578413153 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.732944:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786002500.732950:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10360:x1872758560854784:12345-0@lo:104: Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.732957:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00010000:00010000:3.0:1786002500.733002:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002500.733008:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af57841314c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578413153 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.733016:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47c00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002500.733022:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af57841314c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578413153 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002500.733037:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af57841314c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578413153 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.733060:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af57841314c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413153 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.733066:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002500.733084:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af57841314c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413153 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.733092:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af57841314c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413153 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.733107:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002500.733109:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002500.733110:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002500.733117:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002500.733125:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560854912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002500.733151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.733181:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560854912 00000100:00100000:3.0:1786002500.733185:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560854912 00010000:00010000:3.0:1786002500.733200:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af578413153 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af57841314c expref: 7 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.733221:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596 00000100:00100000:3.0:1786002500.733227:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3646:x1872758560854912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002500.733235:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786002500.733782:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560854784:0@lo:104: 00010000:00010000:3.0:1786002500.733807:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578413199 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1786002500.736565:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 388 batchid updated 00000100:00100000:2.0:1786002500.737723:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560855424 00000100:00100000:2.0:1786002500.737728:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560855424 00000100:00100000:2.0:1786002500.737757:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3421 00000100:00100000:2.0:1786002500.737764:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560855424:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002500.737873:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560855424:12345-0@lo:1000:osp_up1-0.0 Request processed in 81us (400us total) trans 4294968440 rc 0/0 00000100:00100000:2.0:1786002500.737881:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3421 00000100:00100000:3.0:1786002500.748423:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560855424:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786002500.748441:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 734 rpc_version 734 00000020:00100000:3.0:1786002500.748467:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002500.748474:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2419aca80 x1872758560855680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002500.748496:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419aca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560855680:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002500.748556:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.748586:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d540 going to sleep for 11 seconds 00010000:00010000:3.0:1786002500.756981:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578413199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.756995:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578413199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.765618:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530817024 00000100:00100000:3.0:1786002500.765627:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530817024 00000100:00100000:3.0:1786002500.765684:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1381 00000100:00100000:3.0:1786002500.765694:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2412:x1872758530817024:12345-192.168.203.49@tcp:103:rmdir.0 00010000:00010000:3.0:1786002500.765708:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002500.765730:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af57841316f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a511 expref: 14 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.765746:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9ed245e3b300) 00010000:00010000:3.0:1786002500.765756:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002500.765805:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758530817024:12345-192.168.203.49@tcp:103:rmdir.0 Request processed in 112us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.765812:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1381 00000100:00100000:3.0:1786002500.766186:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000020:00080000:3.0:1786002500.768160:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 389 committed batchid 387 00000020:00080000:3.0:1786002500.768208:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 387 00000100:00100000:3.0:1786002500.778781:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530817408 00000100:00100000:3.0:1786002500.778788:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530817408 00010000:00010000:3.0:1786002500.778819:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841318b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a51f expref: 12 pid: 6522 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.778872:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1597 00000100:00100000:3.0:1786002500.778881:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2413:x1872758530817408:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002500.778894:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002500.778908:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841318b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a51f expref: 12 pid: 6522 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.778921:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841318b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a51f expref: 12 pid: 6522 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.778943:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841318b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a51f expref: 12 pid: 6522 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.778956:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xce:0x0].0x0 (ffff9ed245e3b000) 00010000:00010000:3.0:1786002500.778961:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af5784131d1 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xce:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.778974:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af5784131d1 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xce:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.778982:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af5784131d1 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xce:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.779004:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002500.779050:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530817408:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 169us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.779058:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1597 00000100:00100000:3.0:1786002500.793363:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560856832 00000100:00100000:3.0:1786002500.793370:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560856832 00000100:00100000:3.0:1786002500.793410:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1786002500.793417:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6507:x1872758560856832:12345-0@lo:105: 00010000:00010000:3.0:1786002500.793514:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784131d8 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784131df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.793527:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784131d8 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784131df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.793535:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784131d8 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784131df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.793542:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784131d8 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784131df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.793549:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784131d8 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784131df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.793561:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784131d8 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af5784131df expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.793587:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245e7f400) 00000100:00100000:3.0:1786002500.793630:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6507:x1872758560856832:12345-0@lo:105: Request processed in 213us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.793637:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1786002500.797507:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560856960 00000100:00100000:3.0:1786002500.797514:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560856960 00000100:00100000:3.0:1786002500.797751:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3429 00000100:00100000:3.0:1786002500.797761:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6521:x1872758560856960:12345-0@lo:403:mdt00_001.0 00000100:00100000:3.0:1786002500.803086:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6521:x1872758560856960:12345-0@lo:403:mdt00_001.0 Request processed in 5319us (6757us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.803099:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3429 00000004:00080000:2.0:1786002500.807030:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 738 rpc_version 738 00000020:00100000:2.0:1786002500.807063:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002500.807073:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243e16680 x1872758560857216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002500.807097:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560857216:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002500.807158:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002500.807191:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002500.811156:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e16680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560857216:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1786002500.824938:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002500.877213:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002500.878557:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560857856 00000100:00100000:3.0:1786002500.878562:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560857856 00000100:00100000:3.0:1786002500.878593:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3431 00000100:00100000:3.0:1786002500.878600:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560857856:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002500.878908:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:7805:x1872758560857856:12345-0@lo:1000:osp_up1-0.0 Request processed in 299us (405us total) trans 4294968443 rc 0/0 00000100:00100000:3.0:1786002500.878917:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3431 00010000:00010000:2.0:1786002500.892464:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a000/0x7cee4af57841322c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.892483:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a000/0x7cee4af57841322c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.892496:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a000/0x7cee4af57841322c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1531:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.892517:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578413233 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.892524:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578413233 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.892531:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578413233 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.892569:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556ac00/0x7cee4af57841323a lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.892580:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556ac00/0x7cee4af57841323a lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.892591:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556ac00/0x7cee4af57841323a lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002500.892613:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e15500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560857984:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002500.892673:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002500.892716:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:2.0:1786002500.935951:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002500.967562:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002500.972534:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002500.981951:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560858112:0@lo:104: 00010000:00010000:2.0:1786002500.981973:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413279 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.982165:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002500.982173:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556ac00/0x7cee4af57841323a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578413241 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.982182:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556ac00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002500.982187:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556ac00/0x7cee4af57841323a lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578413241 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002500.982197:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556ac00/0x7cee4af57841323a lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578413241 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.982230:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556ac00/0x7cee4af57841323a lrc: 2/0,0 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413241 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.982237:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002500.982264:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556ac00/0x7cee4af57841323a lrc: 1/0,0 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413241 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.982272:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556ac00/0x7cee4af57841323a lrc: 0/0,0 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413241 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.982294:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002500.982295:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002500.982297:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002500.982337:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786002500.982352:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560858240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002500.982390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002500.982463:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560858240 00000100:00100000:3.0:1786002500.982468:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560858240 00010000:00010000:3.0:1786002500.982487:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47400/0x7cee4af578413241 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af57841323a expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002500.982518:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1786002500.982526:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+12:3646:x1872758560858240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002500.982537:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002500.993585:0:7451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f800/0x7cee4af5784131ae lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784131b5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002500.993605:0:7451:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f800/0x7cee4af5784131ae lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784131b5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993651:0:7451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f800/0x7cee4af5784131ae lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784131b5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993663:0:7451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002500.993703:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f800/0x7cee4af5784131ae lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x8fdbecc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784131b5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002500.993722:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968443 is committed 00000001:00080000:2.0:1786002500.993740:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968442 is committed 00000020:00080000:2.0:1786002500.993747:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 389 batchid updated 00000020:00080000:2.0:1786002500.993759:0:7451:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed244e2a180 refcount 2 committed 0 result 0 batchid 390 00000020:00080000:2.0:1786002500.993763:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2464bd900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244e2a0c0 00000020:00080000:2.0:1786002500.993766:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].386 00000020:00080000:2.0:1786002500.993769:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2464bd300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed34732f800 00000020:00080000:2.0:1786002500.993771:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].387 00010000:00010000:2.0:1786002500.993793:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af57841313e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993801:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af57841313e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993807:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af57841313e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993812:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002500.993816:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af57841313e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993823:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af57841313e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993834:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18b:0x0].0x0 (ffff9ed245e3bb00) 00010000:00010000:2.0:1786002500.993837:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002500.993841:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af57841313e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993876:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af57841313e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993890:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413145 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993896:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413145 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993910:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413145 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993915:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002500.993918:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413145 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993924:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413145 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993932:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xce:0x0].0x0 (ffff9ed245e3b000) 00010000:00010000:2.0:1786002500.993935:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002500.993938:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413145 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002500.993944:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413145 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1786002500.995630:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 390 committed batchid 389 00000004:00080000:3.0:1786002500.995728:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed24362d480 with version 739 00000020:00080000:3.0:1786002500.995741:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 388 cancel update log [0x200000401:0x3:0x0].385: rc = 0 00000020:00080000:3.0:1786002500.995779:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 388 cancel update log [0x240000400:0x3:0x0].386: rc = 0 00000020:00080000:3.0:1786002500.995788:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 389 00010000:00010000:3.0:1786002500.995830:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47400/0x7cee4af578413241 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af57841323a expref: 6 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.995842:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd1:0x0].0x0 (ffff9ed245e3bf00) 00010000:00010000:3.0:1786002500.995866:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413279 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.995875:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413279 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.995882:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413279 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.995923:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002500.995957:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560858240:12345-0@lo:103:ldlm_bl.0 Request processed in 13432us (13566us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.995965:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00010000:00010000:3.0:1786002500.995989:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413279 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.995997:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413279 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002500.996044:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xd1:0x0]: returning size 4096 00000004:00200000:3.0:1786002500.996049:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002500.996087:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e800/0x7cee4af578413272 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a550 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.996103:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413279 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a550 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002500.996110:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd1:0x0].0x0 (ffff9ed245e3bf00) 00010000:00010000:3.0:1786002500.996112:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002500.996114:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e400, rc 0) 00000100:00100000:3.0:1786002500.996156:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17719:x1872758530818816:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 23490us (23628us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002500.996163:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23643 00000100:00100000:2.0:1786002500.996758:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560858240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002500.997980:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560858624 00000100:00100000:3.0:1786002500.997988:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560858624 00000100:00100000:3.0:1786002500.998029:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3433 00000100:00100000:3.0:1786002500.998037:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b582050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7466:x1872758560858624:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002500.998175:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b582050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7466:x1872758560858624:12345-0@lo:1000:osp_up0-1.0 Request processed in 138us (1216us total) trans 4294983459 rc 0/0 00000100:00100000:3.0:1786002500.998182:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3433 00000100:00100000:2.0:1786002500.998471:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560858624:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002501.003868:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530819072 00000100:00100000:3.0:1786002501.003877:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530819072 00000100:00100000:3.0:1786002501.003951:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23644 00000100:00100000:3.0:1786002501.003961:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17719:x1872758530819072:12345-192.168.203.49@tcp:36:rmdir.0 00010000:00010000:3.0:1786002501.004011:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002501.004036:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af57841325d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1531:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a542 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004058:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff9ed24559f700) 00010000:00010000:3.0:1786002501.004063:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002501.004086:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578413280 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004098:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578413280 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004132:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578413280 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004144:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578413287 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xb1990dc0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004151:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578413287 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb1990dc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004157:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578413287 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb1990dc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004235:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af57841328e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004243:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af57841328e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004250:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af57841328e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004266:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004275:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af57841326b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a549 expref: 15 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004282:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004308:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af57841326b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a549 expref: 15 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.004321:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af57841326b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a549 expref: 15 pid: 14496 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002501.004334:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419af800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560858752:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002501.004402:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002501.006471:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419af800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560858752:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002501.006498:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002501.013430:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530819200 00000100:00100000:3.0:1786002501.013441:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530819200 00010000:00010000:3.0:1786002501.013476:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af57841326b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a549 expref: 16 pid: 14496 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002501.013516:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1600 00000100:00100000:3.0:1786002501.013526:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758530819200:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002501.013540:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002501.013546:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af57841326b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a549 expref: 16 pid: 14496 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.013558:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af57841326b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a549 expref: 16 pid: 14496 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.013580:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af57841326b lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a549 expref: 16 pid: 14496 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.013593:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9ed24559fd00) 00010000:00010000:3.0:1786002501.013597:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.013607:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.013613:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.013645:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002501.013703:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2413:x1872758530819200:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 178us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.013710:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1600 00000100:00100000:3.0:1786002501.015806:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560858880 00000100:00100000:3.0:1786002501.015813:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560858880 00000100:00100000:3.0:1786002501.015879:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3434 00000100:00100000:3.0:1786002501.015889:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10360:x1872758560858880:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002501.015914:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002501.015929:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784132a3 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841329c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.015953:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413279 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a550 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.015967:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784132a3 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841329c expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.015992:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413279 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a550 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.016004:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413279 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a550 expref: 8 pid: 6521 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002501.016016:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419ac700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6526:1872758560859008:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002501.016080:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002501.024497:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419ac700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6526:1872758560859008:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002501.026895:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784132a3 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841329c expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.026921:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd1:0x0].0x0 (ffff9ed245e3bf00) 00010000:00010000:3.0:1786002501.026924:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002501.026928:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784132a3 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841329c expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.026939:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784132a3 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841329c expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.026947:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a600, rc 0) 00000100:00100000:3.0:1786002501.027018:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10360:x1872758560858880:12345-0@lo:101:mdt00_003.0 Request processed in 11129us (11645us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.027026:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3434 00000100:00100000:3.0:1786002501.032085:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560859136 00000100:00100000:3.0:1786002501.032092:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560859136 00000100:00100000:3.0:1786002501.032137:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1786002501.032146:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6506:x1872758560859136:12345-0@lo:105: 00010000:00010000:3.0:1786002501.032157:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46a00/0x7cee4af57841329c lrc: 5/0,1 mode: --/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784132a3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.032167:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46a00/0x7cee4af57841329c lrc: 5/0,1 mode: --/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784132a3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.032176:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46a00/0x7cee4af57841329c lrc: 5/0,1 mode: --/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784132a3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.032183:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46a00/0x7cee4af57841329c lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784132a3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.032190:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46a00/0x7cee4af57841329c lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784132a3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.032198:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46a00/0x7cee4af57841329c lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af5784132a3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.032224:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245c46a00) 00000100:00100000:3.0:1786002501.032269:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6506:x1872758560859136:12345-0@lo:105: Request processed in 124us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.032276:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1786002501.032309:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6506:1872758560859136:0@lo:105: 00010000:00010000:3.0:1786002501.032320:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002501.032358:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758530819328:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 7870us (8009us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.032367:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1601 00010000:00010000:2.0:1786002501.033112:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46a00/0x7cee4af57841329c lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784132a3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.033122:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46a00/0x7cee4af57841329c lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784132a3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.033776:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560859264:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1786002501.033822:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002501.037969:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab600 going to sleep for 11 seconds 00000004:00080000:2.0:1786002501.068245:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 736 rpc_version 736 00000004:00200000:2.0:1786002501.074438:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1531:0x0]: returning size 4096 00010000:00010000:2.0:1786002501.074469:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074480:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074488:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074494:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002501.074498:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074509:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074523:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd1:0x0].0x0 (ffff9ed24559fd00) 00010000:00010000:2.0:1786002501.074526:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002501.074530:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074536:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413295 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074549:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46a00/0x7cee4af57841329c lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784132a3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074557:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46a00/0x7cee4af57841329c lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784132a3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074563:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46a00/0x7cee4af57841329c lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784132a3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074593:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002501.074602:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xd1:0x0] 00010000:00010000:2.0:1786002501.074610:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af57841328e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074616:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af57841328e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074621:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af57841328e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074631:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002501.074633:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af57841328e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074638:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af57841328e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074646:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1531:0x0].0x0 (ffff9ed24559f700) 00010000:00010000:2.0:1786002501.074648:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002501.074652:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af57841328e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074657:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af57841328e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1531:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074675:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578413280 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074681:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578413280 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074686:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578413280 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074692:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578413280 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074696:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002501.074699:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578413280 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074708:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578413280 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074715:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24206a500) 00010000:00010000:2.0:1786002501.074717:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.074719:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578413280 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074724:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578413280 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002501.074739:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb1cf8dc reply state 00000000bc7499b8 transno 4294983460 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578413287 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb1990dc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074750:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578413287 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xb1990dc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.074757:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xb1990dc0 (ffff9ed35363d700) 00010000:00010000:2.0:1786002501.074759:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002501.074762:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002501.075508:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17719:x1872758530819072:12345-192.168.203.49@tcp:36:rmdir.0 Request processed in 71547us (71765us total) trans 4294983460 rc 0/0 00000100:00100000:2.0:1786002501.075516:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23644 00000100:00100000:3.0:1786002501.127548:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530819456 00000100:00100000:3.0:1786002501.127558:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530819456 00000100:00100000:3.0:1786002501.127617:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23645 00000100:00100000:3.0:1786002501.127628:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17720:x1872758530819456:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002501.127647:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002501.127667:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784132aa lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a557 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127724:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132b1 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127736:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132b1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127746:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132b1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127758:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784132b8 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127763:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784132b8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127769:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784132b8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127811:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132b1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127817:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132b1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127822:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132b1 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127828:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132b1 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127833:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002501.127865:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132b1 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127873:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132b1 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127884:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed245e3bd00) 00010000:00010000:3.0:1786002501.127886:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002501.127890:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132b1 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127896:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132b1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127916:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784132b8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127922:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784132b8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127927:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784132b8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127931:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002501.127934:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784132b8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127938:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784132b8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127944:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1d459ad8 (ffff9ed24206a800) 00010000:00010000:3.0:1786002501.127946:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002501.127948:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784132b8 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127953:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784132b8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127982:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784132aa lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a557 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.127991:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed245e3bd00) 00010000:00010000:3.0:1786002501.127993:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002501.127996:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784132aa lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a557 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.128004:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a200, rc 0) 00000100:00100000:3.0:1786002501.128052:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17720:x1872758530819456:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 426us (652us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002501.128061:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23645 00000100:00100000:3.0:1786002501.151444:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530819584 00000100:00100000:3.0:1786002501.151454:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530819584 00000100:00100000:3.0:1786002501.151514:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23646 00000100:00100000:3.0:1786002501.151524:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17720:x1872758530819584:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002501.151548:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002501.151571:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784132bf lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a55e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.151629:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784132c6 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.151642:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784132c6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.151652:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784132c6 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002501.151694:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1786002501.151698:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002501.151728:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784132bf lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a55e expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.151745:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784132c6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a55e expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.151752:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:3.0:1786002501.151755:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002501.151758:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a400, rc 0) 00000100:00100000:3.0:1786002501.151812:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:17720:x1872758530819584:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 290us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.151818:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23646 00000100:00100000:2.0:1786002501.178150:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530819840 00000100:00100000:2.0:1786002501.178159:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530819840 00000100:00100000:2.0:1786002501.180976:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23647 00000100:00100000:2.0:1786002501.180995:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17720:x1872758530819840:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:2.0:1786002501.181052:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002501.181078:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46c00/0x7cee4af57841311b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a50a expref: 8 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.181096:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed245e3bd00) 00010000:00010000:2.0:1786002501.181107:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002501.181165:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784132cd lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.181177:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784132cd lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.181187:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784132cd lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.181199:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784132d4 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.181206:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784132d4 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.181212:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784132d4 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002501.181880:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].389, 2168 off597656 00000040:00080000:2.0:1786002501.181957:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].388, 2368 off644952 00000004:00080000:2.0:1786002501.181964:0:10360:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed36e7abd80 with version 740 00000004:00080000:2.0:1786002501.181986:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 740 rpc_version 740 00000020:00100000:2.0:1786002501.182013:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002501.182021:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2467f1f80 x1872758560859904/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 4232/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002501.182041:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f1f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560859904:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002501.182097:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002501.182146:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1786002501.214103:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784132db lrc: 3/0,1 mode: --/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214122:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784132db lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214133:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784132db lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214152:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784132e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214158:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784132e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214164:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784132e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214200:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214206:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214215:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.214239:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560860032:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786002501.214302:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002501.214354:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53480 going to sleep for 11 seconds 00000100:00100000:2.0:1786002501.214376:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560860032 00000100:00100000:2.0:1786002501.214382:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560860032 00000100:00100000:2.0:1786002501.214420:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3438 00000100:00100000:2.0:1786002501.214428:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:10360:x1872758560860032:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002501.214446:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002501.214459:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784132f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784132e9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214478:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784132f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784132e9 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214491:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784132f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784132e9 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214500:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcf:0x0].0x0 (ffff9ed24559fc00) 00010000:00010000:2.0:1786002501.214503:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.214506:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b400, rc 0) 00000100:00100000:2.0:1786002501.214537:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:10360:x1872758560860032:12345-0@lo:101:mdt00_003.0 Request processed in 109us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002501.214543:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3438 00000100:00100000:2.0:1786002501.214576:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560860032:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002501.214589:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784132f0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214599:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784132f0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002501.214617:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000754c7042 reply state 0000000059f53ac6 transno 4294968445 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784132e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214633:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784132e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214639:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9ed24559f400) 00010000:00010000:2.0:1786002501.214642:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002501.214644:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002501.214650:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784132f0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214658:0:10360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784132f0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002501.214669:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xcf:0x0] 00000004:00010000:2.0:1786002501.214674:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000754c7042 reply state 0000000059f53ac6 transno 4294968445 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784132db lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214682:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784132db lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214688:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff9ed24559f000) 00010000:00010000:2.0:1786002501.214690:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002501.214692:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1786002501.214696:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18c:0x0]: returning size 4096 00010000:00010000:2.0:1786002501.214704:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784132cd lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214710:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784132cd lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214717:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784132cd lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214724:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784132cd lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214731:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556bc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002501.214735:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784132cd lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214742:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784132cd lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214751:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed24559f800) 00010000:00010000:2.0:1786002501.214753:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.214756:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784132cd lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214762:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784132cd lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002501.214778:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000754c7042 reply state 0000000059f53ac6 transno 4294968445 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784132d4 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214786:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784132d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.214790:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1d459ad8 (ffff9ed24559f100) 00010000:00010000:2.0:1786002501.214792:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002501.214794:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1786002501.214873:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17720:x1872758530819840:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 33883us (36982us total) trans 4294968445 rc 0/0 00000100:00100000:2.0:1786002501.214880:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23647 00000100:00100000:3.0:1786002501.274491:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530820096 00000100:00100000:3.0:1786002501.274500:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530820096 00000100:00100000:3.0:1786002501.274554:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23648 00000100:00100000:3.0:1786002501.274564:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17721:x1872758530820096:12345-192.168.203.49@tcp:36:mkdir.0 00000100:00100000:3.0:1786002501.274732:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17721:x1872758530820096:12345-192.168.203.49@tcp:36:mkdir.0 Request processed in 168us (322us total) trans 0 rc -17/-17 00000100:00100000:3.0:1786002501.274739:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23648 00000100:00100000:3.0:1786002501.307506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002501.307541:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530820224 00000100:00100000:3.0:1786002501.307550:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530820224 00000100:00100000:3.0:1786002501.307601:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23649 00000100:00100000:3.0:1786002501.307611:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17723:x1872758530820224:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:3.0:1786002501.307632:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002501.307656:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784132f7 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a565 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.307718:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132fe lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.307730:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132fe lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.307741:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132fe lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.307755:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413305 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.307761:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413305 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.307778:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413305 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.307843:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af57841330c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.307872:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af57841330c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.307879:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af57841330c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002501.307964:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x18c:0x0]: returning size 4096 00000004:00200000:3.0:1786002501.307968:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1786002501.307984:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af57841330c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.307997:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132fe lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308004:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132fe lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308010:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132fe lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308020:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132fe lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308026:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002501.308029:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132fe lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308037:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132fe lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308048:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed24206aa00) 00010000:00010000:3.0:1786002501.308051:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002501.308055:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132fe lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308062:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784132fe lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308072:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413305 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308077:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413305 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308081:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413305 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308086:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002501.308088:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413305 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308097:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413305 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308104:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1d459ad8 (ffff9ed24559f100) 00010000:00010000:3.0:1786002501.308106:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002501.308109:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413305 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308114:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413305 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308136:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784132f7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a565 expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308156:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af57841330c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a565 expref: 10 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.308163:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff9ed24559f000) 00010000:00010000:3.0:1786002501.308165:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786002501.308167:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5be00, rc 0) 00000100:00100000:3.0:1786002501.308213:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:17723:x1872758530820224:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 605us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.308220:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23649 00000100:00100000:3.0:1786002501.316035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002501.359497:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002501.360206:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560860160 00000100:00100000:2.0:1786002501.360211:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560860160 00000100:00100000:2.0:1786002501.360254:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1786002501.360261:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6521:x1872758560860160:12345-0@lo:104: 00010000:00010000:2.0:1786002501.360272:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784132f0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.360321:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786002501.360326:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6521:x1872758560860160:12345-0@lo:104: Request processed in 67us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002501.360332:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00010000:00010000:2.0:1786002501.360351:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002501.360356:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784132f0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.360364:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002501.360369:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af5784132f0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002501.360377:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af5784132f0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.360401:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784132f0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.360408:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002501.360438:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784132f0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.360453:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af5784132e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784132f0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.360470:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002501.360472:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002501.360474:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002501.360484:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560860288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002501.360512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002501.360554:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560860288 00000100:00100000:2.0:1786002501.360558:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560860288 00010000:00010000:2.0:1786002501.360575:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784132f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af5784132e9 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.360597:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602 00000100:00100000:2.0:1786002501.360605:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3646:x1872758560860288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002501.360613:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1786002501.376276:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983461 is committed 00000001:00080000:3.0:1786002501.376339:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983460 is committed 00000020:00080000:3.0:1786002501.376348:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 389 batchid updated 00000020:00080000:3.0:1786002501.376367:0:6499:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed366d7dd80 refcount 2 committed 0 result 0 batchid 390 00000020:00080000:3.0:1786002501.376372:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed36b3b4f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed366d7d840 00000020:00080000:3.0:1786002501.376376:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].385 00000020:00080000:3.0:1786002501.376378:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed36b3b4000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed246631e00 00000020:00080000:3.0:1786002501.376381:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].385 00010000:00010000:3.0:1786002501.376456:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784132f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af5784132e9 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.376474:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcf:0x0].0x0 (ffff9ed24559fc00) 00010000:00010000:3.0:1786002501.376479:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413328 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.376488:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.376495:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413328 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.376518:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002501.376583:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1872758560860288:12345-0@lo:103:ldlm_bl.0 Request processed in 15978us (16069us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.376593:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602 00010000:00010000:3.0:1786002501.376620:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.376628:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002501.376676:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xcf:0x0]: returning size 4096 00000004:00200000:3.0:1786002501.376681:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002501.376718:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413321 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a573 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.376732:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a573 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.376739:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcf:0x0].0x0 (ffff9ed24559fc00) 00010000:00010000:3.0:1786002501.376742:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002501.376744:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fc00, rc 0) 00000100:00100000:3.0:1786002501.377512:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17723:x1872758530820480:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 17818us (18021us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.377520:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23651 00000100:00100000:3.0:1786002501.377564:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560860288:0@lo:103:ldlm_bl.0 00000004:00080000:3.0:1786002501.378100:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 737 rpc_version 737 00000020:00100000:3.0:1786002501.378183:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002501.378191:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2419af100 x1872758560860544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002501.378210:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419af100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560860544:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002501.378247:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002501.378273:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243460300 going to sleep for 11 seconds 00000100:00100000:3.0:1786002501.400205:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530820736 00000100:00100000:3.0:1786002501.400215:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530820736 00000100:00100000:3.0:1786002501.400267:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23652 00000100:00100000:3.0:1786002501.400277:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17723:x1872758530820736:12345-192.168.203.49@tcp:36:rmdir.0 00010000:00010000:3.0:1786002501.400347:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002501.400374:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af57841330c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a565 expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400394:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff9ed24559f000) 00010000:00010000:3.0:1786002501.400398:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002501.400422:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841332f lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400433:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841332f lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400440:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841332f lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400451:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af578413336 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400457:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af578413336 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400463:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af578413336 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400526:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af57841333d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400534:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af57841333d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400540:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af57841333d lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400554:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af578413344 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400566:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af57841331a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a56c expref: 10 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400573:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af578413344 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400598:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af57841331a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a56c expref: 10 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.400611:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af57841331a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a56c expref: 10 pid: 10360 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002501.400624:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758560860672:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002501.400700:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243460900 going to sleep for 11 seconds 00000100:00100000:3.0:1786002501.416206:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758560860672:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002501.416231:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af578413344 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.431343:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560860800 00000100:00100000:2.0:1786002501.431356:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560860800 00000100:00100000:2.0:1786002501.431407:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3440 00000100:00100000:2.0:1786002501.431416:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6522:x1872758560860800:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002501.431435:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002501.431455:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578413352 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841334b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.431483:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413328 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a573 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.431499:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578413352 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xcf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841334b expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.431527:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a573 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.431541:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413328 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a573 expref: 13 pid: 6521 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.431554:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6526:1872758560860928:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002501.431624:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53480 going to sleep for 11 seconds 00000100:00100000:2.0:1786002501.458290:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560861184:0@lo:403:mdt00_002.0 00000040:00080000:2.0:1786002501.459224:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].390, 664 off598320 00000040:00080000:2.0:1786002501.459371:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].389, 744 off645696 00000004:00080000:2.0:1786002501.459377:0:6522:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245e53c00 with version 741 00000004:00080000:3.0:1786002501.459737:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 741 rpc_version 741 00000020:00100000:3.0:1786002501.459778:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002501.459787:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2419ace00 x1872758560861440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002501.459809:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419ace00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560861440:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002501.459985:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002501.460011:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243460900 going to sleep for 11 seconds 00000100:00100000:3.0:1786002501.519808:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002501.519841:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530821120 00000100:00100000:3.0:1786002501.519863:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530821120 00000100:00100000:3.0:1786002501.519922:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23653 00000100:00100000:3.0:1786002501.519932:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:17732:x1872758530821120:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002501.519952:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002501.519972:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af578413359 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a57a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520827:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413360 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520844:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413360 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520872:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413360 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520888:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413367 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520904:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413367 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520911:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413367 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520946:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413360 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520953:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413360 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520963:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413360 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520968:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413360 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520974:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002501.520978:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413360 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520984:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413360 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.520994:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:3.0:1786002501.520997:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002501.521000:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413360 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.521006:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413360 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.521017:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413367 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.521022:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413367 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.521028:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413367 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.521033:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002501.521036:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413367 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.521043:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413367 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.521050:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x7ae821f6 (ffff9ed24206ad00) 00010000:00010000:3.0:1786002501.521052:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002501.521055:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413367 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.521061:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413367 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.521094:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af578413359 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a57a expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.521104:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:3.0:1786002501.521106:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002501.521110:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af578413359 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a57a expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.521118:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5be00, rc 0) 00000100:00100000:3.0:1786002501.521178:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:17732:x1872758530821120:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 1247us (1377us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002501.521186:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23653 00000004:00080000:3.0:1786002501.553883:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 738 rpc_version 738 00000020:00100000:3.0:1786002501.553926:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002501.553935:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2419adc00 x1872758560861824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002501.553964:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419adc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560861824:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002501.554018:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002501.554067:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243460540 going to sleep for 11 seconds 00000100:00100000:3.0:1786002501.554087:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560861824 00000100:00100000:3.0:1786002501.554091:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560861824 00000100:00100000:3.0:1786002501.554137:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3443 00000100:00100000:3.0:1786002501.554146:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560861824:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002501.554679:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560861824:12345-0@lo:1000:osp_up1-0.0 Request processed in 534us (660us total) trans 4294968448 rc 0/0 00000100:00100000:3.0:1786002501.554688:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3443 00000100:00100000:3.0:1786002501.554744:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419adc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560861824:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1786002501.554828:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841338a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.554841:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841338a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.554866:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841338a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.554882:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413391 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.554889:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413391 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.554906:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413391 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.554934:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b400/0x7cee4af578413398 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.554940:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b400/0x7cee4af578413398 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.554950:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b400/0x7cee4af578413398 lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002501.554961:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560861952:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1786002501.554984:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002501.554996:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243460540 going to sleep for 11 seconds 00000100:00100000:2.0:1786002501.555062:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560861952 00000100:00100000:2.0:1786002501.555067:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560861952 00000100:00100000:2.0:1786002501.555098:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3444 00000100:00100000:2.0:1786002501.555106:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6522:x1872758560861952:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002501.555119:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002501.555133:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841339f lrc: 2/0,0 mode: --/PW res: [0x240000401:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413398 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555151:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841339f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413398 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555168:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841339f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413398 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555175:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd2:0x0].0x0 (ffff9ed366e57600) 00010000:00010000:2.0:1786002501.555178:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.555182:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a800, rc 0) 00000100:00100000:2.0:1786002501.555213:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6522:x1872758560861952:12345-0@lo:101:mdt00_002.0 Request processed in 108us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002501.555219:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3444 00000100:00100000:2.0:1786002501.555258:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560861952:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002501.555270:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b400/0x7cee4af578413398 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841339f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555280:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b400/0x7cee4af578413398 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841339f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002501.555297:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6360741 reply state 000000000997098d transno 4294983463 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413391 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555308:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413391 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555314:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9ed24206ae00) 00010000:00010000:2.0:1786002501.555317:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002501.555320:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002501.555326:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b400/0x7cee4af578413398 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841339f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555572:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b400/0x7cee4af578413398 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841339f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002501.555583:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xd2:0x0] 00000004:00010000:2.0:1786002501.555590:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6360741 reply state 000000000997098d transno 4294983463 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841338a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555601:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841338a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555608:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1533:0x0].0x0 (ffff9ed24206ad00) 00010000:00010000:2.0:1786002501.555611:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002501.555613:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1786002501.555618:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1533:0x0]: returning size 4096 00010000:00010000:2.0:1786002501.555626:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841337c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555649:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841337c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555656:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841337c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555663:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841337c lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555670:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002501.555674:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841337c lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555682:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841337c lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555693:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed245e3bc00) 00010000:00010000:2.0:1786002501.555696:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.555699:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841337c lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555705:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841337c lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002501.555735:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6360741 reply state 000000000997098d transno 4294983463 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578413383 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555744:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578413383 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.555751:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x7ae821f6 (ffff9ed245e3b600) 00010000:00010000:2.0:1786002501.555754:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002501.555756:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1786002501.555834:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:17732:x1872758530821504:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 3335us (3456us total) trans 4294983463 rc 0/0 00000100:00100000:2.0:1786002501.555841:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23655 00000100:00100000:2.0:1786002501.581118:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530821760 00000100:00100000:2.0:1786002501.581128:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530821760 00000100:00100000:2.0:1786002501.581175:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23656 00000100:00100000:2.0:1786002501.581186:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:17733:x1872758530821760:12345-192.168.203.49@tcp:36:mkdir.0 00000100:00100000:2.0:1786002501.581411:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:17733:x1872758530821760:12345-192.168.203.49@tcp:36:mkdir.0 Request processed in 227us (372us total) trans 0 rc -17/-17 00000100:00100000:2.0:1786002501.581418:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23656 00000100:00100000:2.0:1786002501.599979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002501.605368:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002501.605436:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530822016 00000100:00100000:3.0:1786002501.605445:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530822016 00000100:00100000:3.0:1786002501.605495:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23658 00000100:00100000:3.0:1786002501.605504:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:17734:x1872758530822016:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:3.0:1786002501.605521:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002501.605539:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a600/0x7cee4af5784133c2 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a58f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.605586:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784133c9 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.605599:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784133c9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.605609:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784133c9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002501.605656:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd2:0x0]: returning size 4096 00000004:00200000:3.0:1786002501.605660:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002501.605688:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a600/0x7cee4af5784133c2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a58f expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.605703:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784133c9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a58f expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.605712:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9ed24206ae00) 00010000:00010000:3.0:1786002501.605715:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002501.605718:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5aa00, rc 0) 00000100:00100000:3.0:1786002501.605776:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17734:x1872758530822016:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 272us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.605783:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23658 00010000:00010000:2.0:1786002501.622554:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784132d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622563:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784132d4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622570:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784132d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622576:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002501.622581:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784132d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622588:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784132d4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622597:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1d459ad8 (ffff9ed24559f100) 00010000:00010000:2.0:1786002501.622599:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.622602:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784132d4 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622608:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784132d4 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622617:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784132db lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622623:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784132db lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622628:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784132db lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622633:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556ae00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002501.622636:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784132db lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622641:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784132db lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622647:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18c:0x0].0x0 (ffff9ed24559f000) 00010000:00010000:2.0:1786002501.622649:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.622652:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784132db lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622657:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784132db lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x18c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622669:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784132e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622675:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784132e2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622680:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784132e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622684:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002501.622687:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784132e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622692:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784132e2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622702:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcf:0x0].0x0 (ffff9ed24559f400) 00010000:00010000:2.0:1786002501.622704:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.622707:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784132e2 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622711:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784132e2 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622723:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af578413336 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622729:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af578413336 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622734:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af578413336 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622739:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002501.622741:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af578413336 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622746:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af578413336 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622752:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x1d459ad8 (ffff9ed24559f100) 00010000:00010000:2.0:1786002501.622754:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.622756:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af578413336 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.622771:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af578413336 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x1d459ad8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.622796:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560862464 00000100:00100000:2.0:1786002501.622803:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560862464 00000100:00100000:2.0:1786002501.622842:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3445 00000100:00100000:2.0:1786002501.622873:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7466:x1872758560862464:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002501.622998:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7466:x1872758560862464:12345-0@lo:1000:osp_up0-1.0 Request processed in 129us (829us total) trans 4294983464 rc 0/0 00000100:00100000:2.0:1786002501.623004:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3445 00000100:00100000:2.0:1786002501.624028:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560862720 00000100:00100000:2.0:1786002501.624034:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560862720 00000100:00100000:2.0:1786002501.624078:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3446 00000100:00100000:2.0:1786002501.624087:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7466:x1872758560862720:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002501.624181:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7466:x1872758560862720:12345-0@lo:1000:osp_up0-1.0 Request processed in 95us (640us total) trans 4294983465 rc 0/0 00000100:00100000:2.0:1786002501.624188:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3446 00000100:00100000:3.0:1786002501.633614:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002501.653570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002501.654247:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560862976 00000100:00100000:2.0:1786002501.654252:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560862976 00000100:00100000:2.0:1786002501.654285:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3447 00000100:00100000:2.0:1786002501.654292:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1872758560862976:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786002501.654305:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002501.654318:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af578413401 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784133fa expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.654337:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47600/0x7cee4af5784133d7 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a596 expref: 8 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.654347:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af578413401 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784133fa expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.654368:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47600/0x7cee4af5784133d7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a596 expref: 8 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.654380:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47600/0x7cee4af5784133d7 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a596 expref: 8 pid: 14496 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.654392:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6526:1872758560863104:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002501.654440:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002501.660796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002501.661319:0:6520:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968448 gen 2 00000004:00080000:3.0:1786002501.661324:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968444 committed transno 4294968448 00000020:00080000:3.0:1786002501.661330:0:6520:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2456d8540 refcount 2 committed 0 result 0 batchid 391 00000020:00080000:3.0:1786002501.661334:0:6520:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed35959d200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2456d8cc0 00000020:00080000:3.0:1786002501.661338:0:6520:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].386 00000020:00080000:3.0:1786002501.661341:0:6520:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37b9e0200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245da4400 00000020:00080000:3.0:1786002501.661344:0:6520:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].386 00000004:00080000:3.0:1786002501.661363:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968446 committed transno 4294968448 00000004:00080000:3.0:1786002501.661372:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968448 committed transno 4294968448 00000100:00100000:3.0:1786002501.661384:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bba300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560862976:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786002501.661401:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 4/0,1 mode: --/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.661413:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 4/0,1 mode: --/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002501.661864:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786002501.661877:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560863232 00000100:00100000:3.0:1786002501.661880:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560863232 00000100:00100000:3.0:1786002501.661917:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:3.0:1786002501.661924:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6506:x1872758560863232:12345-0@lo:105: 00010000:00010000:3.0:1786002501.661934:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 5/0,1 mode: --/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.661944:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 5/0,1 mode: --/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.661953:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 5/0,1 mode: --/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.661961:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.661968:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.661977:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.661992:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245e7fc00) 00000100:00100000:3.0:1786002501.662019:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6506:x1872758560863232:12345-0@lo:105: Request processed in 95us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.662026:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00010000:00010000:3.0:1786002501.662061:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.662070:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002501.662696:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560863360:0@lo:403:mdt00_000.0 00000100:00100000:3.0:1786002501.662733:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002501.662757:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243460a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002501.663013:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560863360 00000100:00100000:3.0:1786002501.663017:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560863360 00000100:00100000:3.0:1786002501.663044:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3448 00000100:00100000:3.0:1786002501.663050:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6520:x1872758560863360:12345-0@lo:403:mdt00_000.0 00000100:00100000:3.0:1786002501.665058:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6520:x1872758560863360:12345-0@lo:403:mdt00_000.0 Request processed in 2002us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.665068:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3448 00000100:00100000:3.0:1786002501.665112:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560863360:0@lo:403:mdt00_000.0 00000004:00080000:3.0:1786002501.668020:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 739 rpc_version 739 00000020:00100000:3.0:1786002501.668058:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002501.668068:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2454e1c00 x1872758560863616/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002501.668095:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560863616:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002501.668149:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002501.668179:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434606c0 going to sleep for 11 seconds 00010000:00010000:3.0:1786002501.669841:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002501.669868:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.669878:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fc00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002501.669883:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002501.669892:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.669928:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 2/0,0 mode: --/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.669935:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002501.669959:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 1/0,0 mode: --/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.669967:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af5784133fa lrc: 0/0,0 mode: --/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413401 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.669983:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002501.669985:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002501.669986:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002501.670044:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560863744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002501.670079:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002501.670112:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560863744 00000100:00100000:2.0:1786002501.670117:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560863744 00000100:00100000:2.0:1786002501.670152:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1786002501.670162:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1872758560863744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002501.670178:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002501.670198:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af578413401 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784133fa expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.670223:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd2:0x0].0x0 (ffff9ed366e57600) 00010000:00010000:2.0:1786002501.670233:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002501.670268:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1872758560863744:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002501.670286:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1786002501.670319:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560863744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002501.723154:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002501.723258:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530822784 00000100:00100000:2.0:1786002501.723268:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530822784 00000100:00100000:2.0:1786002501.723318:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23661 00000100:00100000:2.0:1786002501.723328:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17735:x1872758530822784:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002501.723347:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002501.723366:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af578413408 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a59d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723424:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841340f lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723437:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841340f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723447:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841340f lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723461:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413416 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723468:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413416 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723474:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413416 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723514:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841340f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723522:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841340f lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723529:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841340f lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723536:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841340f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723542:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556ae00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002501.723545:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841340f lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723552:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841340f lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723562:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed35363d700) 00010000:00010000:2.0:1786002501.723566:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.723570:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841340f lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723577:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841340f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723589:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413416 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723596:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413416 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723602:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413416 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723607:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002501.723610:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413416 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723621:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413416 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723627:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x4e8b2d46 (ffff9ed366e57600) 00010000:00010000:2.0:1786002501.723629:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.723632:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413416 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723638:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413416 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723667:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af578413408 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a59d expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723677:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed35363d700) 00010000:00010000:2.0:1786002501.723679:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.723683:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af578413408 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a59d expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.723692:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b000, rc 0) 00000100:00100000:2.0:1786002501.723753:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17735:x1872758530822784:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 425us (608us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002501.723760:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23661 00000100:00100000:3.0:1786002501.740243:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002501.774001:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530823424 00000100:00100000:2.0:1786002501.774010:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530823424 00000100:00100000:2.0:1786002501.774065:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23664 00000100:00100000:2.0:1786002501.774076:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17736:x1872758530823424:12345-192.168.203.49@tcp:36:mkdir.0 00000100:00100000:2.0:1786002501.774265:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17736:x1872758530823424:12345-192.168.203.49@tcp:36:mkdir.0 Request processed in 190us (374us total) trans 0 rc -17/-17 00000100:00100000:2.0:1786002501.774272:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23664 00000100:00100000:3.0:1786002501.807520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002501.807605:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530823808 00000100:00100000:2.0:1786002501.807614:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530823808 00000100:00100000:2.0:1786002501.807672:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23667 00000100:00100000:2.0:1786002501.807692:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:17737:x1872758530823808:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002501.807711:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002501.807731:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af57841347f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a5b9 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.807782:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.807796:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af57841344e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413447 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.807805:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.807844:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af57841344e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578413447 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.807887:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560864256:0@lo:104: 00000100:00100000:2.0:1786002501.807940:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002501.807978:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e536c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002501.808376:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560864384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002501.808407:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002501.808441:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560864256:0@lo:104: 00010000:00010000:2.0:1786002501.808458:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002501.815819:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983467 is committed 00000001:00080000:3.0:1786002501.815880:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983466 is committed 00000020:00080000:3.0:1786002501.815889:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 391 batchid updated 00000020:00080000:3.0:1786002501.815906:0:6499:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed36e611840 refcount 2 committed 0 result 0 batchid 392 00000020:00080000:3.0:1786002501.815910:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36e611480 00000020:00080000:3.0:1786002501.815913:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].387 00000020:00080000:3.0:1786002501.815915:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed241a35a00 00000020:00080000:3.0:1786002501.815918:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].387 00000020:00080000:3.0:1786002501.815929:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 390 batchid updated 00010000:00010000:1.0:1786002501.816035:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841338a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816041:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841338a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1533:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816055:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413391 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816061:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413391 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816066:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413391 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816070:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002501.816084:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413391 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816090:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413391 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816097:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd2:0x0].0x0 (ffff9ed24206ae00) 00010000:00010000:1.0:1786002501.816099:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002501.816101:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413391 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816114:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413391 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816129:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784133e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816135:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784133e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816140:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784133e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816145:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002501.816148:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784133e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816154:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784133e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816161:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x7ae821f6 (ffff9ed245e3b600) 00010000:00010000:1.0:1786002501.816163:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002501.816166:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784133e5 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.816172:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784133e5 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x7ae821f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.816376:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af57841344e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578413447 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.816388:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd0:0x0].0x0 (ffff9ed35363d400) 00010000:00010000:2.0:1786002501.816392:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.816402:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.816409:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.816437:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002501.816509:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1872758560864384:12345-0@lo:103:ldlm_bl.0 Request processed in 7945us (8100us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002501.816519:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00100000:1.0:1786002501.817280:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560864384:0@lo:103:ldlm_bl.0 00000004:00080000:3.0:1786002501.817304:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 740 rpc_version 740 00000020:00100000:3.0:1786002501.817332:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002501.817339:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2419af100 x1872758560864640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002501.817358:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419af100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560864640:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002501.817400:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002501.817427:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243460d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002501.819262:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560864640 00000100:00100000:1.0:1786002501.819272:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560864640 00000100:00100000:1.0:1786002501.819321:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3452 00000100:00100000:1.0:1786002501.819329:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7805:x1872758560864640:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002501.819474:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560864640:12345-0@lo:1000:osp_up1-0.0 Request processed in 145us (2073us total) trans 4294968451 rc 0/0 00000100:00100000:1.0:1786002501.819482:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3452 00000100:00100000:3.0:1786002501.819565:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419af100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560864640:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786002501.819577:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 741 rpc_version 741 00000020:00100000:3.0:1786002501.819594:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002501.819599:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed37136c380 x1872758560864896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002501.819614:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560864896:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002501.819643:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002501.819665:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243460d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002501.823459:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560864896:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002501.825976:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530824064 00000100:00100000:1.0:1786002501.825987:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530824064 00000100:00100000:1.0:1786002501.826053:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23668 00000100:00100000:1.0:1786002501.826063:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17737:x1872758530824064:12345-192.168.203.49@tcp:36:rmdir.0 00010000:00010000:1.0:1786002501.826115:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002501.826142:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47e00/0x7cee4af57841346a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x18e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ab expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826159:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff9ed3465ad000) 00010000:00010000:1.0:1786002501.826164:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002501.826188:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af57841348d lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826200:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af57841348d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826210:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af57841348d lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826221:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413494 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826227:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413494 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826324:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413494 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826405:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ec00/0x7cee4af57841349b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826415:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ec00/0x7cee4af57841349b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826427:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ec00/0x7cee4af57841349b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x18e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826444:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af5784134a2 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826454:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413478 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b2 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826463:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af5784134a2 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826492:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413478 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b2 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.826505:0:14496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b2 expref: 10 pid: 6520 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002501.826520:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560865024:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002501.826594:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002501.831428:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560865024:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002501.831456:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af5784134a2 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.833505:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530824192 00000100:00100000:2.0:1786002501.833513:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530824192 00010000:00010000:2.0:1786002501.833548:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b2 expref: 11 pid: 6520 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.833587:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1609 00000100:00100000:2.0:1786002501.833597:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2412:x1872758530824192:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002501.833612:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002501.833618:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b2 expref: 11 pid: 6520 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.833637:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413478 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b2 expref: 11 pid: 6520 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.833657:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413478 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b2 expref: 11 pid: 6520 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.833670:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9ed3465ad600) 00010000:00010000:2.0:1786002501.833675:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af5784134a2 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.833684:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af5784134a2 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.833691:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af5784134a2 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.833725:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002501.833777:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758530824192:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 180us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002501.833785:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1609 00010000:00010000:1.0:1786002501.834592:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af5784134a2 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.834601:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af5784134a2 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.834642:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.834650:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.834659:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002501.834677:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560865152:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1786002501.834728:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002501.834761:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002501.838065:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560865152 00000100:00100000:2.0:1786002501.838075:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560865152 00000100:00100000:2.0:1786002501.838114:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3454 00000100:00100000:2.0:1786002501.838123:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:14496:x1872758560865152:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002501.838141:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002501.838158:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784134b0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784134a9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.838191:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b9 expref: 13 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.838201:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784134b0 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784134a9 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.838240:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b9 expref: 13 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.838254:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b9 expref: 13 pid: 10360 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.838267:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6526:1872758560865280:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002501.838342:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e536c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002501.842283:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6526:1872758560865280:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002501.842317:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784134b0 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784134a9 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.842328:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd0:0x0].0x0 (ffff9ed35363d400) 00010000:00010000:2.0:1786002501.842332:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002501.842336:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784134b0 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784134a9 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.842346:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784134b0 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784134a9 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.842359:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b400, rc 0) 00000100:00100000:2.0:1786002501.842413:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:14496:x1872758560865152:12345-0@lo:101:mdt00_004.0 Request processed in 4290us (7683us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002501.842432:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3454 00000100:00100000:3.0:1786002501.842613:0:14496:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983467 gen 2 00000004:00080000:3.0:1786002501.842619:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983462 committed transno 4294983467 00000020:00080000:3.0:1786002501.842625:0:14496:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed245e53a80 refcount 2 committed 0 result 0 batchid 393 00000020:00080000:3.0:1786002501.842629:0:14496:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2464bd100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245e53c00 00000020:00080000:3.0:1786002501.842633:0:14496:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].389 00000020:00080000:3.0:1786002501.842636:0:14496:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2464bdf00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed246631a00 00000020:00080000:3.0:1786002501.842638:0:14496:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].390 00000004:00080000:3.0:1786002501.842666:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983464 committed transno 4294983467 00000004:00080000:3.0:1786002501.842680:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983465 committed transno 4294983467 00000004:00080000:3.0:1786002501.842688:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983467 committed transno 4294983467 00000100:00100000:3.0:1786002501.842701:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560865152:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002501.842725:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784134b0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.842736:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784134b0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1786002501.842796:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 393 committed batchid 391 00000020:00080000:1.0:1786002501.842905:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 391 00000100:00100000:3.0:1786002501.845552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002501.845748:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530824320 00000100:00100000:2.0:1786002501.845758:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530824320 00010000:00010000:2.0:1786002501.845806:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b9 expref: 14 pid: 10360 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.845877:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1610 00000100:00100000:2.0:1786002501.845889:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2413:x1872758530824320:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002501.845912:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002501.845920:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b9 expref: 14 pid: 10360 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.845935:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b9 expref: 14 pid: 10360 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.845959:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413486 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5b9 expref: 14 pid: 10360 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.845973:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd0:0x0].0x0 (ffff9ed35363d400) 00010000:00010000:2.0:1786002501.845979:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784134b0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784134a9 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.845991:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784134b0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784134a9 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.846305:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784134b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784134a9 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.846337:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784134b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784134a9 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.846349:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560865408:0@lo:105: 00000100:00100000:2.0:1786002501.846393:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002501.846432:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e536c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002501.846474:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560865408 00000100:00100000:1.0:1786002501.846479:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560865408 00000100:00100000:1.0:1786002501.846516:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:1.0:1786002501.846525:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560865408:12345-0@lo:105: 00010000:00010000:1.0:1786002501.846535:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784134b0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.846544:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784134b0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.846552:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784134b0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.846559:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784134b0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.846567:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784134b0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.846574:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af5784134b0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.846596:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245e7e800) 00000100:00100000:1.0:1786002501.846633:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560865408:12345-0@lo:105: Request processed in 110us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002501.846640:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00010000:00010000:1.0:1786002501.846663:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784134b0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.846673:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af5784134a9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784134b0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002501.847368:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560865536:0@lo:403:mdt00_004.0 00000100:00100000:1.0:1786002501.847406:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002501.847426:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7df00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002501.847440:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560865536 00000100:00100000:1.0:1786002501.847444:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560865536 00000100:00100000:1.0:1786002501.847474:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3455 00000100:00100000:1.0:1786002501.847481:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:14496:x1872758560865536:12345-0@lo:403:mdt00_004.0 00000100:00100000:1.0:1786002501.848971:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:14496:x1872758560865536:12345-0@lo:403:mdt00_004.0 Request processed in 1487us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002501.848980:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3455 00000100:00100000:1.0:1786002501.849030:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560865536:0@lo:403:mdt00_004.0 00000040:00080000:1.0:1786002501.849889:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].392, 664 off601152 00000100:00100000:2.0:1786002501.850675:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560865408:0@lo:105: 00010000:00010000:2.0:1786002501.850694:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002501.850757:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2413:x1872758530824320:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 4869us (5211us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002501.850766:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1610 00000040:00080000:1.0:1786002501.854225:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].391, 744 off648808 00000004:00080000:1.0:1786002501.854282:0:14496:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed366d7df00 with version 745 00000004:00080000:2.0:1786002501.854363:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 745 rpc_version 745 00000020:00100000:2.0:1786002501.854394:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002501.854405:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244be5180 x1872758560865792/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002501.854552:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560865792:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002501.854614:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002501.854691:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e536c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002501.860523:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560865792 00000100:00100000:3.0:1786002501.860537:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560865792 00000100:00100000:3.0:1786002501.860639:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3456 00000100:00100000:3.0:1786002501.860650:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b580050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7466:x1872758560865792:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002501.860981:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b580050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7466:x1872758560865792:12345-0@lo:1000:osp_up0-1.0 Request processed in 333us (6366us total) trans 4294983468 rc 0/0 00000100:00100000:3.0:1786002501.860989:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3456 00000100:00100000:3.0:1786002501.904189:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530824448 00000100:00100000:3.0:1786002501.904198:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530824448 00000100:00100000:3.0:1786002501.904261:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23669 00000100:00100000:3.0:1786002501.904272:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17738:x1872758530824448:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002501.904295:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002501.904317:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784134b7 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a5c0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904378:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784134be lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904391:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784134be lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904402:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784134be lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904415:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784134c5 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904422:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784134c5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904429:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784134c5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904480:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784134be lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904491:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784134be lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904496:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784134be lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904502:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784134be lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904509:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002501.904520:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784134be lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904529:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784134be lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904541:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed2456f9b00) 00010000:00010000:3.0:1786002501.904544:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002501.904549:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784134be lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904554:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af5784134be lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904566:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784134c5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904572:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784134c5 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904578:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784134c5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904584:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002501.904587:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784134c5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904593:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784134c5 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904601:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x94284bcd (ffff9ed2456f9400) 00010000:00010000:3.0:1786002501.904603:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002501.904606:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784134c5 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904612:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784134c5 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904647:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784134b7 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5c0 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904658:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed2456f9b00) 00010000:00010000:3.0:1786002501.904661:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002501.904664:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784134b7 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5c0 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.904676:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b600, rc 0) 00000100:00100000:3.0:1786002501.904743:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17738:x1872758530824448:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 473us (755us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002501.904749:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23669 00000100:00100000:3.0:1786002501.909309:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002501.929059:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002501.938296:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002501.938804:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560866048 00000100:00100000:3.0:1786002501.938809:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560866048 00000100:00100000:3.0:1786002501.938840:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3457 00000100:00100000:3.0:1786002501.938862:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6521:x1872758560866048:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002501.938936:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6521:x1872758560866048:12345-0@lo:1000:mdt00_001.0 Request processed in 89us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.938944:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3457 00000100:00100000:3.0:1786002501.939292:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560866176 00000100:00100000:3.0:1786002501.939296:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560866176 00000100:00100000:3.0:1786002501.939322:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3458 00000100:00100000:3.0:1786002501.939327:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6521:x1872758560866176:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002501.939389:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6521:x1872758560866176:12345-0@lo:1000:mdt00_001.0 Request processed in 62us (233us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002501.939396:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3458 00000100:00100000:2.0:1786002501.939658:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560866304 00000100:00100000:2.0:1786002501.939663:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560866304 00000100:00100000:2.0:1786002501.939698:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3459 00000100:00100000:2.0:1786002501.939713:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6521:x1872758560866304:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1786002501.939722:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002501.939735:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784134f6 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784134ef expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.939757:0:15596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46a00/0x7cee4af5784134e8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ce expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.939765:0:15596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784134f6 lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784134ef expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.939936:0:15596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46a00/0x7cee4af5784134e8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ce expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.939950:0:15596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46a00/0x7cee4af5784134e8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ce expref: 11 pid: 14496 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.939961:0:15596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:15596:1872758560866432:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002501.940011:0:15596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e536c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002501.943138:0:15596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:15596:1872758560866432:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002501.943169:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784134f6 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784134ef expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.943182:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed3465ad100) 00010000:00010000:2.0:1786002501.943185:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002501.943189:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784134f6 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784134ef expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.943199:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556ae00, rc 0) 00000100:00100000:2.0:1786002501.943263:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6521:x1872758560866304:12345-0@lo:101:mdt00_001.0 Request processed in 3558us (3686us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002501.943271:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3459 00000100:00100000:3.0:1786002501.947569:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530825088 00000100:00100000:3.0:1786002501.947577:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530825088 00010000:00010000:3.0:1786002501.947611:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46a00/0x7cee4af5784134e8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ce expref: 12 pid: 14496 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002501.947649:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1611 00000100:00100000:3.0:1786002501.947658:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530825088:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002501.947678:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002501.947684:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46a00/0x7cee4af5784134e8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ce expref: 12 pid: 14496 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.947698:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46a00/0x7cee4af5784134e8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ce expref: 12 pid: 14496 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.947730:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46a00/0x7cee4af5784134e8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ce expref: 12 pid: 14496 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.947744:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed3465ad100) 00010000:00010000:3.0:1786002501.947751:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784134f6 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784134ef expref: 8 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.947761:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784134f6 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784134ef expref: 8 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.947770:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784134f6 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784134ef expref: 8 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.947805:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af5784134f6 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784134ef expref: 8 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002501.947819:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6506:1872758560866560:0@lo:105: 00000100:00100000:3.0:1786002501.947875:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002501.947914:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434606c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002501.949748:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560866560 00000100:00100000:1.0:1786002501.949758:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560866560 00000100:00100000:1.0:1786002501.949808:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:1.0:1786002501.949820:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6506:x1872758560866560:12345-0@lo:105: 00010000:00010000:1.0:1786002501.949833:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46400/0x7cee4af5784134ef lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784134f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.949888:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46400/0x7cee4af5784134ef lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784134f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.949906:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46400/0x7cee4af5784134ef lrc: 5/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784134f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.949916:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46400/0x7cee4af5784134ef lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784134f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.949925:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46400/0x7cee4af5784134ef lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784134f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.949935:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46400/0x7cee4af5784134ef lrc: 6/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af5784134f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.949962:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245c46400) 00000100:00100000:1.0:1786002501.950022:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6506:x1872758560866560:12345-0@lo:105: Request processed in 203us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002501.950030:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:1.0:1786002501.950221:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560866688 00000100:00100000:1.0:1786002501.950225:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560866688 00000100:00100000:1.0:1786002501.950263:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3460 00000100:00100000:1.0:1786002501.950269:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6521:x1872758560866688:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1786002501.950282:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002501.950296:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af578413504 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784134fd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.950315:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af578413504 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784134fd expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.950326:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af578413504 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784134fd expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.950333:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x94284bcd (ffff9ed35363d800) 00010000:00010000:1.0:1786002501.950336:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002501.950340:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fa00, rc 0) 00000100:00100000:1.0:1786002501.950371:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6521:x1872758560866688:12345-0@lo:101:mdt00_001.0 Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002501.950377:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3460 00000100:00100000:1.0:1786002501.950410:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1872758560866688:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1786002501.950612:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47400/0x7cee4af5784134fd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413504 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.950622:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47400/0x7cee4af5784134fd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413504 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002501.950639:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1786002501.950667:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1872758560866816:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786002501.950703:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002501.950927:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002501.951319:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6506:1872758560866560:0@lo:105: 00010000:00010000:3.0:1786002501.951331:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002501.951379:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2412:x1872758530825088:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 3720us (3926us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002501.951387:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1611 00000100:00100000:1.0:1786002501.952887:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1872758560866816:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786002501.952960:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1872758560866944:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786002501.953001:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002501.953025:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002501.953427:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1872758560866944:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002501.953509:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1872758560867072:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002501.953534:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002501.953558:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243460300 going to sleep for 11 seconds 00010000:00010000:3.0:1786002501.958319:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002501.958329:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46400/0x7cee4af5784134ef lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784134f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.958340:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002501.958347:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46400/0x7cee4af5784134ef lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784134f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002501.958356:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46400/0x7cee4af5784134ef lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784134f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.958388:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46400/0x7cee4af5784134ef lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784134f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.958395:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002501.958425:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46400/0x7cee4af5784134ef lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784134f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.958434:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46400/0x7cee4af5784134ef lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784134f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002501.958451:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002501.958452:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002501.958454:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002501.959009:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786002501.959024:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560867968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002501.959072:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002501.963640:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560867968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002501.976025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002501.976144:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530825344 00000100:00100000:3.0:1786002501.976153:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530825344 00000100:00100000:3.0:1786002501.976214:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23673 00000100:00100000:3.0:1786002501.976225:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17739:x1872758530825344:12345-192.168.203.49@tcp:36:mkdir.0 00000100:00100000:3.0:1786002501.976385:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17739:x1872758530825344:12345-192.168.203.49@tcp:36:mkdir.0 Request processed in 162us (368us total) trans 0 rc -17/-17 00000100:00100000:3.0:1786002501.976392:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23673 00000100:00100000:3.0:1786002501.996554:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002501.996668:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530825472 00000100:00100000:2.0:1786002501.996679:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530825472 00000100:00100000:2.0:1786002501.996745:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23674 00000100:00100000:2.0:1786002501.996755:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17741:x1872758530825472:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002501.996774:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002501.996798:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a000/0x7cee4af578413527 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a5d5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.996886:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841352e lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.996909:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841352e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.996921:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841352e lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.996933:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.996943:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af578413504 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784134fd expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.996958:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.996989:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af578413504 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af5784134fd expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002501.997005:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560868096:0@lo:104: 00000100:00100000:2.0:1786002501.997049:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002501.997078:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560868096 00000100:00100000:2.0:1786002501.997082:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560868096 00000100:00100000:2.0:1786002501.997108:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:2.0:1786002501.997115:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:14496:x1872758560868096:12345-0@lo:104: 00010000:00010000:2.0:1786002501.997126:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47400/0x7cee4af5784134fd lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578413504 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002501.997171:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786002501.997177:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:14496:x1872758560868096:12345-0@lo:104: Request processed in 63us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002501.997184:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:2.0:1786002501.997217:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e536c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002501.997387:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560868096:0@lo:104: 00010000:00010000:2.0:1786002501.997405:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.998461:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002501.998480:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47400/0x7cee4af5784134fd lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578413504 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.998490:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002501.998496:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47400/0x7cee4af5784134fd lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578413504 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002501.998505:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47400/0x7cee4af5784134fd lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578413504 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.998534:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47400/0x7cee4af5784134fd lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413504 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.998541:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002501.998661:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47400/0x7cee4af5784134fd lrc: 1/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413504 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.998675:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47400/0x7cee4af5784134fd lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413504 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002501.998693:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002501.998695:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002501.998697:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786002502.014550:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968454 is committed 00000001:00080000:3.0:1786002502.016530:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968453 is committed 00000020:00080000:3.0:1786002502.016545:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 393 batchid updated 00000020:00080000:3.0:1786002502.016557:0:7451:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed36e611a80 refcount 2 committed 0 result 0 batchid 394 00000020:00080000:3.0:1786002502.016562:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36e611000 00000020:00080000:3.0:1786002502.016566:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].390 00000020:00080000:3.0:1786002502.016569:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2432e4800 00000020:00080000:3.0:1786002502.016571:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].391 00000020:00080000:3.0:1786002502.016591:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 392 batchid updated 00010000:00010000:3.0:1786002502.016660:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af578413504 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af5784134fd expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.016676:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x94284bcd (ffff9ed35363d800) 00010000:00010000:3.0:1786002502.016681:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.016694:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.016702:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.016739:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002502.016806:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1872758560868224:12345-0@lo:103:ldlm_bl.0 Request processed in 12731us (18185us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.016816:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00010000:00010000:3.0:1786002502.016883:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.016890:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002502.017071:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560868352:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002502.017105:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002502.017135:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560868352 00000100:00100000:3.0:1786002502.017141:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560868352 00000100:00100000:3.0:1786002502.017172:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3469 00000100:00100000:3.0:1786002502.017179:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:14496:x1872758560868352:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002502.017235:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:14496:x1872758560868352:12345-0@lo:1000:mdt00_004.0 Request processed in 56us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.017242:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3469 00000100:00100000:3.0:1786002502.017263:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243460300 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.017283:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560868352:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1786002502.017319:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841353c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017328:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841353c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017335:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841353c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002502.017353:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841353c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017364:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841352e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017370:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841352e lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017376:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841352e lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017383:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841352e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017389:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002502.017393:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841352e lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017400:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841352e lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017409:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed366e57600) 00010000:00010000:3.0:1786002502.017412:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.017426:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841352e lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017434:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af57841352e lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017445:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017451:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017457:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017462:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002502.017475:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017482:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017489:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x94284bcd (ffff9ed35363d800) 00010000:00010000:3.0:1786002502.017492:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.017495:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017501:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413535 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017536:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a000/0x7cee4af578413527 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5d5 expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017558:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841353c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5d5 expref: 10 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.017565:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:3.0:1786002502.017567:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002502.017569:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b600, rc 0) 00000100:00100000:3.0:1786002502.017609:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:17741:x1872758530825472:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 20856us (21065us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.017616:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23674 00000004:00080000:3.0:1786002502.018349:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 746 rpc_version 746 00000020:00100000:3.0:1786002502.018368:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002502.018375:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2423f9180 x1872758560868608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002502.018391:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560868608:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002502.018477:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002502.018502:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434606c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.018806:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560868608:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1786002502.018814:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 747 rpc_version 747 00000020:00100000:3.0:1786002502.018825:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002502.018830:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2454e2d80 x1872758560868864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002502.018842:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560868864:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002502.018890:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002502.018916:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434606c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.018928:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560868864 00000100:00100000:3.0:1786002502.018931:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560868864 00000100:00100000:3.0:1786002502.018953:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3471 00000100:00100000:3.0:1786002502.018959:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7466:x1872758560868864:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002502.019027:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7466:x1872758560868864:12345-0@lo:1000:osp_up0-1.0 Request processed in 67us (136us total) trans 4294983471 rc 0/0 00000100:00100000:3.0:1786002502.019034:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3471 00000100:00100000:3.0:1786002502.019066:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560868864:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1786002502.020698:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46c00/0x7cee4af578413432 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.020817:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46c00/0x7cee4af578413432 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.020824:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46c00/0x7cee4af578413432 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.020830:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002502.020835:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46c00/0x7cee4af578413432 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.020842:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46c00/0x7cee4af578413432 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.020962:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x4e8b2d46 (ffff9ed3465ad800) 00010000:00010000:2.0:1786002502.020965:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002502.020969:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46c00/0x7cee4af578413432 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.020976:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46c00/0x7cee4af578413432 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.020986:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47600/0x7cee4af578413439 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.020992:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47600/0x7cee4af578413439 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.020998:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47600/0x7cee4af578413439 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021003:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002502.021007:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47600/0x7cee4af578413439 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021013:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47600/0x7cee4af578413439 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021019:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x18e:0x0].0x0 (ffff9ed3465ad000) 00010000:00010000:2.0:1786002502.021021:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002502.021024:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47600/0x7cee4af578413439 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021029:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47600/0x7cee4af578413439 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x18e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021041:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413440 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021048:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413440 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021053:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413440 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021058:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002502.021061:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413440 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021066:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413440 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021072:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd0:0x0].0x0 (ffff9ed3465ad600) 00010000:00010000:2.0:1786002502.021074:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002502.021077:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413440 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021083:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413440 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021095:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413494 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021101:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413494 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021107:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413494 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021112:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002502.021115:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413494 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021120:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413494 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021127:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x4e8b2d46 (ffff9ed3465ad800) 00010000:00010000:2.0:1786002502.021129:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002502.021131:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413494 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.021137:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e400/0x7cee4af578413494 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x4e8b2d46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002502.023229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002502.029791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002502.029928:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530825728 00000100:00100000:1.0:1786002502.029936:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530825728 00000100:00100000:1.0:1786002502.029991:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23676 00000100:00100000:1.0:1786002502.030002:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17741:x1872758530825728:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:1.0:1786002502.030020:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002502.030039:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413551 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a5e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.030091:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413558 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.030104:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413558 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.030115:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413558 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002502.030162:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd3:0x0]: returning size 4096 00000004:00200000:1.0:1786002502.030166:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786002502.030198:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413551 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5e3 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.030218:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413558 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5e3 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.030226:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd3:0x0].0x0 (ffff9ed3465ad300) 00010000:00010000:1.0:1786002502.030229:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002502.030233:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fa00, rc 0) 00000100:00100000:1.0:1786002502.030279:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:17741:x1872758530825728:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 280us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002502.030287:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23676 00000100:00080000:2.0:1786002502.032944:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786002502.036819:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002502.038968:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530825856 00000100:00100000:3.0:1786002502.038978:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530825856 00000100:00100000:3.0:1786002502.039064:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23677 00000100:00100000:3.0:1786002502.039073:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17741:x1872758530825856:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:3.0:1786002502.039091:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002502.039109:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af57841355f lrc: 2/0,0 mode: --/CR res: [0x240000401:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a5ea expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.039156:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.039169:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413520 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413519 expref: 5 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.039176:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 4/1,0 mode: --/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.039202:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413520 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578413519 expref: 5 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002502.039216:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560868992:0@lo:104: 00000100:00100000:3.0:1786002502.039259:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002502.039298:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434606c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002502.040797:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560868992 00000100:00100000:2.0:1786002502.040805:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560868992 00000100:00100000:2.0:1786002502.040843:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:2.0:1786002502.040872:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:14496:x1872758560868992:12345-0@lo:104: 00010000:00010000:2.0:1786002502.040886:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46800/0x7cee4af578413519 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578413520 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.040954:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786002502.040960:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:14496:x1872758560868992:12345-0@lo:104: Request processed in 91us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.040967:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00010000:00010000:2.0:1786002502.040987:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002502.040993:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46800/0x7cee4af578413519 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578413520 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.041002:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002502.041007:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46800/0x7cee4af578413519 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xd3:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578413520 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002502.041015:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46800/0x7cee4af578413519 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xd3:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578413520 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.041043:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46800/0x7cee4af578413519 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xd3:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413520 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.041050:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002502.041068:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46800/0x7cee4af578413519 lrc: 1/0,0 mode: --/PW res: [0x240000401:0xd3:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413520 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.041075:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46800/0x7cee4af578413519 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xd3:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413520 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.041098:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002502.041100:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002502.041102:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002502.041113:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560869120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002502.041142:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002502.041178:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560869120 00000100:00100000:2.0:1786002502.041182:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560869120 00010000:00010000:2.0:1786002502.041199:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413520 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578413519 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002502.041220:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:2.0:1786002502.041227:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1872758560869120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002502.041236:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1786002502.041749:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560868992:0@lo:104: 00010000:00010000:2.0:1786002502.041769:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1786002502.044298:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 394 batchid updated 00000020:00080000:3.0:1786002502.044331:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 394 00000004:00080000:3.0:1786002502.044382:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed243460300 with version 748 00000020:00080000:3.0:1786002502.044391:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 394 cancel update log [0x200000401:0x3:0x0].390: rc = 0 00000020:00080000:3.0:1786002502.044449:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 394 cancel update log [0x240000400:0x3:0x0].391: rc = 0 00000020:00080000:3.0:1786002502.044456:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 394 00000004:00080000:3.0:1786002502.044463:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 748 rpc_version 748 00000020:00100000:3.0:1786002502.044487:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002502.044495:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2419aed80 x1872758560869376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002502.044513:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419aed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560869376:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002502.044568:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002502.044594:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243460000 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.044613:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560869376 00000100:00100000:3.0:1786002502.044617:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560869376 00000100:00100000:3.0:1786002502.044665:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3472 00000100:00100000:3.0:1786002502.044674:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7466:x1872758560869376:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002502.044792:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7466:x1872758560869376:12345-0@lo:1000:osp_up0-1.0 Request processed in 118us (223us total) trans 4294983472 rc 0/0 00000100:00100000:3.0:1786002502.044799:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3472 00000100:00100000:3.0:1786002502.044861:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419aed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560869376:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1786002502.045909:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413520 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578413519 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.045927:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd3:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:3.0:1786002502.045932:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.045942:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.045949:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.045972:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002502.046013:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560869120:12345-0@lo:103:ldlm_bl.0 Request processed in 4785us (4869us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.046021:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00100000:2.0:1786002502.046103:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560869120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002502.046129:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.046137:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002502.046187:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xd3:0x0]: returning size 4096 00000004:00200000:2.0:1786002502.046192:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002502.046243:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af57841355f lrc: 0/0,0 mode: --/CR res: [0x240000401:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ea expref: 10 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.046260:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ea expref: 9 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.046268:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd3:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:2.0:1786002502.046270:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002502.046273:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a600, rc 0) 00000100:00100000:2.0:1786002502.046320:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17741:x1872758530825856:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 7248us (9509us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.046327:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23677 00000100:00100000:3.0:1786002502.068739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002502.068782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002502.069565:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530825984 00000100:00100000:2.0:1786002502.069570:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530825984 00000100:00100000:2.0:1786002502.069612:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1391 00000100:00100000:2.0:1786002502.069620:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758530825984:12345-192.168.203.49@tcp:103:rmdir.0 00010000:00010000:2.0:1786002502.069628:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002502.069641:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841353c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5d5 expref: 9 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.069651:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:2.0:1786002502.069660:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002502.069712:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758530825984:12345-192.168.203.49@tcp:103:rmdir.0 Request processed in 85us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.069720:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1391 00000100:00100000:3.0:1786002502.070287:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560869504 00000100:00100000:3.0:1786002502.070291:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560869504 00000100:00100000:3.0:1786002502.070333:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3473 00000100:00100000:3.0:1786002502.070340:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10360:x1872758560869504:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002502.070350:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002502.070364:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413574 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841356d expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.070385:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413574 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841356d expref: 6 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.070398:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413574 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841356d expref: 6 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.070405:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed24206ac00) 00010000:00010000:3.0:1786002502.070408:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.070411:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a000, rc 0) 00000100:00100000:3.0:1786002502.070538:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10360:x1872758560869504:12345-0@lo:101:mdt00_003.0 Request processed in 198us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.070544:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3473 00000100:00100000:1.0:1786002502.070608:0:10360:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968454 gen 2 00000004:00080000:1.0:1786002502.070614:0:10360:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968449 committed transno 4294968454 00000020:00080000:1.0:1786002502.070619:0:10360:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed243460600 refcount 2 committed 0 result 0 batchid 393 00000020:00080000:1.0:1786002502.070623:0:10360:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245747e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed243460a80 00000020:00080000:1.0:1786002502.070627:0:10360:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].388 00000020:00080000:1.0:1786002502.070630:0:10360:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245747200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244a61a00 00000020:00080000:1.0:1786002502.070633:0:10360:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].388 00000004:00080000:1.0:1786002502.070657:0:10360:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968451 committed transno 4294968454 00000004:00080000:1.0:1786002502.070667:0:10360:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968452 committed transno 4294968454 00000004:00080000:1.0:1786002502.070676:0:10360:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968454 committed transno 4294968454 00000100:00100000:1.0:1786002502.070692:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560869504:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786002502.070719:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47e00/0x7cee4af57841356d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413574 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.070731:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47e00/0x7cee4af57841356d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413574 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002502.070746:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1786002502.070768:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e200/0x7cee4af57841357b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.070775:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e200/0x7cee4af57841357b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.070783:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e200/0x7cee4af57841357b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002502.070795:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560869632:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1786002502.070823:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002502.070861:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f480 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.070984:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560869632 00000100:00100000:3.0:1786002502.070988:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560869632 00000100:00100000:3.0:1786002502.071016:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3474 00000100:00100000:3.0:1786002502.071023:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10360:x1872758560869632:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002502.071031:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002502.071042:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af578413582 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841357b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.071057:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af578413582 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841357b expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.071066:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af578413582 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841357b expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.071074:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x94284bcd (ffff9ed24206ab00) 00010000:00010000:3.0:1786002502.071076:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.071078:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5be00, rc 0) 00000100:00100000:3.0:1786002502.071109:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:10360:x1872758560869632:12345-0@lo:101:mdt00_003.0 Request processed in 86us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.071116:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3474 00000100:00100000:3.0:1786002502.071139:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560869632:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002502.071149:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e200/0x7cee4af57841357b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413582 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.071157:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e200/0x7cee4af57841357b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413582 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002502.071169:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:3.0:1786002502.071196:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e15880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560869760:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002502.071218:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002502.071242:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed242216240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.071252:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560869760 00000100:00100000:3.0:1786002502.071255:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560869760 00000100:00100000:3.0:1786002502.071272:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3475 00000100:00100000:3.0:1786002502.071277:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:10360:x1872758560869760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002502.071326:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:10360:x1872758560869760:12345-0@lo:1000:mdt00_003.0 Request processed in 48us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.071332:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3475 00000100:00100000:3.0:1786002502.071355:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e15880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560869760:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002502.071385:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e15880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560869888:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002502.071408:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002502.071509:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed242216240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.071522:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560869888 00000100:00100000:3.0:1786002502.071525:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560869888 00000100:00100000:3.0:1786002502.071545:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3476 00000100:00100000:3.0:1786002502.071551:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:10360:x1872758560869888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002502.071607:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:10360:x1872758560869888:12345-0@lo:1000:mdt00_003.0 Request processed in 56us (198us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002502.071613:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3476 00000100:00100000:3.0:1786002502.071634:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e15880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560869888:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1786002502.071665:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5aa00/0x7cee4af578413589 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.071672:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5aa00/0x7cee4af578413589 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.071679:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5aa00/0x7cee4af578413589 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002502.071689:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e15880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560870016:0@lo:101:mdt00_003.0 00000020:00080000:2.0:1786002502.071819:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 393 committed batchid 391 00000020:00080000:2.0:1786002502.071885:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 391 00000100:00100000:3.0:1786002502.071990:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002502.072010:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed242216780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002502.072093:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560870016 00000100:00100000:2.0:1786002502.072097:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560870016 00000100:00100000:2.0:1786002502.072126:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3477 00000100:00100000:2.0:1786002502.072133:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:10360:x1872758560870016:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002502.072141:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002502.072152:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af578413590 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413589 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.072169:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af578413590 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413589 expref: 8 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.072179:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af578413590 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413589 expref: 8 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.072187:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff9ed2434dfc00) 00010000:00010000:2.0:1786002502.072189:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002502.072192:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556bc00, rc 0) 00000100:00100000:2.0:1786002502.072228:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:10360:x1872758560870016:12345-0@lo:101:mdt00_003.0 Request processed in 95us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.072242:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3477 00000100:00100000:2.0:1786002502.077722:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530826368 00000100:00100000:2.0:1786002502.077730:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530826368 00010000:00010000:2.0:1786002502.077765:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413558 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5e3 expref: 17 pid: 6522 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002502.077801:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1614 00000100:00100000:2.0:1786002502.077811:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758530826368:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002502.077825:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002502.077832:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413558 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5e3 expref: 17 pid: 6522 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.077871:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413558 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5e3 expref: 17 pid: 6522 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.077901:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413558 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5e3 expref: 17 pid: 6522 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.077916:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd3:0x0].0x0 (ffff9ed3465ad300) 00010000:00010000:2.0:1786002502.077921:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af57841359e lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.077929:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af57841359e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.077936:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af57841359e lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.077958:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002502.078003:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758530826368:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 193us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.078010:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1614 00000100:00100000:3.0:1786002502.078393:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560870272 00000100:00100000:3.0:1786002502.078397:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560870272 00000100:00100000:3.0:1786002502.078433:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3478 00000100:00100000:3.0:1786002502.078440:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:10360:x1872758560870272:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002502.078453:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002502.078465:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784135ac lrc: 2/0,0 mode: --/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784135a5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.078484:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ea expref: 7 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.078493:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784135ac lrc: 4/0,0 mode: --/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784135a5 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.078518:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ea expref: 7 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.078529:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ea expref: 7 pid: 14496 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002502.078540:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e15c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6525:1872758560870400:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002502.078587:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed242216240 going to sleep for 11 seconds 00000100:00100000:1.0:1786002502.083430:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002502.083558:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e15c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6525:1872758560870400:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002502.083589:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784135ac lrc: 3/0,0 mode: --/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784135a5 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.083600:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd3:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:3.0:1786002502.083603:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002502.083606:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784135ac lrc: 3/0,0 mode: --/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784135a5 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.083615:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784135ac lrc: 3/0,0 mode: --/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784135a5 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.083621:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a200, rc 0) 00000100:00100000:3.0:1786002502.083672:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:10360:x1872758560870272:12345-0@lo:101:mdt00_003.0 Request processed in 5232us (5346us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.083680:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3478 00000100:00100000:1.0:1786002502.083769:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560870272:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786002502.083785:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.083796:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002502.083944:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530826496 00000100:00100000:2.0:1786002502.083951:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530826496 00010000:00010000:2.0:1786002502.083977:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ea expref: 8 pid: 14496 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002502.084008:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1615 00000100:00100000:2.0:1786002502.084017:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758530826496:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002502.084031:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002502.084037:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ea expref: 8 pid: 14496 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.084049:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ea expref: 8 pid: 14496 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.084070:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413566 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ea expref: 8 pid: 14496 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.084081:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd3:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:2.0:1786002502.084085:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784135ac lrc: 2/0,0 mode: --/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784135a5 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.084093:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784135ac lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784135a5 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.084099:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784135ac lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784135a5 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.084124:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784135ac lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784135a5 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002502.084135:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f571c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6506:1872758560870528:0@lo:105: 00000100:00100000:2.0:1786002502.084164:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002502.084199:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e536c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002502.084245:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560870528 00000100:00100000:1.0:1786002502.084249:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560870528 00000100:00100000:1.0:1786002502.084277:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1786002502.084283:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6506:x1872758560870528:12345-0@lo:105: 00010000:00010000:1.0:1786002502.084291:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.084304:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.084311:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.084317:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.084323:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.084330:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.084346:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245c47800) 00000100:00100000:1.0:1786002502.084374:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6506:x1872758560870528:12345-0@lo:105: Request processed in 91us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002502.084381:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00010000:00010000:1.0:1786002502.084398:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.084406:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002502.085053:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560870656:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1786002502.085091:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002502.085107:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002502.085350:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f571c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6506:1872758560870528:0@lo:105: 00010000:00010000:2.0:1786002502.085362:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002502.085404:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758530826496:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 1388us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.085420:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1615 00000100:00100000:3.0:1786002502.085736:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560870656 00000100:00100000:3.0:1786002502.085741:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560870656 00000100:00100000:3.0:1786002502.085775:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3479 00000100:00100000:3.0:1786002502.085783:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:10360:x1872758560870656:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1786002502.087349:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:10360:x1872758560870656:12345-0@lo:403:mdt00_003.0 Request processed in 1563us (2254us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.087358:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3479 00000100:00100000:3.0:1786002502.087403:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560870656:0@lo:403:mdt00_003.0 00000040:00080000:3.0:1786002502.088276:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].391, 952 off592944 00000040:00080000:3.0:1786002502.088440:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].390, 1032 off641840 00000004:00080000:3.0:1786002502.088447:0:10360:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed242216240 with version 743 00000100:00100000:3.0:1786002502.090790:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560870912 00000100:00100000:3.0:1786002502.090797:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560870912 00000100:00100000:3.0:1786002502.090950:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3480 00000100:00100000:3.0:1786002502.090962:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560870912:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002502.091501:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560870912:12345-0@lo:1000:osp_up1-0.0 Request processed in 540us (1061us total) trans 4294968455 rc 0/0 00000100:00100000:3.0:1786002502.091508:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3480 00000004:00200000:3.0:1786002502.091659:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1535:0x0]: returning size 4096 00010000:00010000:3.0:1786002502.091678:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af57841359e lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.091688:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af57841359e lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.091697:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af57841359e lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.091702:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002502.091774:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af57841359e lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.091784:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af57841359e lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.091799:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd3:0x0].0x0 (ffff9ed3465ad300) 00010000:00010000:3.0:1786002502.091802:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002502.091807:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af57841359e lrc: 2/0,0 mode: --/EX res: [0x200000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.091813:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af57841359e lrc: 0/0,0 mode: --/EX res: [0x200000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.091827:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.091835:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.091842:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47800/0x7cee4af5784135a5 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784135ac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092039:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002502.092048:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xd3:0x0] 00010000:00010000:3.0:1786002502.092057:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578413597 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092064:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578413597 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092070:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578413597 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092079:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002502.092082:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578413597 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092088:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578413597 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092097:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff9ed3465adf00) 00010000:00010000:3.0:1786002502.092099:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.092103:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578413597 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092109:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578413597 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092120:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5aa00/0x7cee4af578413589 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413590 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092127:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5aa00/0x7cee4af578413589 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413590 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092135:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5aa00/0x7cee4af578413589 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413590 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092341:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002502.092351:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1786002502.092356:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47e00/0x7cee4af57841356d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413574 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092368:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47e00/0x7cee4af57841356d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413574 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.092375:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47e00/0x7cee4af57841356d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413574 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.092640:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002502.092689:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560871040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002502.092737:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002502.092875:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560871040 00000100:00100000:1.0:1786002502.092881:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560871040 00000100:00100000:1.0:1786002502.092929:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1786002502.092937:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+10:3647:x1872758560871040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002502.092949:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002502.092965:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a200/0x7cee4af5784135ac lrc: 0/0,0 mode: --/EX res: [0x240000401:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784135a5 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.092977:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd3:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:1.0:1786002502.092984:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002502.093013:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3647:x1872758560871040:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002502.093020:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:2.0:1786002502.093093:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560871040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002502.093170:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786002502.093175:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47e00/0x7cee4af57841356d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413574 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002502.093191:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1786002502.093197:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e200/0x7cee4af57841357b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413582 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.093205:0:10360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e200/0x7cee4af57841357b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413582 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002502.093278:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17741:x1872758530826240:12345-192.168.203.49@tcp:36:rmdir.0 Request processed in 24201us (24546us total) trans 4294983473 rc 0/0 00000100:00100000:3.0:1786002502.093286:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23678 00010000:00010000:2.0:1786002502.093332:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002502.098946:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560871168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002502.099025:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002502.099111:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002502.099118:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560871296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002502.099144:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002502.105389:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560871168 00000100:00100000:2.0:1786002502.105402:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560871168 00000100:00100000:2.0:1786002502.105482:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560871296 00000100:00100000:2.0:1786002502.105486:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560871296 00000100:00100000:2.0:1786002502.105523:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:2.0:1786002502.105533:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34bc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3644:x1872758560871168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002502.105549:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002502.105572:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af578413590 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1535:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413589 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.105587:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1535:0x0].0x0 (ffff9ed2434dfc00) 00010000:00010000:2.0:1786002502.105597:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002502.105656:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34bc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3644:x1872758560871168:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (6631us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.105662:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:2.0:1786002502.105704:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:2.0:1786002502.106158:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3644:x1872758560871296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002502.106167:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002502.106178:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413574 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841356d expref: 8 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.106189:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed24206ac00) 00010000:00010000:2.0:1786002502.106196:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002502.106219:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1872758560871296:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (7075us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002502.106292:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560871296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002502.106301:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560871168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002502.107325:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1786002502.107402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002502.107618:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530826624 00000100:00100000:3.0:1786002502.107624:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530826624 00000100:00100000:3.0:1786002502.107694:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23679 00000100:00100000:3.0:1786002502.107702:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:17742:x1872758530826624:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002502.107778:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002502.107799:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b400/0x7cee4af5784135b3 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a5f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.107898:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784135ba lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.107910:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784135ba lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.107920:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784135ba lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.107934:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af5784135c1 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.107940:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af5784135c1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.107946:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af5784135c1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.107982:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784135ba lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.107988:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784135ba lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.107994:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784135ba lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108000:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784135ba lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108005:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002502.108009:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784135ba lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108015:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784135ba lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108023:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed24206a600) 00010000:00010000:3.0:1786002502.108026:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.108029:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784135ba lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108034:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af5784135ba lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108043:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af5784135c1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108048:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af5784135c1 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108053:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af5784135c1 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108056:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002502.108059:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af5784135c1 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108063:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af5784135c1 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108068:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xbc121369 (ffff9ed24206a200) 00010000:00010000:3.0:1786002502.108070:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.108072:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af5784135c1 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108077:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af5784135c1 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108104:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b400/0x7cee4af5784135b3 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5f1 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108112:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed24206a600) 00010000:00010000:3.0:1786002502.108114:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.108117:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b400/0x7cee4af5784135b3 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5f1 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.108125:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b400, rc 0) 00000100:00100000:3.0:1786002502.108167:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:17742:x1872758530826624:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 466us (767us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002502.108174:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23679 00000100:00100000:3.0:1786002502.113979:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530826752 00000100:00100000:3.0:1786002502.113988:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530826752 00000100:00100000:3.0:1786002502.114043:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23680 00000100:00100000:3.0:1786002502.114053:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:17742:x1872758530826752:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002502.114072:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002502.114091:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784135c8 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a5f8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114145:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784135cf lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114161:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784135cf lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114169:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784135cf lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114180:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af5784135d6 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114186:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af5784135d6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114191:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af5784135d6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114222:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784135cf lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114227:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784135cf lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114324:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784135cf lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114330:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784135cf lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114337:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002502.114341:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784135cf lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114347:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784135cf lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114358:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed24206a900) 00010000:00010000:3.0:1786002502.114361:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.114365:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784135cf lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114371:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784135cf lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114382:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af5784135d6 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114387:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af5784135d6 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114392:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af5784135d6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114395:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5bc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002502.114398:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af5784135d6 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114402:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af5784135d6 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114407:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xbc121369 (ffff9ed24206a100) 00010000:00010000:3.0:1786002502.114409:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.114411:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af5784135d6 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114421:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af5784135d6 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114453:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784135c8 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5f8 expref: 8 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114462:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed24206a900) 00010000:00010000:3.0:1786002502.114464:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.114563:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784135c8 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5f8 expref: 8 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.114578:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b800, rc 0) 00000100:00100000:3.0:1786002502.114665:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:17742:x1872758530826752:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 612us (781us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002502.114672:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23680 00000100:00100000:2.0:1786002502.124240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002502.124340:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530826880 00000100:00100000:1.0:1786002502.124349:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530826880 00000100:00100000:1.0:1786002502.124402:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23681 00000100:00100000:1.0:1786002502.124412:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:17742:x1872758530826880:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002502.124440:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002502.124462:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784135dd lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a5ff expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.124527:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af5784135e4 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.124539:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af5784135e4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.124548:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af5784135e4 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002502.124588:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1786002502.124592:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786002502.124624:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784135dd lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ff expref: 9 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.124638:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af5784135e4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ff expref: 8 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.124645:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed35363d800) 00010000:00010000:1.0:1786002502.124648:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002502.124651:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f400, rc 0) 00000100:00100000:1.0:1786002502.124698:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17742:x1872758530826880:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 288us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002502.124840:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23681 00000100:00100000:2.0:1786002502.131595:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002502.132655:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530827136 00000100:00100000:3.0:1786002502.132666:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530827136 00000100:00100000:3.0:1786002502.132734:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23682 00000100:00100000:3.0:1786002502.132744:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17742:x1872758530827136:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:3.0:1786002502.132808:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002502.132833:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af5784135e4 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5ff expref: 8 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.132864:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed35363d800) 00010000:00010000:3.0:1786002502.132874:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002502.132939:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784135eb lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.132952:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784135eb lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.132962:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784135eb lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.132974:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784135f2 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xbc121369 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.132981:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784135f2 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.132988:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784135f2 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002502.135642:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].393, 2168 off603320 00000040:00080000:3.0:1786002502.136308:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].392, 2368 off651176 00000004:00080000:3.0:1786002502.136316:0:6520:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed243460240 with version 749 00000004:00080000:3.0:1786002502.136336:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 749 rpc_version 749 00000020:00100000:3.0:1786002502.136370:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002502.136380:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243e15c00 x1872758560871552/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 4232/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002502.136402:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e15c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560871552:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002502.137364:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002502.137389:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e5f4840 going to sleep for 11 seconds 00000100:00100000:2.0:1786002502.137452:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560871552 00000100:00100000:2.0:1786002502.137460:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560871552 00000100:00100000:2.0:1786002502.137643:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3481 00000100:00100000:2.0:1786002502.137652:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7466:x1872758560871552:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002502.138193:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:7466:x1872758560871552:12345-0@lo:1000:osp_up0-1.0 Request processed in 541us (830us total) trans 4294983474 rc 0/0 00000100:00100000:2.0:1786002502.138200:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3481 00000100:00100000:3.0:1786002502.138511:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e15c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560871552:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1786002502.138644:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784135f9 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x191:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.138660:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784135f9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.138671:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784135f9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x191:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.138687:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413600 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.138693:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.138701:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578413600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.138977:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af578413607 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.138984:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af578413607 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.138993:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af578413607 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002502.139011:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245510000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560871680:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1786002502.139042:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002502.139066:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.139300:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560871680 00000100:00100000:3.0:1786002502.139305:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560871680 00000100:00100000:3.0:1786002502.139340:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3482 00000100:00100000:3.0:1786002502.139346:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560871680:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786002502.139360:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002502.139375:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af57841360e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413607 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.139392:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af57841360e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413607 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.139402:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af57841360e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413607 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.139409:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd1:0x0].0x0 (ffff9ed24206ac00) 00010000:00010000:3.0:1786002502.139412:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.139467:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a200, rc 0) 00000100:00100000:3.0:1786002502.139504:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:6520:x1872758560871680:12345-0@lo:101:mdt00_000.0 Request processed in 158us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.139510:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3482 00000100:00100000:3.0:1786002502.170451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002502.170499:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530827392 00000100:00100000:3.0:1786002502.170508:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530827392 00000100:00100000:3.0:1786002502.170561:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23683 00000100:00100000:3.0:1786002502.170571:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17743:x1872758530827392:12345-192.168.203.49@tcp:36:mkdir.0 00000100:00100000:3.0:1786002502.170753:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17743:x1872758530827392:12345-192.168.203.49@tcp:36:mkdir.0 Request processed in 181us (310us total) trans 0 rc -17/-17 00000100:00100000:3.0:1786002502.170760:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23683 00000100:00100000:3.0:1786002502.196760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002502.196888:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530827520 00000100:00100000:2.0:1786002502.196905:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530827520 00000100:00100000:2.0:1786002502.196965:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23684 00000100:00100000:2.0:1786002502.196976:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17744:x1872758530827520:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002502.197007:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002502.197029:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578413615 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a606 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197092:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af57841361c lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197105:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af57841361c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197117:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af57841361c lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197129:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af578413623 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197137:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af578413623 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197143:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af578413623 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197211:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841362a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x191:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197219:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841362a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197226:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841362a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002502.197508:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x191:0x0]: returning size 4096 00000004:00200000:2.0:1786002502.197513:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1786002502.197532:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841362a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197546:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af57841361c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197552:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af57841361c lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197559:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af57841361c lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197569:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af57841361c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197576:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002502.197579:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af57841361c lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197586:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af57841361c lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197599:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed2434dfe00) 00010000:00010000:2.0:1786002502.197602:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002502.197606:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af57841361c lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197612:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af57841361c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197624:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af578413623 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197630:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af578413623 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197635:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af578413623 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197638:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002502.197641:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af578413623 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197649:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af578413623 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197655:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xbc121369 (ffff9ed24206af00) 00010000:00010000:2.0:1786002502.197657:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002502.197659:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af578413623 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197664:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556aa00/0x7cee4af578413623 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197686:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578413615 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a606 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197703:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ae00/0x7cee4af57841362a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x191:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a606 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.197723:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff9ed2434dfc00) 00010000:00010000:2.0:1786002502.197725:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786002502.197727:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556ae00, rc 0) 00000100:00100000:2.0:1786002502.197776:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:17744:x1872758530827520:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 802us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.197782:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23684 00000100:00100000:3.0:1786002502.204005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002502.205796:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530827648 00000100:00100000:2.0:1786002502.205807:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530827648 00000100:00100000:2.0:1786002502.207073:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23685 00000100:00100000:2.0:1786002502.207086:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:17744:x1872758530827648:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002502.207106:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002502.207123:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ac00/0x7cee4af578413631 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a60d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.207184:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413638 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.207195:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413638 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.207204:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413638 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002502.207256:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xd1:0x0]: returning size 4096 00000004:00200000:2.0:1786002502.207260:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002502.207289:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556ac00/0x7cee4af578413631 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a60d expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.207302:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413638 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a60d expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.207309:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd1:0x0].0x0 (ffff9ed2434df400) 00010000:00010000:2.0:1786002502.207312:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002502.207315:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a200, rc 0) 00000100:00100000:2.0:1786002502.207376:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17744:x1872758530827648:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 294us (3378us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.207382:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23685 00000100:00100000:3.0:1786002502.212550:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002502.212784:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530827776 00000100:00100000:1.0:1786002502.212793:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530827776 00000100:00100000:1.0:1786002502.212864:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23686 00000100:00100000:1.0:1786002502.212874:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17744:x1872758530827776:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:1.0:1786002502.212903:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002502.212921:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af57841363f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a614 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.212968:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.212980:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af57841360e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413607 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.213186:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.213218:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af57841360e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578413607 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002502.213240:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560871808:0@lo:104: 00000100:00100000:1.0:1786002502.213280:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002502.213323:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.213435:0:17237:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786002502.213446:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560871808 00000100:00100000:3.0:1786002502.213450:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560871808 00000100:00100000:3.0:1786002502.213485:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:3.0:1786002502.213492:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243664050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10360:x1872758560871808:12345-0@lo:104: 00010000:00010000:3.0:1786002502.213503:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556a800/0x7cee4af578413607 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af57841360e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.213981:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786002502.213998:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243664050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10360:x1872758560871808:12345-0@lo:104: Request processed in 497us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.214005:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:2.0:1786002502.214451:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002502.214465:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560871936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002502.214500:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786002502.217085:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e200/0x7cee4af57841357b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413582 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002502.217101:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e200/0x7cee4af57841357b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413582 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.217131:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e200/0x7cee4af57841357b lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413582 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.217137:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002502.217152:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e200/0x7cee4af57841357b lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413582 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002502.217167:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983474 is committed 00000001:00080000:3.0:1786002502.217203:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983473 is committed 00000020:00080000:3.0:1786002502.217210:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 393 batchid updated 00000020:00080000:3.0:1786002502.217219:0:6499:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed34bb3c480 refcount 2 committed 0 result 0 batchid 394 00000020:00080000:3.0:1786002502.217223:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed34bb3cc00 00000020:00080000:3.0:1786002502.217490:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].389 00000020:00080000:3.0:1786002502.217493:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed346085a00 00000020:00080000:3.0:1786002502.217496:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].390 00000020:00080000:3.0:1786002502.217516:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 392 batchid updated 00000100:00100000:2.0:1786002502.217797:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560872064:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1786002502.217843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1786002502.218396:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 744 rpc_version 744 00000020:00100000:2.0:1786002502.218417:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002502.218424:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed37f535c00 x1872758560872320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002502.218441:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560872320:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002502.218471:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002502.218488:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed342bf6540 going to sleep for 11 seconds 00000100:00100000:2.0:1786002502.220324:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560872064 00000100:00100000:2.0:1786002502.220771:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560872064 00000100:00100000:2.0:1786002502.220828:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:2.0:1786002502.220838:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1872758560872064:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1786002502.220875:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002502.220908:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af578413582 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x94284bcd bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841357b expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.220922:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x94284bcd (ffff9ed24206ab00) 00010000:00010000:2.0:1786002502.220932:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002502.220982:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1872758560872064:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 146us (3138us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.221406:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:2.0:1786002502.221479:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560872064:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1786002502.221534:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd1:0x0].0x0 (ffff9ed24206ac00) 00010000:00010000:2.0:1786002502.221540:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.221551:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.221559:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.221576:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002502.221606:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3647:x1872758560871936:12345-0@lo:103:ldlm_bl.0 Request processed in 6974us (7106us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.221613:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616 00000100:00100000:2.0:1786002502.221639:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560871936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002502.221917:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af57841360e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578413607 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002502.221929:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560871808:0@lo:104: 00010000:00010000:1.0:1786002502.221942:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.221954:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.221961:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002502.222160:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xd1:0x0]: returning size 4096 00000004:00200000:1.0:1786002502.222167:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786002502.222211:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af57841363f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a614 expref: 15 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.222226:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a614 expref: 14 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002502.222575:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560872320 00000100:00100000:3.0:1786002502.222581:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560872320 00000100:00100000:3.0:1786002502.222613:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3483 00000100:00100000:3.0:1786002502.222621:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1872758560872320:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786002502.222775:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd1:0x0].0x0 (ffff9ed24206ac00) 00010000:00010000:1.0:1786002502.222778:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002502.222781:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f000, rc 0) 00000100:00100000:1.0:1786002502.222825:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:17744:x1872758530827776:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 9952us (10282us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002502.222832:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23686 00000100:00100000:3.0:1786002502.224146:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560872320:12345-0@lo:1000:osp_up1-0.0 Request processed in 1522us (5670us total) trans 4294968457 rc 0/0 00000100:00100000:3.0:1786002502.224155:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3483 00000100:00100000:3.0:1786002502.230973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002502.232367:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560872320:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786002502.232461:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 745 rpc_version 745 00000020:00100000:3.0:1786002502.232487:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002502.232494:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243dd4700 x1872758560872704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002502.232510:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560872704:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002502.232543:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002502.232568:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002502.232604:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560872704 00000100:00100000:2.0:1786002502.232609:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560872704 00000100:00100000:2.0:1786002502.232645:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3484 00000100:00100000:2.0:1786002502.232652:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560872704:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002502.232794:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560872704:12345-0@lo:1000:osp_up1-0.0 Request processed in 141us (250us total) trans 4294968458 rc 0/0 00000100:00100000:2.0:1786002502.232802:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3484 00000100:00100000:1.0:1786002502.232900:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560872704:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002502.258117:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002502.258253:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758560872448:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002502.258279:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002502.262183:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530828160 00000100:00100000:2.0:1786002502.262198:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530828160 00010000:00010000:2.0:1786002502.262238:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413638 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a60d expref: 11 pid: 6520 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002502.262275:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1617 00000100:00100000:2.0:1786002502.262285:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530828160:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002502.262302:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002502.262308:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413638 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a60d expref: 11 pid: 6520 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.262321:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413638 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a60d expref: 11 pid: 6520 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.262816:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578413638 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a60d expref: 11 pid: 6520 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.262831:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd1:0x0].0x0 (ffff9ed2434df400) 00010000:00010000:2.0:1786002502.262836:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.262871:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.262880:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.262915:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002502.262962:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2413:x1872758530828160:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 678us (4853us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.262969:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1617 00010000:00010000:1.0:1786002502.263199:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.263210:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.263247:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e600/0x7cee4af578413669 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.263253:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e600/0x7cee4af578413669 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.263261:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e600/0x7cee4af578413669 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002502.263277:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560872832:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1786002502.263315:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002502.264127:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560872832 00000100:00100000:3.0:1786002502.264135:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560872832 00000100:00100000:3.0:1786002502.264180:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3485 00000100:00100000:3.0:1786002502.264188:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6522:x1872758560872832:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1786002502.264204:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002502.264219:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578413670 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413669 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.264246:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a614 expref: 13 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.264255:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578413670 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413669 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.264279:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a614 expref: 13 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.264292:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a614 expref: 13 pid: 10360 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002502.264304:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6526:1872758560872960:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002502.264418:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.265930:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcf780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002502.272651:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002502.273201:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560873088 00000100:00100000:2.0:1786002502.273205:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560873088 00000100:00100000:2.0:1786002502.273237:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:2.0:1786002502.273244:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560873088:12345-0@lo:105: 00010000:00010000:2.0:1786002502.273254:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e600/0x7cee4af578413669 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413670 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.273263:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e600/0x7cee4af578413669 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413670 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.273272:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e600/0x7cee4af578413669 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413670 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.273279:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e600/0x7cee4af578413669 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413670 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.273286:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e600/0x7cee4af578413669 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413670 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.273293:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e600/0x7cee4af578413669 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578413670 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.273307:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245e7e600) 00000100:00100000:2.0:1786002502.273353:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560873088:12345-0@lo:105: Request processed in 110us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.273360:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:2.0:1786002502.273391:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560873088:0@lo:105: 00010000:00010000:2.0:1786002502.273406:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002502.273435:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2412:x1872758530828288:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 623us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002502.273442:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1618 00010000:00010000:3.0:1786002502.274177:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a614 expref: 13 pid: 10360 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002502.274191:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6526:1872758560872960:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002502.274208:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578413670 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413669 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.274216:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd1:0x0].0x0 (ffff9ed24206ac00) 00010000:00010000:3.0:1786002502.274219:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002502.274221:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5bc00, rc 0) 00000100:00100000:3.0:1786002502.274263:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6522:x1872758560872832:12345-0@lo:101:mdt00_002.0 Request processed in 10075us (10947us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.274269:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3485 00000020:00080000:3.0:1786002502.274981:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 395 committed batchid 394 00000020:00080000:3.0:1786002502.275040:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 394 00000100:00100000:3.0:1786002502.275774:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560873216 00000100:00100000:3.0:1786002502.275781:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560873216 00000100:00100000:3.0:1786002502.275831:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3486 00000100:00100000:3.0:1786002502.275840:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6522:x1872758560873216:12345-0@lo:403:mdt00_002.0 00000100:00100000:3.0:1786002502.287491:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6522:x1872758560873216:12345-0@lo:403:mdt00_002.0 Request processed in 11647us (11920us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.287504:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3486 00000004:00080000:1.0:1786002502.287770:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 750 rpc_version 750 00000020:00100000:1.0:1786002502.289608:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002502.289619:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244bba680 x1872758560873472/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002502.289639:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560873472:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002502.289695:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002502.289940:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002502.294080:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560873472 00000100:00100000:2.0:1786002502.294093:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560873472 00000100:00100000:2.0:1786002502.294141:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3487 00000100:00100000:2.0:1786002502.294150:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7466:x1872758560873472:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002502.294682:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7466:x1872758560873472:12345-0@lo:1000:osp_up0-1.0 Request processed in 532us (4985us total) trans 4294983475 rc 0/0 00000100:00100000:2.0:1786002502.294690:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3487 00000004:00200000:1.0:1786002502.296738:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x191:0x0]: returning size 4096 00010000:00010000:1.0:1786002502.296762:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.296773:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.296915:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.296922:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002502.296927:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.296934:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.296949:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd1:0x0].0x0 (ffff9ed2434df400) 00010000:00010000:1.0:1786002502.296952:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002502.296957:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.296964:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413662 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.296977:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e600/0x7cee4af578413669 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413670 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.296985:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e600/0x7cee4af578413669 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413670 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297001:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e600/0x7cee4af578413669 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413670 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297020:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786002502.297029:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xd1:0x0] 00010000:00010000:1.0:1786002502.297036:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af57841365b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297042:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af57841365b lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297047:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af57841365b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297051:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002502.297053:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af57841365b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297058:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af57841365b lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297065:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x191:0x0].0x0 (ffff9ed2434dfc00) 00010000:00010000:1.0:1786002502.297067:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002502.297069:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af57841365b lrc: 2/0,0 mode: --/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297075:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af57841365b lrc: 0/0,0 mode: --/EX res: [0x240000402:0x191:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297090:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af57841364d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297096:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af57841364d lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297102:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af57841364d lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297107:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af57841364d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297113:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002502.297116:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af57841364d lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297123:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af57841364d lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297129:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed2456efa00) 00010000:00010000:1.0:1786002502.297131:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002502.297134:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af57841364d lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297139:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af57841364d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002502.297153:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006992b0d2 reply state 00000000e35345d5 transno 4294968459 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47c00/0x7cee4af578413654 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297164:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47c00/0x7cee4af578413654 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0xbc121369 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.297171:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xbc121369 (ffff9ed24206af00) 00010000:00010000:1.0:1786002502.297173:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002502.297176:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002502.297240:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17744:x1872758530828032:12345-192.168.203.49@tcp:36:rmdir.0 Request processed in 66081us (66272us total) trans 4294968459 rc 0/0 00000100:00100000:1.0:1786002502.297248:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23687 00000100:00100000:2.0:1786002502.321366:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002502.329709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002502.329872:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530828544 00000100:00100000:1.0:1786002502.329880:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530828544 00000100:00100000:1.0:1786002502.329943:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23689 00000100:00100000:1.0:1786002502.329954:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17745:x1872758530828544:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002502.329974:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002502.330004:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af57841368c lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a622 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330066:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413693 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330080:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413693 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330091:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413693 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330103:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af57841369a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330109:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af57841369a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330116:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af57841369a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330153:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413693 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330161:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413693 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330168:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413693 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330180:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413693 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330186:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002502.330190:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413693 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330198:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413693 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330209:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed35363da00) 00010000:00010000:1.0:1786002502.330212:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002502.330216:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413693 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330222:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413693 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330252:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af57841369a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330258:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af57841369a lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330264:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af57841369a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330268:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002502.330271:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af57841369a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330280:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af57841369a lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330288:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xe8fb0a82 (ffff9ed35363d500) 00010000:00010000:1.0:1786002502.330290:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002502.330293:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af57841369a lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330299:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af57841369a lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330338:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af57841368c lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a622 expref: 12 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330349:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed35363da00) 00010000:00010000:1.0:1786002502.330351:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002502.330355:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af57841368c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a622 expref: 12 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.330365:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fc00, rc 0) 00000100:00100000:1.0:1786002502.330416:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17745:x1872758530828544:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 463us (715us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002502.330423:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23689 00000100:00100000:2.0:1786002502.339498:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002502.341407:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530828672 00000100:00100000:1.0:1786002502.341420:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530828672 00000100:00100000:1.0:1786002502.341775:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23690 00000100:00100000:1.0:1786002502.341831:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17745:x1872758530828672:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002502.341914:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002502.341936:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784136a1 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a629 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.343058:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784136a8 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.343073:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784136a8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.343083:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784136a8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002502.343121:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1786002502.343125:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786002502.343157:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784136a1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a629 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.343171:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784136a8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a629 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.343179:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed35363d700) 00010000:00010000:1.0:1786002502.343181:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002502.343184:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7ee00, rc 0) 00000100:00100000:1.0:1786002502.343251:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:17745:x1872758530828672:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 1466us (3761us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002502.343256:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23690 00000100:00100000:1.0:1786002502.361515:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002502.361939:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560873728 00000100:00100000:3.0:1786002502.361943:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560873728 00000100:00100000:3.0:1786002502.361980:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3488 00000100:00100000:3.0:1786002502.361996:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6520:x1872758560873728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002502.362070:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6520:x1872758560873728:12345-0@lo:1000:mdt00_000.0 Request processed in 83us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.362077:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3488 00000100:00100000:3.0:1786002502.362546:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560873856 00000100:00100000:3.0:1786002502.362550:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560873856 00000100:00100000:3.0:1786002502.362581:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3489 00000100:00100000:3.0:1786002502.362588:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6520:x1872758560873856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002502.362656:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6520:x1872758560873856:12345-0@lo:1000:mdt00_000.0 Request processed in 68us (161us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002502.362662:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3489 00000100:00100000:3.0:1786002502.362870:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560873984 00000100:00100000:3.0:1786002502.362875:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560873984 00000100:00100000:3.0:1786002502.362904:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3490 00000100:00100000:3.0:1786002502.362911:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6520:x1872758560873984:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786002502.362919:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002502.362933:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784136b6 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784136af expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.362955:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784136a8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a629 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.362963:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784136b6 lrc: 4/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784136af expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.362983:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784136a8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a629 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.363005:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784136a8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a629 expref: 11 pid: 6522 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002502.363015:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6525:1872758560874112:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002502.364293:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002502.365535:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6525:1872758560874112:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002502.365559:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784136b6 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784136af expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.365570:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed35363d700) 00010000:00010000:1.0:1786002502.365573:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002502.365577:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784136b6 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784136af expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.365585:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b800, rc 0) 00000100:00100000:1.0:1786002502.365631:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6520:x1872758560873984:12345-0@lo:101:mdt00_000.0 Request processed in 2721us (2853us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002502.365638:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3490 00000100:00100000:1.0:1786002502.366706:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002502.367032:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530829056 00000100:00100000:3.0:1786002502.367040:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530829056 00010000:00010000:3.0:1786002502.367069:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784136a8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a629 expref: 12 pid: 6522 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002502.367093:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1619 00000100:00100000:3.0:1786002502.367101:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34656a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2413:x1872758530829056:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002502.367116:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002502.367121:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784136a8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a629 expref: 12 pid: 6522 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.367131:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784136a8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a629 expref: 12 pid: 6522 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.367149:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af5784136a8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a629 expref: 12 pid: 6522 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.367160:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed35363d700) 00010000:00010000:3.0:1786002502.367165:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784136b6 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784136af expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.367174:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784136b6 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784136af expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.367181:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784136b6 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784136af expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.367217:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784136b6 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784136af expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002502.367236:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6507:1872758560874240:0@lo:105: 00000100:00100000:3.0:1786002502.367267:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002502.367295:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcf780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.367308:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560874240 00000100:00100000:3.0:1786002502.367312:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560874240 00000100:00100000:3.0:1786002502.367335:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1786002502.367341:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6507:x1872758560874240:12345-0@lo:105: 00010000:00010000:3.0:1786002502.367350:0:17237:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af5784136af lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784136b6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.367358:0:17237:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af5784136af lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784136b6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.367364:0:17237:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af5784136af lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784136b6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.367370:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af5784136af lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784136b6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.367376:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af5784136af lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784136b6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.367383:0:17237:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af5784136af lrc: 5/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af5784136b6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.367391:0:17237:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245c47200) 00000100:00100000:3.0:1786002502.367426:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6507:x1872758560874240:12345-0@lo:105: Request processed in 85us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.367431:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1786002502.367457:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6507:1872758560874240:0@lo:105: 00010000:00010000:3.0:1786002502.367625:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002502.367656:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34656a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530829056:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 556us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.367663:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1619 00000100:00100000:3.0:1786002502.369120:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560874368 00000100:00100000:3.0:1786002502.369126:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560874368 00000100:00100000:3.0:1786002502.369162:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3491 00000100:00100000:3.0:1786002502.369169:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6520:x1872758560874368:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786002502.369190:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002502.369204:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784136c4 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784136bd expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.369223:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784136c4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784136bd expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.369241:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af5784136c4 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784136bd expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002502.369249:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xe8fb0a82 (ffff9ed243ce3a00) 00010000:00010000:3.0:1786002502.369252:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002502.369255:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b000, rc 0) 00000100:00100000:3.0:1786002502.369287:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560874368:12345-0@lo:101:mdt00_000.0 Request processed in 118us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.369292:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3491 00000100:00100000:1.0:1786002502.369952:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560874368:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786002502.369975:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46c00/0x7cee4af5784136bd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784136c4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002502.369993:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46c00/0x7cee4af5784136bd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784136c4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002502.370010:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:1.0:1786002502.370043:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560874496:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1786002502.370074:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002502.370094:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.370623:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560874496 00000100:00100000:3.0:1786002502.370629:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560874496 00000100:00100000:3.0:1786002502.373835:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3492 00000100:00100000:3.0:1786002502.373863:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560874496:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002502.373999:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560874496:12345-0@lo:1000:mdt00_000.0 Request processed in 152us (3923us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.374007:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3492 00000100:00100000:1.0:1786002502.387267:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560874624 00000100:00100000:1.0:1786002502.387275:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560874624 00000100:00100000:1.0:1786002502.387359:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3493 00000100:00100000:1.0:1786002502.387370:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560874624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1786002502.387631:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560874624:12345-0@lo:1000:mdt00_000.0 Request processed in 263us (12536us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002502.387639:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3493 00000100:00100000:1.0:1786002502.399418:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560874752 00000100:00100000:1.0:1786002502.399428:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560874752 00000100:00100000:1.0:1786002502.399539:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3494 00000100:00100000:1.0:1786002502.399549:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560874752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1786002502.399648:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560874752:12345-0@lo:1000:mdt00_000.0 Request processed in 100us (351us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002502.399656:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3494 00000100:00100000:3.0:1786002502.406268:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560874880 00000100:00100000:3.0:1786002502.406282:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560874880 00000100:00100000:3.0:1786002502.406334:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3495 00000100:00100000:3.0:1786002502.406344:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560874880:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002502.407923:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560874880:12345-0@lo:1000:mdt00_000.0 Request processed in 1579us (8119us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.407932:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3495 00000100:00100000:3.0:1786002502.407952:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560875008 00000100:00100000:3.0:1786002502.407956:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560875008 00000100:00100000:3.0:1786002502.407973:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3496 00000100:00100000:3.0:1786002502.407978:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560875008:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002502.408156:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560875008:12345-0@lo:1000:mdt00_000.0 Request processed in 176us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.408163:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3496 00000100:00100000:2.0:1786002502.408199:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560875008:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786002502.408240:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560875136:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786002502.408268:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002502.408294:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002502.409981:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560875136 00000100:00100000:3.0:1786002502.409991:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560875136 00000100:00100000:3.0:1786002502.410034:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3497 00000100:00100000:3.0:1786002502.410044:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560875136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002502.410120:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560875136:12345-0@lo:1000:mdt00_000.0 Request processed in 78us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002502.410139:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3497 00000100:00100000:2.0:1786002502.410632:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560875136:0@lo:1000:mdt00_000.0 00080000:02000000:2.0:1786002502.411004:0:6520:0:(osd_handler.c:2218:osd_trans_start()) *** cfs_fail_loc=19a, val=0*** 00000004:00080000:2.0:1786002502.411019:0:6520:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed2456d8600 with version 0 00000020:00080000:2.0:1786002502.411025:0:6520:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2456d8b40 refcount 3 committed 0 result -5 batchid 396 00000020:00080000:2.0:1786002502.411029:0:6520:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2464bd200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result -5 sub_th ffff9ed2456d8600 00000020:00080000:2.0:1786002502.411032:0:6520:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2464bd700 obd lustre-MDT0000-osd committed 1 started 0 stopped 1 result 0 sub_th ffff9ed346084c00 00000004:00080000:2.0:1786002502.411058:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1786002502.411068:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af5784136af lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784136b6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.411079:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af5784136af lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784136b6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.411092:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c47200/0x7cee4af5784136af lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784136b6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.411107:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002502.411112:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1786002502.411116:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46c00/0x7cee4af5784136bd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784136c4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.411123:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46c00/0x7cee4af5784136bd lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784136c4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.411130:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c46c00/0x7cee4af5784136bd lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0xe8fb0a82 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784136c4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002502.411140:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786002502.411197:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:17745:x1872758530828928:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 49482us (49687us total) trans 0 rc -5/-5 00000100:00100000:2.0:1786002502.411204:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23691 00000020:00080000:3.0:1786002502.411809:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 393 00000100:00100000:1.0:1786002502.508345:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786002502.508365:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560875520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002502.508437:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002502.508884:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560875520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786002502.517926:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560875648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786002502.517995:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002502.518085:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560875648 00000100:00100000:1.0:1786002502.518093:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560875648 00000100:00100000:1.0:1786002502.518154:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1786002502.518164:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758560875648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002502.518186:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002502.518240:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758560875648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002502.518247:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00080000:3.0:1786002502.518329:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002502.518363:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560875648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002503.002384:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002503.002428:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002503.002462:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002503.002530:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530829184 00000100:00100000:3.0:1786002503.002540:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530829184 00000100:00100000:3.0:1786002503.002593:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 503 00000100:00100000:3.0:1786002503.002603:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758530829184:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002503.002674:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758530829184:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002503.002682:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 503 00000100:00080000:3.0:1786002503.003843:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786002503.003876:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002503.020123:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560875776 00000100:00100000:2.0:1786002503.020131:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560875776 00000100:00100000:2.0:1786002503.020185:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3498 00000100:00100000:2.0:1786002503.020195:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1872758560875776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786002503.020240:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444003840 avail 1297764352 00000100:00100000:2.0:1786002503.020286:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1872758560875776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002503.020294:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3498 00000100:00100000:2.0:1786002504.042001:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786002504.042022:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758560876160:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.042151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002504.042430:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560876288 00000100:00100000:1.0:1786002504.042438:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560876288 00000100:00100000:1.0:1786002504.042482:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3499 00000100:00100000:1.0:1786002504.042492:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1872758560876288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002504.043838:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560876160 00000100:00100000:3.0:1786002504.043844:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560876160 00000100:00100000:3.0:1786002504.043902:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1786002504.043910:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758560876160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.043983:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560875904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002504.044016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002504.044042:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758560876032:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.044069:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002504.044109:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560875904 00000100:00100000:2.0:1786002504.044113:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560875904 00000100:00100000:2.0:1786002504.044147:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1786002504.044155:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560875904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002504.044174:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1786002504.044209:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560875904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002504.044215:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1786002504.044238:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560876032 00000100:00100000:2.0:1786002504.044241:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560876032 00000100:00100000:2.0:1786002504.044264:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1786002504.044270:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758560876032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.044296:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758560876032:12345-0@lo:400:kworker.0 Request processed in 27us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002504.044302:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1786002504.044346:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560875904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002504.044357:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758560876032:0@lo:400:kworker.0 00000100:00080000:2.0:1786002504.044397:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002504.045548:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758560876800:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.045584:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002504.045621:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560876672:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.045641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002504.045668:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002504.045673:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758560876544:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.045691:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002504.045724:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786002504.045737:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758560876928:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.045781:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002504.045809:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560876800 00000100:00100000:2.0:1786002504.045813:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560876800 00000100:00100000:2.0:1786002504.045862:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560876544 00000100:00100000:2.0:1786002504.045865:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560876544 00000100:00100000:2.0:1786002504.045888:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560876928 00000100:00100000:2.0:1786002504.045891:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560876928 00000100:00100000:2.0:1786002504.045907:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:2.0:1786002504.045914:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758560876800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.045953:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758560876800:12345-0@lo:400:kworker.0 Request processed in 39us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002504.045959:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:2.0:1786002504.045972:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:2.0:1786002504.045978:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243c07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758560876544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046004:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243c07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758560876544:12345-0@lo:400:kworker.0 Request processed in 26us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002504.046009:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:2.0:1786002504.046021:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:2.0:1786002504.046027:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758560876928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046053:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758560876928:12345-0@lo:400:kworker.0 Request processed in 26us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002504.046057:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00080000:2.0:1786002504.046072:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786002504.046075:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002504.046097:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758560876928:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046106:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758560876800:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046132:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758560876544:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046140:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560876672:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046188:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758560877312:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002504.046229:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560877312 00000100:00100000:2.0:1786002504.046233:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560877312 00000100:00100000:2.0:1786002504.046256:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:2.0:1786002504.046262:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758560877312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046290:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758560877312:12345-0@lo:400:kworker.0 Request processed in 28us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002504.046295:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00080000:2.0:1786002504.046307:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002504.046322:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758560877312:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046339:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560877184:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046360:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002504.046377:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002504.046383:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560877056:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002504.046424:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560877184 00000100:00100000:2.0:1786002504.046428:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560877184 00000100:00100000:2.0:1786002504.046454:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560877056 00000100:00100000:2.0:1786002504.046457:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560877056 00000100:00100000:2.0:1786002504.046476:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1786002504.046483:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560877184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046515:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560877184:12345-0@lo:400:kworker.0 Request processed in 32us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002504.046521:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1786002504.046532:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1786002504.046538:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560877056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046564:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560877056:12345-0@lo:400:kworker.0 Request processed in 27us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002504.046569:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00080000:2.0:1786002504.046586:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002504.046601:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560877056:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046609:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560877184:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046637:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786002504.046643:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758560877440:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046664:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002504.046681:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560877440 00000100:00100000:2.0:1786002504.046684:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560877440 00000100:00100000:2.0:1786002504.046706:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:2.0:1786002504.046712:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758560877440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046743:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758560877440:12345-0@lo:400:kworker.0 Request processed in 31us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002504.046749:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00080000:2.0:1786002504.046763:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786002504.046776:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758560877440:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046808:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002504.046814:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560877568:0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046835:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002504.046910:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560877568 00000100:00100000:2.0:1786002504.046913:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560877568 00000100:00100000:2.0:1786002504.046933:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:2.0:1786002504.046939:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560877568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002504.046970:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560877568:12345-0@lo:400:kworker.0 Request processed in 31us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002504.046975:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00080000:2.0:1786002504.046987:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002504.047003:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560877568:0@lo:400:kworker.0 00000100:00100000:1.0:1786002504.047396:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3645:x1872758560876288:12345-0@lo:400:kworker.0 Request processed in 4904us (5204us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002504.047530:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3499 00000100:00100000:3.0:1786002504.047801:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758560876160:12345-0@lo:400:kworker.0 Request processed in 3892us (5650us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002504.047808:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:2.0:1786002504.052293:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758560876160:0@lo:400:kworker.0 00000100:00100000:1.0:1786002504.255159:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002504.255223:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530829696 00000100:00100000:2.0:1786002504.255232:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530829696 00000100:00100000:2.0:1786002504.255338:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23692 00000100:00100000:2.0:1786002504.255348:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:17764:x1872758530829696:12345-192.168.203.49@tcp:36:mkdir.0 00010000:00010000:2.0:1786002504.255397:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002504.255423:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578413424 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a5a4 expref: 13 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.255445:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed35363d100) 00010000:00010000:2.0:1786002504.255454:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002504.255509:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136cb lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.255522:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136cb lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.255531:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136cb lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.255542:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784136d2 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.255550:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784136d2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.255556:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784136d2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257112:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784136d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257126:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784136d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257135:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784136d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002504.257149:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ccadfb95 reply state 0000000074c99a9b transno 4294983476 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784136d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257163:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784136d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257169:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff9ed2434df100) 00010000:00010000:2.0:1786002504.257172:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002504.257174:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1786002504.257179:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1537:0x0]: returning size 4096 00010000:00010000:2.0:1786002504.257187:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136cb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257193:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136cb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257199:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136cb lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257205:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136cb lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257211:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002504.257215:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136cb lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257224:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136cb lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257232:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed2434dfe00) 00010000:00010000:2.0:1786002504.257234:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002504.257237:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136cb lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257247:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136cb lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002504.257260:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ccadfb95 reply state 0000000074c99a9b transno 4294983476 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784136d2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257269:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784136d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.257274:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff9ed2434dfd00) 00010000:00010000:2.0:1786002504.257277:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002504.257279:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1786002504.257349:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:17764:x1872758530829696:12345-192.168.203.49@tcp:36:mkdir.0 Request processed in 2001us (2195us total) trans 4294983476 rc 0/0 00000100:00100000:2.0:1786002504.257357:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23692 00000100:00100000:2.0:1786002504.300812:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530829824 00000100:00100000:2.0:1786002504.300822:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530829824 00000100:00100000:2.0:1786002504.300896:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23693 00000100:00100000:2.0:1786002504.300905:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:17765:x1872758530829824:12345-192.168.203.49@tcp:101:rmdir.0 00010000:00010000:2.0:1786002504.300927:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002504.300947:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136e0 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a630 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301004:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af5784136e7 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301016:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af5784136e7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301029:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af5784136e7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301040:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784136ee lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301047:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784136ee lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301053:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784136ee lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301118:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784136f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301126:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784136f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301132:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784136f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002504.301166:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1537:0x0]: returning size 4096 00000004:00200000:2.0:1786002504.301170:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786002504.301188:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784136f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301199:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af5784136e7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301205:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af5784136e7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301215:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af5784136e7 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301222:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af5784136e7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301228:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556ae00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002504.301232:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af5784136e7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301238:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af5784136e7 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301249:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed2434dfe00) 00010000:00010000:2.0:1786002504.301251:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002504.301255:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af5784136e7 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301261:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af5784136e7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301273:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784136ee lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301278:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784136ee lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301285:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784136ee lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301289:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002504.301291:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784136ee lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301296:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784136ee lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301302:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff9ed2434dfd00) 00010000:00010000:2.0:1786002504.301304:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002504.301307:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784136ee lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301311:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784136ee lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301346:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784136e0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a630 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301361:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784136f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1537:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a630 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002504.301368:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff9ed2434df100) 00010000:00010000:2.0:1786002504.301370:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786002504.301372:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556aa00, rc 0) 00000100:00100000:2.0:1786002504.301427:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:17765:x1872758530829824:12345-192.168.203.49@tcp:101:rmdir.0 Request processed in 523us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002504.301433:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23693 00000100:00100000:1.0:1786002504.309202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00010000:00010000:1.0:1786002504.619192:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786002505.419825:0:20594:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866e6 len=0 uarg=00007ffe48a13f50 00000004:00000080:2.0:1786002505.419843:0:20594:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=c00866e6 len=608 karg=ffff9ed37ba25400 uarg=0000000000000000 00000004:00000080:2.0:1786002505.420244:0:20594:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1744858fd70 00100000:10000000:2.0:1786002505.420249:0:20594:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:2.0:1786002505.421362:0:20594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb800 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000-mdtlov_UUID:20594:1872758560877696:0@lo:1101:lctl.0 00000100:00100000:2.0:1786002505.421432:0:20594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.421484:0:20594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8900 going to sleep for 11 seconds 00000100:00100000:1.0:1786002505.425125:0:20596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2d80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-MDT0001_UUID:20596:1872758560877824:0@lo:900:lfsck.0 00000100:00100000:1.0:1786002505.425174:0:20596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.425213:0:20596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.425294:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560877824 00000100:00100000:2.0:1786002505.425301:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560877824 00000100:00100000:2.0:1786002505.425334:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786002505.425343:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:20596:x1872758560877824:12345-0@lo:900:lfsck.0 00000100:00100000:2.0:1786002505.425402:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:20596:x1872758560877824:12345-0@lo:900:lfsck.0 Request processed in 60us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.425410:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786002505.425599:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2d80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-lwp-MDT0001_UUID:20596:1872758560877824:0@lo:900:lfsck.0 00000100:00100000:1.0:1786002505.425650:0:20596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2d80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560877952:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.425688:0:20596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.425711:0:20596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6240 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.425753:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560877952 00000100:00100000:2.0:1786002505.425757:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560877952 00000100:00100000:2.0:1786002505.425779:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3502 00000100:00100000:2.0:1786002505.425784:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:20596:x1872758560877952:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1786002505.425864:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:20596:x1872758560877952:12345-0@lo:1000:lfsck.0 Request processed in 57us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.425879:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3502 00000100:00100000:1.0:1786002505.426063:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2d80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560877952:0@lo:1000:lfsck.0 00000100:00100000:2.0:1786002505.426413:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560878080 00000100:00100000:2.0:1786002505.426417:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560878080 00000100:00100000:2.0:1786002505.426447:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3503 00000100:00100000:2.0:1786002505.426452:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:20596:x1872758560878080:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1786002505.426524:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:20596:x1872758560878080:12345-0@lo:1000:lfsck.0 Request processed in 71us (186us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002505.426531:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3503 00000100:00100000:1.0:1786002505.426672:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9c00 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560878080:0@lo:1000:lfsck.0 00010000:00010000:1.0:1786002505.426713:0:20596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578413711 lrc: 3/0,1 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.426722:0:20596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578413711 lrc: 3/0,1 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20596 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.426730:0:20596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578413711 lrc: 3/0,1 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20596 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002505.426740:0:20596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f3b80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560878208:0@lo:101:lfsck.0 00000100:00100000:1.0:1786002505.426762:0:20596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.426782:0:20596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.427403:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560878208 00000100:00100000:2.0:1786002505.427408:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560878208 00000100:00100000:2.0:1786002505.427439:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3504 00000100:00100000:2.0:1786002505.427446:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:20596:x1872758560878208:12345-0@lo:101:lfsck.0 00010000:00010000:2.0:1786002505.427457:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002505.427472:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af578413718 lrc: 2/0,0 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413711 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.427494:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af578413718 lrc: 3/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413711 expref: 8 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.427507:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ae00/0x7cee4af578413718 lrc: 3/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413711 expref: 8 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.427514:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff9ed2434dfe00) 00010000:00010000:2.0:1786002505.427517:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002505.427521:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556ae00, rc 0) 00000100:00100000:2.0:1786002505.427555:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20596:x1872758560878208:12345-0@lo:101:lfsck.0 Request processed in 110us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.427561:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3504 00000100:00100000:1.0:1786002505.428216:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f3b80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560878208:0@lo:101:lfsck.0 00010000:00010000:1.0:1786002505.428240:0:20596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578413711 lrc: 4/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413718 expref: -99 pid: 20596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.428253:0:20596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578413711 lrc: 4/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413718 expref: -99 pid: 20596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002505.428269:0:20596:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000002:0x3:0x0] 00010000:00010000:1.0:1786002505.428292:0:20596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af57841371f lrc: 3/0,1 mode: --/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.428299:0:20596:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af57841371f lrc: 3/0,1 mode: --/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20596 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.428305:0:20596:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af57841371f lrc: 3/0,1 mode: --/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20596 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002505.428318:0:20596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f3b80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560878336:0@lo:101:lfsck.0 00000100:00100000:1.0:1786002505.428347:0:20596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.428372:0:20596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.428946:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560878336 00000100:00100000:2.0:1786002505.428952:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560878336 00000100:00100000:2.0:1786002505.428989:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3505 00000100:00100000:2.0:1786002505.428997:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b583450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20596:x1872758560878336:12345-0@lo:101:lfsck.0 00010000:00010000:2.0:1786002505.429007:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002505.429018:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a000/0x7cee4af578413726 lrc: 2/0,0 mode: --/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841371f expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.429034:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a000/0x7cee4af578413726 lrc: 3/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841371f expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.429042:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a000/0x7cee4af578413726 lrc: 3/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841371f expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.429062:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x4649583 (ffff9ed2434df300) 00010000:00010000:2.0:1786002505.429064:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002505.429066:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a000, rc 0) 00000100:00100000:2.0:1786002505.429256:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b583450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20596:x1872758560878336:12345-0@lo:101:lfsck.0 Request processed in 259us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.429263:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3505 00000100:00100000:1.0:1786002505.429479:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f3b80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560878336:0@lo:101:lfsck.0 00010000:00010000:1.0:1786002505.429490:0:20596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af57841371f lrc: 4/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413726 expref: -99 pid: 20596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.429499:0:20596:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af57841371f lrc: 4/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413726 expref: -99 pid: 20596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002505.429514:0:20596:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000002:0x3:0x0] 00000100:00100000:1.0:1786002505.429538:0:20596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f3b80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560878464:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.429564:0:20596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.429581:0:20596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6240 going to sleep for 11 seconds 00000100:00100000:1.0:1786002505.429966:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f3b80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560878464:0@lo:1000:lfsck.0 00000004:00080000:1.0:1786002505.431210:0:20596:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245dc6240 with version 0 00000020:00100000:1.0:1786002505.431228:0:20596:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002505.431236:0:20596:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2467f3b80 x1872758560878720/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 400/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002505.431252:0:20596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f3b80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560878720:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.431284:0:20596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.431555:0:20596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6780 going to sleep for 11 seconds 00000001:00080000:3.0:1786002505.445238:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983478 is committed 00000001:00080000:3.0:1786002505.445268:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983477 is committed 00000020:00080000:3.0:1786002505.445277:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 394 batchid updated 00000020:00080000:3.0:1786002505.445295:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 394 00000004:00080000:3.0:1786002505.445355:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed2434d23c0 with version 746 00000020:00080000:3.0:1786002505.445365:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 394 cancel update log [0x240000401:0x3:0x0].389: rc = 0 00000020:00080000:3.0:1786002505.445429:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 394 cancel update log [0x200000400:0x3:0x0].390: rc = 0 00000020:00080000:3.0:1786002505.445438:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 394 00000004:00080000:3.0:1786002505.445446:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 746 rpc_version 746 00010000:00010000:1.0:1786002505.445469:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784136d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1786002505.445475:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1786002505.445480:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784136d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002505.445484:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244bb9f80 x1872758560878976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1786002505.445488:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784136d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445495:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002505.445499:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784136d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002505.445504:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560878976:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1786002505.445506:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784136d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445525:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff9ed2434dfd00) 00010000:00010000:1.0:1786002505.445528:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002505.445532:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784136d2 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445539:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af5784136d2 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445553:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784136d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445560:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784136d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445566:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784136d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445571:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556ac00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002505.445573:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784136d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445579:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784136d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445586:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1537:0x0].0x0 (ffff9ed2434df100) 00010000:00010000:1.0:1786002505.445589:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002505.445592:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784136d9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445598:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af5784136d9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1537:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445621:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413703 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445627:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413703 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445632:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413703 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445637:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002505.445639:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413703 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445644:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413703 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445652:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd04803f8 (ffff9ed2434dfd00) 00010000:00010000:1.0:1786002505.445654:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002505.445657:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413703 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.445662:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413703 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd04803f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002505.445808:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.445876:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.445945:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20596:x1872758560878720:12345-0@lo:1000:lfsck.0 Request processed in 5327us (14660us total) trans 4294983478 rc 0/0 00000100:00100000:1.0:1786002505.445953:0:15596:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 3 min 2 max 116 00000100:00100000:3.0:1786002505.445955:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3507 00000100:00100000:1.0:1786002505.445960:0:15596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_003' 00000004:00080000:2.0:1786002505.446208:0:20596:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983478 committed transno 4294983478 00000100:00100000:2.0:1786002505.446213:0:20596:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983478 gen 2 00000004:00080000:2.0:1786002505.446217:0:20596:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983475 committed transno 4294983478 00000100:00100000:2.0:1786002505.446239:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f3b80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560878720:0@lo:1000:lfsck.0 00010000:00010000:2.0:1786002505.446260:0:20596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af57841371f lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413726 expref: -99 pid: 20596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002505.446268:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560878976 00010000:00010000:2.0:1786002505.446269:0:20596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e400/0x7cee4af57841371f lrc: 2/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0x4649583 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413726 expref: -99 pid: 20596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002505.446273:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560878976 00010000:00010000:2.0:1786002505.446276:0:20596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578413711 lrc: 3/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413718 expref: -99 pid: 20596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.446281:0:20596:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e800/0x7cee4af578413711 lrc: 2/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413718 expref: -99 pid: 20596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002505.446298:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3508 00000100:00100000:3.0:1786002505.446305:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560878976:12345-0@lo:1000:osp_up1-0.0 00100000:10000000:2.0:1786002505.446305:0:20596:0:(lfsck_lib.c:2526:lfsck_start_assistant()) lustre-MDT0001-osd: start lfsck_namespace assistant thread 00000100:00100000:3.0:1786002505.446463:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560878976:12345-0@lo:1000:osp_up1-0.0 Request processed in 157us (654us total) trans 4294968460 rc 0/0 00000100:00100000:3.0:1786002505.446469:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3508 00000100:00100000:2.0:1786002505.446566:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560878976:0@lo:1000:osp_up1-0.0 00100000:10000000:1.0:1786002505.449595:0:20596:0:(lfsck_namespace.c:4580:lfsck_namespace_prep()) lustre-MDT0001-osd: namespace LFSCK prep done, start pos [1, [0x0:0x0:0x0], 0x0]: rc = 0 00100000:10000000:1.0:1786002505.451659:0:20596:0:(lfsck_namespace.c:4478:lfsck_namespace_checkpoint()) lustre-MDT0001-osd: namespace LFSCK checkpoint at the pos [13, [0x0:0x0:0x0], 0x0], status = 1: rc = 0 00100000:10000000:1.0:1786002505.451666:0:20596:0:(lfsck_engine.c:1034:lfsck_master_engine()) lustre-MDT0001-osd entry: oit_flags = 0x40003, dir_flags = 0x8006, oit_cookie = 13, dir_cookie = 0x0, parent = [0x0:0x0:0x0], pid = 20596 00000100:00100000:1.0:1786002505.452979:0:20594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb800 pname:cluuid:pid:xid:nid:opc:job lctl:lustre-MDT0000-mdtlov_UUID:20594:1872758560877696:0@lo:1101:lctl.0 00010000:00010000:1.0:1786002505.455224:0:20595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841372d lrc: 3/0,1 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455240:0:20595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841372d lrc: 3/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455250:0:20595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841372d lrc: 3/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455265:0:20595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578413734 lrc: 3/0,1 mode: --/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455272:0:20595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578413734 lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455277:0:20595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578413734 lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455556:0:20595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578413734 lrc: 3/0,1 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455564:0:20595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578413734 lrc: 2/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455570:0:20595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578413734 lrc: 3/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455576:0:20595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002505.455580:0:20595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578413734 lrc: 3/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455591:0:20595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578413734 lrc: 4/0,0 mode: PW/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455602:0:20595:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0xaaab9583 (ffff9ed35363dc00) 00010000:00010000:1.0:1786002505.455605:0:20595:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002505.455610:0:20595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578413734 lrc: 2/0,0 mode: --/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455616:0:20595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578413734 lrc: 0/0,0 mode: --/PW res: [0x200000002:0x3:0x0].0xaaab9583 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455632:0:20595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841372d lrc: 3/0,1 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455637:0:20595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841372d lrc: 2/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455642:0:20595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841372d lrc: 3/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455647:0:20595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fa00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002505.455649:0:20595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841372d lrc: 3/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455656:0:20595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841372d lrc: 4/0,0 mode: CW/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455662:0:20595:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x3:0x0].0x0 (ffff9ed2434dfe00) 00010000:00010000:1.0:1786002505.455665:0:20595:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002505.455667:0:20595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841372d lrc: 2/0,0 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.455676:0:20595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841372d lrc: 0/0,0 mode: --/CW res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20595 initiator: MDT0 lru_score: 0 lru_type: 0 00100000:10000000:1.0:1786002505.455695:0:20595:0:(lfsck_lib.c:2526:lfsck_start_assistant()) lustre-MDT0000-osd: start lfsck_namespace assistant thread 00100000:10000000:2.0:1786002505.458972:0:20599:0:(lfsck_engine.c:1551:lfsck_assistant_engine()) lustre-MDT0001-osd: lfsck_namespace LFSCK assistant thread start 00100000:10000000:1.0:1786002505.462639:0:20601:0:(lfsck_engine.c:1551:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_namespace LFSCK assistant thread start 00000100:00100000:1.0:1786002505.471030:0:20595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351f800 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20595:1872758560879232:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.472230:0:20595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.472279:0:20595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.472294:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560879104 00000100:00100000:3.0:1786002505.472302:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560879104 00000100:00100000:3.0:1786002505.472537:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3510 00000100:00100000:3.0:1786002505.472544:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20596:x1872758560879104:12345-0@lo:1000:lfsck.0 00000100:00100000:3.0:1786002505.472625:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20596:x1872758560879104:12345-0@lo:1000:lfsck.0 Request processed in 81us (17871us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.472631:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3510 00000100:00100000:1.0:1786002505.473291:0:20595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351f800 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20595:1872758560879232:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.473751:0:20595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351f800 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20595:1872758560879488:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.473776:0:20595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.473796:0:20595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790840 going to sleep for 11 seconds 00000100:00100000:1.0:1786002505.473810:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560879360 00000100:00100000:1.0:1786002505.473813:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560879360 00000100:00100000:1.0:1786002505.473833:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560879488 00000100:00100000:1.0:1786002505.473835:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560879488 00000100:00100000:1.0:1786002505.473958:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3511 00000100:00100000:1.0:1786002505.473968:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:20596:x1872758560879360:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.474020:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:20596:x1872758560879360:12345-0@lo:1000:lfsck.0 Request processed in 53us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.474568:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560879616:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.474597:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.474613:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.483975:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3512 00000100:00100000:3.0:1786002505.483999:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:20595:x1872758560879488:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.486519:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3511 00000100:00100000:1.0:1786002505.487150:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffbb80 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560879360:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.487827:0:20596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351e680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560879744:0@lo:1000:lfsck.0 00000100:00100000:2.0:1786002505.488461:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fbb80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560879872:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.503603:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:20595:x1872758560879488:12345-0@lo:1000:lfsck.0 Request processed in 19606us (29816us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.503622:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3512 00000100:00100000:3.0:1786002505.503657:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3513 00000100:00100000:3.0:1786002505.503669:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560879616:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.503757:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560879616:12345-0@lo:1000:lfsck_namespace.0 Request processed in 92us (29158us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.503763:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3513 00100000:10000000:3.0:1786002505.504125:0:20597:0:(scrub.c:368:scrub_thread_post()) lustre-MDT0001: OI scrub post with result = 1 00100000:10000000:3.0:1786002505.504159:0:20597:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1786002505.504161:0:20597:0:(osd_scrub.c:1303:osd_scrub_main()) lustre-MDT0001: OI scrub: stop, pos = 1024001: rc = 1 00000100:00100000:2.0:1786002505.506732:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560879616:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1786002505.517064:0:20595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351f800 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20595:1872758560879488:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.517601:0:20595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351f800 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0000-mdtlov_UUID:20595:1872758560880128:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.517658:0:20595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.517715:0:20595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002505.517743:0:20596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.517775:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560880128 00000100:00100000:1.0:1786002505.517781:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560880128 00000100:00100000:1.0:1786002505.517813:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560879744 00000100:00100000:1.0:1786002505.517815:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560879744 00000100:00100000:1.0:1786002505.517830:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3514 00000100:00100000:1.0:1786002505.517837:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20595:x1872758560880128:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.518560:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20595:x1872758560880128:12345-0@lo:1000:lfsck.0 Request processed in 722us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002505.518567:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3514 00000100:00100000:1.0:1786002505.518587:0:20596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002505.518603:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351e680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560879744:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.518656:0:20596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560880256:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.518679:0:20596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.518700:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560880256 00000100:00100000:1.0:1786002505.518703:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560880256 00000100:00100000:1.0:1786002505.518723:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3516 00000100:00100000:1.0:1786002505.518729:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20596:x1872758560880256:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.518777:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20596:x1872758560880256:12345-0@lo:1000:lfsck.0 Request processed in 48us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002505.518783:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3516 00000100:00100000:1.0:1786002505.518800:0:20596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002505.518810:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560880256:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.520269:0:20596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560880384:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.520298:0:20596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.520327:0:20596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.521726:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560880000:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.521769:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.521793:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.521819:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.521830:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002505.521989:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560880384 00000100:00100000:1.0:1786002505.521995:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560880384 00000100:00100000:1.0:1786002505.522036:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560880000 00000100:00100000:1.0:1786002505.522039:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560880000 00000100:00100000:2.0:1786002505.522720:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560879872 00000100:00100000:2.0:1786002505.522725:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560879872 00000100:00100000:2.0:1786002505.522749:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3517 00000100:00100000:2.0:1786002505.522757:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20596:x1872758560880384:12345-0@lo:1000:lfsck.0 00000100:00100000:2.0:1786002505.522840:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:20596:x1872758560880384:12345-0@lo:1000:lfsck.0 Request processed in 83us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.522866:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3517 00000100:00100000:2.0:1786002505.522891:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3518 00000100:00100000:2.0:1786002505.522898:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20599:x1872758560879872:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.522961:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:20599:x1872758560879872:12345-0@lo:1000:lfsck_namespace.0 Request processed in 63us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002505.523034:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3519 00000100:00100000:1.0:1786002505.523259:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560880000:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1786002505.523314:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560880000:12345-0@lo:1000:lfsck_namespace.0 Request processed in 273us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.534896:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3518 00000100:00100000:2.0:1786002505.534939:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560880000:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.537458:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560880640:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.537706:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.537745:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.537770:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560880640 00000100:00100000:2.0:1786002505.537776:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560880640 00000100:00100000:2.0:1786002505.537807:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3520 00000100:00100000:2.0:1786002505.537815:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:20601:x1872758560880640:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.537921:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:20601:x1872758560880640:12345-0@lo:1000:lfsck_namespace.0 Request processed in 106us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.537928:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3520 00000100:00100000:2.0:1786002505.537962:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560880640:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.538383:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560880768:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.539069:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.539096:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.539195:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560880768 00000100:00100000:2.0:1786002505.539200:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560880768 00000100:00100000:2.0:1786002505.539281:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3521 00000100:00100000:2.0:1786002505.539290:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:20601:x1872758560880768:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.539778:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:20601:x1872758560880768:12345-0@lo:1000:lfsck_namespace.0 Request processed in 488us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.539785:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3521 00000100:00100000:2.0:1786002505.539817:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560880768:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.539898:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560880896:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.539923:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.539938:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.539951:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560880896 00000100:00100000:2.0:1786002505.539954:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560880896 00000100:00100000:2.0:1786002505.541895:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3522 00000100:00100000:2.0:1786002505.541913:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:20601:x1872758560880896:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.544106:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:20601:x1872758560880896:12345-0@lo:1000:lfsck_namespace.0 Request processed in 2196us (4175us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.544118:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3522 00000100:00100000:2.0:1786002505.544177:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560880896:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1786002505.545055:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3519 00000100:00100000:1.0:1786002505.545124:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560880384:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.545194:0:20596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560881024:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.545237:0:20596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.545719:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560881152:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1786002505.552747:0:20596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.555989:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fbb80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560879872:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.556069:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560881280:0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1786002505.561616:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560881024:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.566062:0:20596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560881664:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.566193:0:20596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.566237:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560881664 00000100:00100000:1.0:1786002505.566243:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560881664 00000100:00100000:1.0:1786002505.566286:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3527 00000100:00100000:1.0:1786002505.566294:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20596:x1872758560881664:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.566414:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20596:x1872758560881664:12345-0@lo:1000:lfsck.0 Request processed in 120us (219us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002505.566421:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3527 00000100:00100000:1.0:1786002505.566459:0:20596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002505.566530:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560881664:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.567701:0:20596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560881792:0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.567738:0:20596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.567761:0:20596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed35a4ada80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.567999:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.568020:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d840 going to sleep for 11 seconds 00000100:00100000:1.0:1786002505.574779:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560881792 00000100:00100000:1.0:1786002505.574793:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560881792 00000100:00100000:1.0:1786002505.574839:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560881280 00000100:00100000:1.0:1786002505.574843:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560881280 00000100:00100000:1.0:1786002505.575526:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3528 00000100:00100000:1.0:1786002505.575536:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:20596:x1872758560881792:12345-0@lo:1000:lfsck.0 00000100:00100000:1.0:1786002505.575671:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:20596:x1872758560881792:12345-0@lo:1000:lfsck.0 Request processed in 135us (7931us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002505.575678:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3528 00000100:00100000:1.0:1786002505.575694:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3529 00000100:00100000:1.0:1786002505.575700:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20599:x1872758560881280:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1786002505.578487:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20599:x1872758560881280:12345-0@lo:1000:lfsck_namespace.0 Request processed in 2786us (10486us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002505.578494:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3529 00000100:00100000:2.0:1786002505.580073:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.580114:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.580252:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560881280:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1786002505.580345:0:20599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841373b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.580361:0:20599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841373b lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.580374:0:20599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841373b lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.580388:0:20599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b400/0x7cee4af578413742 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.580395:0:20599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b400/0x7cee4af578413742 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.580402:0:20599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b400/0x7cee4af578413742 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.580416:0:20599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af578413749 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.580423:0:20599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af578413749 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.580429:0:20599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af578413749 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.580455:0:20599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a600/0x7cee4af578413750 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.580463:0:20599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a600/0x7cee4af578413750 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.580488:0:20599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a600/0x7cee4af578413750 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002505.580505:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560882304:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1786002505.580549:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.580566:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002505.580788:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560881152 00000100:00100000:1.0:1786002505.580795:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560881152 00000100:00100000:1.0:1786002505.580823:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560882304 00000100:00100000:1.0:1786002505.580825:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560882304 00000100:00100000:1.0:1786002505.580837:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3532 00000100:00100000:1.0:1786002505.580875:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560881152:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1786002505.581026:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560881152:12345-0@lo:1000:lfsck_namespace.0 Request processed in 181us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002505.581034:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3532 00000100:00100000:1.0:1786002505.581048:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3533 00000100:00100000:1.0:1786002505.581055:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:20599:x1872758560882304:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:1.0:1786002505.581064:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002505.581078:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413757 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413750 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002505.581097:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560882176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002505.581125:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.581166:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560882176 00000100:00100000:2.0:1786002505.581169:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560882176 00000100:00100000:2.0:1786002505.581188:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3534 00000100:00100000:2.0:1786002505.581193:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3647:x1872758560882176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786002505.582286:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444995072 avail 1298755584 00000100:00100000:2.0:1786002505.582390:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3647:x1872758560882176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1195us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.582458:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3534 00000100:00100000:2.0:1786002505.582498:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560882176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002505.582525:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560881152:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.582572:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560882560:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.582594:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.582608:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.582619:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560882560 00000100:00100000:2.0:1786002505.582622:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560882560 00000100:00100000:2.0:1786002505.582640:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3536 00000100:00100000:2.0:1786002505.582646:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560882560:12345-0@lo:1000:lfsck_namespace.0 00010000:00010000:1.0:1786002505.582842:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413757 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413750 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.582985:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413757 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413750 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.582994:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed35363dc00) 00010000:00010000:1.0:1786002505.582997:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 23 00010000:00010000:1.0:1786002505.583000:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fa00, rc 0) 00000100:00100000:1.0:1786002505.583030:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:20599:x1872758560882304:12345-0@lo:101:lfsck_namespace.0 Request processed in 1975us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002505.583036:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3533 00000100:00100000:1.0:1786002505.583162:0:20596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job lfsck:lustre-MDT0001-mdtlov_UUID:20596:1872758560881792:0@lo:1000:lfsck.0 00000100:00100000:2.0:1786002505.584797:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560882560:12345-0@lo:1000:lfsck_namespace.0 Request processed in 2151us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.584804:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3536 00000100:00100000:2.0:1786002505.584841:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560882560:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.584917:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560882944:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.584940:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.584954:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00100000:10000000:1.0:1786002505.585600:0:20596:0:(lfsck_engine.c:1053:lfsck_master_engine()) lustre-MDT0001-osd ffff9ed245c98000 exit: oit_flags = 0x40003, dir_flags = 0x8006, oit_cookie = 512135, dir_cookie = 0x6b568b6cf14aa3c3, parent = [0x240000400:0xcb:0x0], pid = 20596: rc = 1 00100000:10000000:1.0:1786002505.585612:0:20596:0:(lfsck_lib.c:2594:lfsck_post_generic()) lustre-MDT0001-osd: waiting for assistant to do lfsck_namespace post, rc = 1 00000100:00100000:2.0:1786002505.585713:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560882944 00000100:00100000:2.0:1786002505.585719:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560882944 00000100:00100000:2.0:1786002505.590591:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3538 00000100:00100000:2.0:1786002505.590609:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560882944:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.591454:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560882944:12345-0@lo:1000:lfsck_namespace.0 Request processed in 791us (6450us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.591463:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3538 00000100:00100000:2.0:1786002505.591898:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560882944:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.592274:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560883328:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.603452:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560883456 00000100:00100000:2.0:1786002505.603465:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560883456 00000100:00100000:2.0:1786002505.603500:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.603552:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.603595:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560883328 00000100:00100000:2.0:1786002505.603599:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560883328 00000100:00100000:2.0:1786002505.603614:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3541 00000100:00100000:2.0:1786002505.603622:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560883456:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.603744:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560883456:12345-0@lo:1000:lfsck_namespace.0 Request processed in 121us (11443us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.603751:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3541 00000100:00100000:2.0:1786002505.603767:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3542 00000100:00100000:2.0:1786002505.603773:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560883328:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.603822:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560883328:12345-0@lo:1000:lfsck_namespace.0 Request processed in 48us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.603828:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3542 00000100:00100000:2.0:1786002505.603886:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560883328:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.604305:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560883584:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.604452:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.604465:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.604483:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560883584 00000100:00100000:2.0:1786002505.604487:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560883584 00000100:00100000:2.0:1786002505.604508:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3543 00000100:00100000:2.0:1786002505.604703:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560883584:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.604831:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560883584:12345-0@lo:1000:lfsck_namespace.0 Request processed in 317us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.604838:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3543 00000100:00100000:2.0:1786002505.604898:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560883584:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.604950:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f1f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560883712:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.605038:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.605065:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.605079:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560883712 00000100:00100000:2.0:1786002505.605082:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560883712 00000100:00100000:2.0:1786002505.605105:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3544 00000100:00100000:2.0:1786002505.605110:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560883712:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.605174:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560883712:12345-0@lo:1000:lfsck_namespace.0 Request processed in 63us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.605181:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3544 00000100:00100000:2.0:1786002505.605251:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f1f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560883712:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.605749:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f1f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560884096:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.605772:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.605792:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.605809:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3547 00000100:00100000:2.0:1786002505.605816:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560884096:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.605914:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560884096:12345-0@lo:1000:lfsck_namespace.0 Request processed in 98us (140us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002505.607186:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.607206:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed34bb3cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.609000:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560884224 00000100:00100000:3.0:1786002505.609010:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560884224 00000100:00100000:2.0:1786002505.612772:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3547 00000100:00100000:2.0:1786002505.612865:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f1f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560884096:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.613503:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f1f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560884352:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.613573:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.613612:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.613629:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560884352 00000100:00100000:2.0:1786002505.613635:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560884352 00000100:00100000:2.0:1786002505.613684:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3548 00000100:00100000:2.0:1786002505.613695:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560884352:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.613799:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560884352:12345-0@lo:1000:lfsck_namespace.0 Request processed in 106us (226us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002505.613806:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3548 00000100:00100000:2.0:1786002505.613830:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f1f80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560884352:0@lo:1000:lfsck_namespace.0 00010000:00010000:2.0:1786002505.613951:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841375e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x148b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.613977:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841375e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.613989:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841375e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614004:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413765 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x148b:0x0].0x93b3a2ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614011:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413765 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x148b:0x0].0x93b3a2ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614018:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413765 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x148b:0x0].0x93b3a2ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614037:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413765 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x148b:0x0].0x93b3a2ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614044:0:20601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413765 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x148b:0x0].0x93b3a2ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614051:0:20601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413765 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x148b:0x0].0x93b3a2ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614058:0:20601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002505.614062:0:20601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413765 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x148b:0x0].0x93b3a2ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614068:0:20601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413765 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x148b:0x0].0x93b3a2ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614079:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x148b:0x0].0x93b3a2ec (ffff9ed2434df600) 00010000:00010000:2.0:1786002505.614083:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002505.614087:0:20601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413765 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x148b:0x0].0x93b3a2ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614093:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578413765 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x148b:0x0].0x93b3a2ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614108:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841375e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614114:0:20601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841375e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614120:0:20601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841375e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614126:0:20601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002505.614129:0:20601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841375e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614135:0:20601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841375e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614147:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x148b:0x0].0x0 (ffff9ed2434df800) 00010000:00010000:2.0:1786002505.614149:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002505.614152:0:20601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841375e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.614157:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841375e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00100000:10000000:2.0:1786002505.614168:0:20601:0:(lfsck_namespace.c:5575:lfsck_namespace_repair_dangling()) lustre-MDT0000-osd: namespace LFSCK assistant found dangling reference for: parent [0x200000402:0x148b:0x0], child [0x240000401:0x82:0x0], type 16877, name [0x240000401:0x82:0x0]:1. Create the lost MDT-object as required: rc = 2 00100000:10000000:2.0:1786002505.614175:0:20601:0:(lfsck_striped_dir.c:2252:lfsck_namespace_striped_dir_rescan()) lustre-MDT0000-osd: namespace LFSCK repair the shard 1 [0x240000401:0x82:0x0] of the striped directory [0x200000402:0x148b:0x0] with dangling yes/yes, rename no/no, llinkea no/no, repair_lmvea no/no: rc = 2 00000100:00100000:2.0:1786002505.614264:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560884480:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.614288:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.614317:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.614330:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560884480 00000100:00100000:2.0:1786002505.614333:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560884480 00000100:00100000:2.0:1786002505.614350:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3549 00000100:00100000:2.0:1786002505.614356:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560884480:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.614408:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560884480:12345-0@lo:1000:lfsck_namespace.0 Request processed in 51us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.614414:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3549 00000100:00100000:2.0:1786002505.614434:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560884480:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.614487:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560884608:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.614509:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.614519:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.614530:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560884608 00000100:00100000:2.0:1786002505.614534:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560884608 00000100:00100000:2.0:1786002505.614549:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3550 00000100:00100000:2.0:1786002505.614554:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560884608:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.614610:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560884608:12345-0@lo:1000:lfsck_namespace.0 Request processed in 55us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.614617:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3550 00000100:00100000:2.0:1786002505.614637:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560884608:0@lo:1000:lfsck_namespace.0 00100000:10000000:2.0:1786002505.614694:0:20601:0:(lfsck_engine.c:1612:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_namespace LFSCK assistant thread post 00000100:00100000:2.0:1786002505.614711:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560884736:0@lo:1101:lfsck_namespace.0 00000100:00100000:2.0:1786002505.614733:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.614754:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.614765:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560884736 00000100:00100000:2.0:1786002505.614769:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560884736 00000100:00100000:2.0:1786002505.614785:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3551 00000100:00100000:2.0:1786002505.614791:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560884736:12345-0@lo:1101:lfsck_namespace.0 00100000:10000000:2.0:1786002505.614805:0:6525:0:(lfsck_namespace.c:5114:lfsck_namespace_in_notify()) lustre-MDT0001-osd: namespace LFSCK handles notify 3 from MDT 0, status 1, flags 0 00000100:00100000:2.0:1786002505.614836:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560884736:12345-0@lo:1101:lfsck_namespace.0 Request processed in 45us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.614842:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3551 00000100:00100000:2.0:1786002505.614894:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560884736:0@lo:1101:lfsck_namespace.0 00100000:10000000:2.0:1786002505.614902:0:20601:0:(lfsck_engine.c:1626:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant notified others for lfsck_namespace post: rc = 0 00000100:00100000:3.0:1786002505.614979:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3552 00000100:00100000:3.0:1786002505.614988:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560884224:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.615045:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560884224:12345-0@lo:1000:lfsck_namespace.0 Request processed in 59us (7861us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.615064:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3552 00000100:00100000:3.0:1786002505.617128:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffaa00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560884224:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.617265:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560884864:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.617309:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.617344:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.617362:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560884864 00000100:00100000:3.0:1786002505.617366:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560884864 00000100:00100000:3.0:1786002505.617397:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3553 00000100:00100000:3.0:1786002505.617405:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560884864:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.617477:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560884864:12345-0@lo:1000:lfsck_namespace.0 Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.617484:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3553 00000100:00100000:3.0:1786002505.617515:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560884864:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.617578:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560884992:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.617602:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.617615:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.617626:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560884992 00000100:00100000:3.0:1786002505.617629:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560884992 00000100:00100000:3.0:1786002505.617646:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3554 00000100:00100000:3.0:1786002505.617651:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560884992:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.617698:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560884992:12345-0@lo:1000:lfsck_namespace.0 Request processed in 46us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.617705:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3554 00000100:00100000:3.0:1786002505.617728:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560884992:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.617785:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885120:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.617808:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.617821:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.617832:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560885120 00000100:00100000:3.0:1786002505.617835:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560885120 00000100:00100000:3.0:1786002505.617894:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3555 00000100:00100000:3.0:1786002505.617900:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885120:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.617965:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885120:12345-0@lo:1000:lfsck_namespace.0 Request processed in 65us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.617971:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3555 00000100:00100000:3.0:1786002505.617995:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885120:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.618037:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885248:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.618059:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.618077:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.618087:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560885248 00000100:00100000:3.0:1786002505.618090:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560885248 00000100:00100000:3.0:1786002505.618107:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3556 00000100:00100000:3.0:1786002505.618112:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885248:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.618156:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885248:12345-0@lo:1000:lfsck_namespace.0 Request processed in 43us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.618162:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3556 00000100:00100000:3.0:1786002505.618184:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885248:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.618259:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885376:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.618281:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.618294:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.618304:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560885376 00000100:00100000:3.0:1786002505.618307:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560885376 00000100:00100000:3.0:1786002505.618323:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3557 00000100:00100000:3.0:1786002505.618328:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885376:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.618400:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885376:12345-0@lo:1000:lfsck_namespace.0 Request processed in 71us (117us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002505.618407:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3557 00000100:00100000:3.0:1786002505.618431:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885376:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.618508:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885504:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.618530:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.618545:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.618556:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560885504 00000100:00100000:3.0:1786002505.618558:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560885504 00000100:00100000:3.0:1786002505.618574:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3558 00000100:00100000:3.0:1786002505.618578:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885504:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.618632:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885504:12345-0@lo:1000:lfsck_namespace.0 Request processed in 52us (100us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002505.618637:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3558 00000100:00100000:3.0:1786002505.618659:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885504:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1786002505.618743:0:20599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841376c lrc: 3/0,1 mode: --/CW res: [0x240000402:0x104:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618758:0:20599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841376c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618769:0:20599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841376c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618780:0:20599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af578413773 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x104:0x0].0x94915003 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618786:0:20599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af578413773 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x104:0x0].0x94915003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618791:0:20599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af578413773 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x104:0x0].0x94915003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618800:0:20599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af578413773 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x104:0x0].0x94915003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618806:0:20599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af578413773 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x104:0x0].0x94915003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618812:0:20599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af578413773 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x104:0x0].0x94915003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618817:0:20599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002505.618821:0:20599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af578413773 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x104:0x0].0x94915003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618827:0:20599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af578413773 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x104:0x0].0x94915003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618836:0:20599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x104:0x0].0x94915003 (ffff9ed24206a500) 00010000:00010000:3.0:1786002505.618840:0:20599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002505.618844:0:20599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af578413773 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x104:0x0].0x94915003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618881:0:20599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af578413773 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x104:0x0].0x94915003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618897:0:20599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841376c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618903:0:20599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841376c lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618908:0:20599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841376c lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618912:0:20599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002505.618914:0:20599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841376c lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618919:0:20599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841376c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618925:0:20599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x104:0x0].0x0 (ffff9ed24206ad00) 00010000:00010000:3.0:1786002505.618927:0:20599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002505.618929:0:20599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841376c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.618934:0:20599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af57841376c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00100000:10000000:3.0:1786002505.618943:0:20599:0:(lfsck_namespace.c:5575:lfsck_namespace_repair_dangling()) lustre-MDT0001-osd: namespace LFSCK assistant found dangling reference for: parent [0x240000402:0x104:0x0], child [0x200000401:0x86:0x0], type 16877, name [0x200000401:0x86:0x0]:1. Create the lost MDT-object as required: rc = -19 00100000:10000000:3.0:1786002505.618949:0:20599:0:(lfsck_striped_dir.c:2252:lfsck_namespace_striped_dir_rescan()) lustre-MDT0001-osd: namespace LFSCK repair the shard 1 [0x200000401:0x86:0x0] of the striped directory [0x240000402:0x104:0x0] with dangling yes/no, rename no/no, llinkea no/no, repair_lmvea no/no: rc = -19 00000100:00100000:3.0:1786002505.619011:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be7480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885632:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.619036:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.619056:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.619067:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560885632 00000100:00100000:3.0:1786002505.619070:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560885632 00000100:00100000:3.0:1786002505.619085:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3559 00000100:00100000:3.0:1786002505.619090:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885632:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.619152:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885632:12345-0@lo:1000:lfsck_namespace.0 Request processed in 60us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.619158:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3559 00000100:00100000:3.0:1786002505.619182:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be7480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885632:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.619234:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be7480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885760:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.619257:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.619269:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.619280:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560885760 00000100:00100000:3.0:1786002505.619283:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560885760 00000100:00100000:3.0:1786002505.619298:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3560 00000100:00100000:3.0:1786002505.619303:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885760:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.619348:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885760:12345-0@lo:1000:lfsck_namespace.0 Request processed in 44us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.619354:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3560 00000100:00100000:3.0:1786002505.619376:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be7480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885760:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.619427:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be7480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885888:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.619448:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.619460:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.619470:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560885888 00000100:00100000:3.0:1786002505.619474:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560885888 00000100:00100000:3.0:1786002505.619491:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3561 00000100:00100000:3.0:1786002505.619496:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885888:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.619544:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560885888:12345-0@lo:1000:lfsck_namespace.0 Request processed in 47us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.619550:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3561 00000100:00100000:3.0:1786002505.619573:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be7480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560885888:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.624592:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be7480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560886016:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.624674:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.624718:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.624739:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560886016 00000100:00100000:3.0:1786002505.624745:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560886016 00000100:00100000:3.0:1786002505.624790:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3562 00000100:00100000:3.0:1786002505.624799:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560886016:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.625203:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560886016:12345-0@lo:1000:lfsck_namespace.0 Request processed in 404us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.625211:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3562 00000100:00100000:3.0:1786002505.625252:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be7480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560886016:0@lo:1000:lfsck_namespace.0 00100000:10000000:2.0:1786002505.625293:0:20601:0:(lfsck_engine.c:1644:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant sync before the second-stage scaning 00000100:00100000:3.0:1786002505.625351:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560886144:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.625374:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1786002505.625461:0:20601:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865806612439ns, next at 710286181700ns, rc = 0 00080000:00080000:2.0:1786002505.625474:0:20601:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1786002505.625498:0:20601:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 865806650130ns, next at 686041981081ns, rc = 0 00080000:00080000:2.0:1786002505.625503:0:20601:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1786002505.626469:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560886144 00000100:00100000:2.0:1786002505.626476:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560886144 00000100:00100000:3.0:1786002505.635020:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.636444:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3563 00000100:00100000:2.0:1786002505.636463:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560886144:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.637169:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560886144:12345-0@lo:1000:lfsck_namespace.0 Request processed in 713us (11792us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002505.637177:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3563 00000100:00100000:2.0:1786002505.637893:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560886272 00000100:00100000:2.0:1786002505.637899:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560886272 00000100:00100000:2.0:1786002505.637934:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3564 00000100:00100000:2.0:1786002505.637941:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560886272:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.638026:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560886272:12345-0@lo:1000:lfsck_namespace.0 Request processed in 85us (236us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002505.638033:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3564 00000004:00080000:3.0:1786002505.640279:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 86 committed 00000004:00080000:3.0:1786002505.640298:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 89 committed 00000001:00080000:3.0:1786002505.640310:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983479 is committed 00100000:10000000:3.0:1786002505.640343:0:20601:0:(lfsck_engine.c:1651:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant phase2 scan start, synced: rc = 0 00100000:10000000:3.0:1786002505.640354:0:20601:0:(lfsck_namespace.c:6700:lfsck_namespace_assistant_handler_p2()) lustre-MDT0000-osd: namespace LFSCK phase2 scan start 00100000:10000000:3.0:1786002505.640412:0:20601:0:(lfsck_namespace.c:6325:lfsck_namespace_scan_local_lpf()) lustre-MDT0000-osd: start to scan backend /lost+found 00100000:10000000:3.0:1786002505.640439:0:20601:0:(lfsck_namespace.c:6428:lfsck_namespace_scan_local_lpf()) lustre-MDT0000-osd: stop to scan backend /lost+found: rc = 1 00100000:10000000:2.0:1786002505.641456:0:20596:0:(lfsck_lib.c:2630:lfsck_double_scan_generic()) lustre-MDT0001-osd: the assistant has done lfsck_namespace double_scan, status 0 00000100:00100000:3.0:1786002505.644188:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560886528:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.644255:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.644292:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d840 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.650978:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560886528:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.651322:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560886656:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.651447:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.651500:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d840 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.651801:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f4e00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560886656:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.651950:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448ff100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560886784:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.651974:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.651996:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d840 going to sleep for 11 seconds 00010000:00010000:2.0:1786002505.652081:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002505.652358:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560886784 00000100:00100000:3.0:1786002505.652362:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560886784 00000100:00100000:3.0:1786002505.652394:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3568 00000100:00100000:3.0:1786002505.652401:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560886784:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.653317:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560886784:12345-0@lo:1000:lfsck_namespace.0 Request processed in 914us (1339us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002505.653325:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3568 00000100:00100000:3.0:1786002505.653361:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448ff100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560886784:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1786002505.653398:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413788 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.653414:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413788 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.653425:0:20601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413788 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002505.653561:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000004:00080000:2.0:1786002505.653575:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000001:00080000:2.0:1786002505.653611:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968460 is committed 00000001:00080000:2.0:1786002505.653628:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968459 is committed 00000020:00080000:2.0:1786002505.653632:0:7451:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed245e3de40 refcount 2 committed 0 result 0 batchid 397 00000020:00080000:2.0:1786002505.653635:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245e3d480 00000020:00080000:2.0:1786002505.653639:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].393 00000020:00080000:2.0:1786002505.653641:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed346084e00 00000020:00080000:2.0:1786002505.653644:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].394 00000020:00080000:2.0:1786002505.653664:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 395 batchid updated 00000020:00080000:2.0:1786002505.653672:0:7451:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed243460000 refcount 2 committed 0 result 0 batchid 396 00000020:00080000:2.0:1786002505.653674:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245747a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed243460240 00000020:00080000:2.0:1786002505.653676:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].392 00000020:00080000:2.0:1786002505.653678:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245747400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244a61e00 00000020:00080000:2.0:1786002505.653681:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].393 00000100:00100000:3.0:1786002505.654318:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448ff100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560886912:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.654360:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.654389:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d840 going to sleep for 11 seconds 00000020:00080000:3.0:1786002505.654406:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 397 committed batchid 395 00000004:00080000:3.0:1786002505.655374:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed366d7d180 with version 752 00000020:00080000:3.0:1786002505.655390:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 395 cancel update log [0x200000401:0x3:0x0].391: rc = 0 00000020:00080000:3.0:1786002505.655441:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 395 cancel update log [0x240000400:0x3:0x0].392: rc = 0 00000020:00080000:3.0:1786002505.655450:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 395 00000004:00080000:3.0:1786002505.655460:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 752 rpc_version 752 00000020:00100000:3.0:1786002505.655600:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002505.655607:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2448ff800 x1872758560887168/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002505.655625:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448ff800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560887168:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002505.655659:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.655674:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.655698:0:20601:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968460 gen 2 00000004:00080000:3.0:1786002505.655704:0:20601:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968455 committed transno 4294968460 00000020:00080000:3.0:1786002505.655708:0:20601:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed242216300 refcount 2 committed 0 result 0 batchid 395 00000020:00080000:3.0:1786002505.655712:0:20601:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245747d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed242216240 00000020:00080000:3.0:1786002505.655715:0:20601:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].390 00000020:00080000:3.0:1786002505.655717:0:20601:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245747300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244a60400 00000020:00080000:3.0:1786002505.655720:0:20601:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].391 00000004:00080000:3.0:1786002505.655741:0:20601:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968457 committed transno 4294968460 00000004:00080000:3.0:1786002505.655751:0:20601:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968458 committed transno 4294968460 00000004:00080000:3.0:1786002505.655788:0:20601:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968460 committed transno 4294968460 00000100:00100000:3.0:1786002505.655802:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448ff100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560886912:0@lo:1000:lfsck_namespace.0 00010000:00010000:3.0:1786002505.655819:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413788 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.655828:0:20601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413788 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.655836:0:20601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413788 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.655843:0:20601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002505.656700:0:20601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413788 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.656709:0:20601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413788 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.656720:0:20601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x148b:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:3.0:1786002505.656722:0:20601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1786002505.656726:0:20601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413788 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.656731:0:20601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413788 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.656792:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.656800:0:20601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.656810:0:20601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002505.656824:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448ff100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560887296:0@lo:101:lfsck_namespace.0 00000100:00100000:3.0:1786002505.656898:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.656923:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed35a4ad3c0 going to sleep for 11 seconds 00000020:00080000:3.0:1786002505.656936:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 396 committed batchid 394 00000020:00080000:3.0:1786002505.656964:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 394 00000100:00100000:3.0:1786002505.656978:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560887296 00000100:00100000:3.0:1786002505.656982:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560887296 00000100:00100000:3.0:1786002505.657008:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3571 00000100:00100000:3.0:1786002505.657015:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:20601:x1872758560887296:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1786002505.657026:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002505.657040:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578413796 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841378f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.657075:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578413796 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841378f expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002505.659101:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560887808 00000100:00100000:2.0:1786002505.659107:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560887808 00000100:00100000:2.0:1786002505.659131:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3575 00000100:00100000:2.0:1786002505.659139:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560887808:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.659200:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:20599:x1872758560887808:12345-0@lo:1000:lfsck_namespace.0 Request processed in 62us (822us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002505.659206:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3575 00010000:00010000:3.0:1786002505.660362:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578413796 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841378f expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.660376:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:3.0:1786002505.660379:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002505.660382:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5ba00, rc 0) 00000100:00100000:3.0:1786002505.660450:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20601:x1872758560887296:12345-0@lo:101:lfsck_namespace.0 Request processed in 3434us (3551us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.660461:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3571 00000100:00100000:2.0:1786002505.660534:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448ff100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560887296:0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1786002505.660555:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413796 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.660566:0:20601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413796 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002505.660584:0:20601:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1786002505.660625:0:20601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.660632:0:20601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.660644:0:20601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002505.660673:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560887936:0@lo:101:lfsck_namespace.0 00000100:00100000:2.0:1786002505.660702:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.660730:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.660745:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560887936 00000100:00100000:2.0:1786002505.660749:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560887936 00000100:00100000:2.0:1786002505.660777:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3576 00000100:00100000:2.0:1786002505.660783:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:20601:x1872758560887936:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1786002505.660795:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002505.660808:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784137ab lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784137a4 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.660826:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784137ab lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784137a4 expref: 8 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.660835:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784137ab lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137a4 expref: 8 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.660841:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x95dc2b73 (ffff9ed24556ea00) 00010000:00010000:2.0:1786002505.660844:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 23 00010000:00010000:2.0:1786002505.660953:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a200, rc 0) 00000100:00100000:2.0:1786002505.660994:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560887936:12345-0@lo:101:lfsck_namespace.0 Request processed in 210us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.660999:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3576 00000100:00100000:2.0:1786002505.661024:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb480 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560887936:0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1786002505.661034:0:20601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137ab expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.661042:0:20601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784137ab expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002505.661053:0:20601:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000040:00080000:2.0:1786002505.661238:0:20601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].392, 448 off593392 00000040:00080000:2.0:1786002505.661268:0:20601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].391, 448 off642288 00000004:00080000:2.0:1786002505.661274:0:20601:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed2456d8cc0 with version 747 00000004:00080000:2.0:1786002505.661287:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 747 rpc_version 747 00000020:00100000:2.0:1786002505.661305:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002505.662002:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244bbb480 x1872758560888192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1728/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002505.662020:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560888192:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002505.662050:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.662081:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8900 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.662095:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560888192 00000100:00100000:2.0:1786002505.662099:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560888192 00000100:00100000:2.0:1786002505.662122:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3577 00000100:00100000:2.0:1786002505.662129:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560888192:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002505.664050:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560888192:12345-0@lo:1000:osp_up1-0.0 Request processed in 1918us (1996us total) trans 4294968461 rc 0/0 00000100:00100000:3.0:1786002505.668062:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560888192:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1786002505.668099:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137ab expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.668111:0:20601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137ab expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.668120:0:20601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413796 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.668128:0:20601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413796 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:3.0:1786002505.668136:0:20601:0:(lfsck_namespace.c:1395:lfsck_namespace_insert_normal()) lustre-MDT0000-osd: namespace LFSCK insert object [0x200000402:0x148b:0x0] with the name subdir248 and type 40000 to the parent [0x240000401:0x5:0x0]: rc = 1 00000100:00100000:3.0:1786002505.668263:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560888448:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.668313:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.668351:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed35a4ada80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002505.668969:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560888448 00000100:00100000:1.0:1786002505.668976:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560888448 00000100:00100000:2.0:1786002505.669443:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3577 00000100:00100000:2.0:1786002505.673836:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed34bb3c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.673916:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560888320:0@lo:1000:lfsck_namespace.0 00010000:00010000:2.0:1786002505.674000:0:20599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556aa00/0x7cee4af5784137b2 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.674011:0:20599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556aa00/0x7cee4af5784137b2 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.674020:0:20599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556aa00/0x7cee4af5784137b2 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002505.674036:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbbb80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560888576:0@lo:101:lfsck_namespace.0 00000100:00100000:2.0:1786002505.674107:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.674134:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.678222:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560888576 00000100:00100000:3.0:1786002505.678237:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560888576 00000100:00100000:3.0:1786002505.678307:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3579 00000100:00100000:3.0:1786002505.678317:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:20599:x1872758560888576:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1786002505.678337:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002505.678360:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784137b9 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784137b2 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.678394:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784137b9 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784137b2 expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.678407:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784137b9 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137b2 expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.678415:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:3.0:1786002505.678418:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002505.678421:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b600, rc 0) 00000100:00100000:3.0:1786002505.678501:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:20599:x1872758560888576:12345-0@lo:101:lfsck_namespace.0 Request processed in 185us (4392us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.678507:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3579 00000100:00100000:3.0:1786002505.692537:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560888704 00000100:00100000:3.0:1786002505.692550:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560888704 00000100:00100000:3.0:1786002505.692662:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3580 00000100:00100000:3.0:1786002505.692672:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560888448:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.692809:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560888448:12345-0@lo:1000:lfsck_namespace.0 Request processed in 137us (24495us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002505.692817:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3580 00000100:00100000:3.0:1786002505.692878:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560888448:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.693008:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560888832:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.693043:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.693066:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.693079:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560888832 00000100:00100000:3.0:1786002505.693083:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560888832 00000100:00100000:3.0:1786002505.693102:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3581 00000100:00100000:3.0:1786002505.693108:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:20599:x1872758560888704:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1786002505.693117:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002505.693138:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784137c7 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784137c0 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.693165:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784137c7 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784137c0 expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.693180:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784137c7 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137c0 expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.693188:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xf8280fc8 (ffff9ed243ce3b00) 00010000:00010000:3.0:1786002505.693191:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 23 00010000:00010000:3.0:1786002505.693195:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b400, rc 0) 00000100:00100000:3.0:1786002505.693229:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:20599:x1872758560888704:12345-0@lo:101:lfsck_namespace.0 Request processed in 121us (14392us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.693235:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3581 00000100:00100000:3.0:1786002505.693251:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3582 00000100:00100000:3.0:1786002505.693257:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560888832:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.698541:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560889088 00000100:00100000:2.0:1786002505.698552:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560889088 00000100:00100000:2.0:1786002505.698592:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3583 00000100:00100000:2.0:1786002505.698601:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:7466:x1872758560889088:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002505.699595:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:7466:x1872758560889088:12345-0@lo:1000:osp_up0-1.0 Request processed in 993us (4003us total) trans 4294983481 rc 0/0 00000100:00100000:2.0:1786002505.699605:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3583 00000100:00100000:2.0:1786002505.699663:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560889088:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1786002505.699715:0:20599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af5784137c0 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137c7 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.699727:0:20599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af5784137c0 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137c7 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.699736:0:20599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556aa00/0x7cee4af5784137b2 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137b9 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.699742:0:20599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556aa00/0x7cee4af5784137b2 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137b9 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:2.0:1786002505.699751:0:20599:0:(lfsck_namespace.c:1395:lfsck_namespace_insert_normal()) lustre-MDT0001-osd: namespace LFSCK insert object [0x240000402:0x104:0x0] with the name subdir261 and type 40000 to the parent [0x200000400:0x5:0x0]: rc = 1 00000100:00100000:2.0:1786002505.700786:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560889216:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.700828:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.701163:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8300 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.701177:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560889216 00000100:00100000:2.0:1786002505.701182:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560889216 00000100:00100000:2.0:1786002505.701314:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3584 00000100:00100000:2.0:1786002505.701324:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560889216:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.701410:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560889216:12345-0@lo:1000:lfsck_namespace.0 Request processed in 87us (580us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002505.704461:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560888832:12345-0@lo:1000:lfsck_namespace.0 Request processed in 11196us (11410us total) trans 0 rc 1/1 00000100:00100000:2.0:1786002505.709576:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3584 00000100:00100000:2.0:1786002505.709650:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560889216:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.709794:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560889344:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.710660:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.710745:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab600 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.710841:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560889344 00000100:00100000:2.0:1786002505.710879:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560889344 00000100:00100000:1.0:1786002505.714672:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3585 00000100:00100000:1.0:1786002505.714695:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560889344:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1786002505.714843:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560889344:12345-0@lo:1000:lfsck_namespace.0 Request processed in 159us (4184us total) trans 0 rc 1/1 00000100:00100000:1.0:1786002505.715170:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3585 00000100:00100000:2.0:1786002505.716519:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560889344:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.716653:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560889472:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.716695:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.716723:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab600 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.716737:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560889472 00000100:00100000:2.0:1786002505.716742:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560889472 00000100:00100000:2.0:1786002505.716772:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3586 00000100:00100000:2.0:1786002505.716779:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560889472:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1786002505.718061:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560889600:0@lo:1000:lfsck_namespace.0 00010000:00010000:0.0:1786002505.718083:0:20599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47000/0x7cee4af5784137ce lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.718092:0:20599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47000/0x7cee4af5784137ce lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.718099:0:20599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47000/0x7cee4af5784137ce lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.718105:0:20599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002505.718108:0:20599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47000/0x7cee4af5784137ce lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.718115:0:20599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47000/0x7cee4af5784137ce lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.718127:0:20599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:0.0:1786002505.718130:0:20599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1786002505.718135:0:20599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47000/0x7cee4af5784137ce lrc: 2/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.718141:0:20599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47000/0x7cee4af5784137ce lrc: 0/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002505.718160:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560889472:12345-0@lo:1000:lfsck_namespace.0 Request processed in 68us (152us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002505.718167:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3586 00000100:00100000:0.0:1786002505.718184:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560889728:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1786002505.718208:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002505.718229:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed34bb3c840 going to sleep for 11 seconds 00000100:00100000:0.0:1786002505.718241:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560889728 00000100:00100000:0.0:1786002505.718245:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560889728 00000100:00100000:0.0:1786002505.718261:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3588 00000100:00100000:0.0:1786002505.718266:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560889728:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1786002505.718430:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560889728:12345-0@lo:1000:lfsck_namespace.0 Request processed in 162us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002505.718437:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3588 00000100:00100000:2.0:1786002505.718485:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560889728:0@lo:1000:lfsck_namespace.0 00010000:00010000:2.0:1786002505.718529:0:20599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 20599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.718536:0:20599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.718545:0:20599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002505.718557:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560889856:0@lo:101:lfsck_namespace.0 00000100:00100000:2.0:1786002505.718580:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.718607:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.718947:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3582 00000100:00100000:3.0:1786002505.719391:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560888832:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1786002505.719748:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560889856 00000100:00100000:0.0:1786002505.719753:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560889856 00000100:00100000:0.0:1786002505.719781:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3589 00000100:00100000:0.0:1786002505.719789:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560889856:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:0.0:1786002505.719800:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002505.719815:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784137dc lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784137d5 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.719837:0:20598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784137b9 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137b2 expref: 14 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.719858:0:20598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784137dc lrc: 4/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784137d5 expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.719891:0:20598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784137b9 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af5784137b2 expref: 14 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002505.719903:0:20598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20598:1872758560889984:0@lo:104: 00000100:00100000:0.0:1786002505.719934:0:20598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002505.719958:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560889984 00000100:00100000:0.0:1786002505.719962:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560889984 00000100:00100000:0.0:1786002505.720055:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:0.0:1786002505.720061:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:20598:x1872758560889984:12345-0@lo:104: 00010000:00010000:0.0:1786002505.720071:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556aa00/0x7cee4af5784137b2 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784137b9 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.720109:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786002505.720114:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:20598:x1872758560889984:12345-0@lo:104: Request processed in 54us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002505.720120:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00010000:00010000:0.0:1786002505.720137:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002505.720143:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556aa00/0x7cee4af5784137b2 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784137b9 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.720151:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556aa00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002505.720154:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556aa00/0x7cee4af5784137b2 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7cee4af5784137b9 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.720162:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556aa00/0x7cee4af5784137b2 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af5784137b9 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.720184:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556aa00/0x7cee4af5784137b2 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137b9 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.720190:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002505.720207:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556aa00/0x7cee4af5784137b2 lrc: 1/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137b9 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.720214:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556aa00/0x7cee4af5784137b2 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137b9 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.720224:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002505.720226:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002505.720228:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002505.720234:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002505.720242:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560890112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002505.720267:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002505.720300:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560890112 00000100:00100000:0.0:1786002505.720304:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560890112 00000100:00100000:3.0:1786002505.720742:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560890240:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.720768:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.720778:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.720811:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560890240 00000100:00100000:3.0:1786002505.720814:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560890240 00000100:00100000:3.0:1786002505.720831:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3590 00000100:00100000:3.0:1786002505.720836:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560890240:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.720923:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560890240:12345-0@lo:1000:lfsck_namespace.0 Request processed in 85us (153us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002505.720930:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3590 00000100:00100000:3.0:1786002505.720956:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560890240:0@lo:1000:lfsck_namespace.0 00010000:00010000:0.0:1786002505.721618:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784137b9 lrc: 5/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af5784137b2 expref: 15 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002505.721642:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:0.0:1786002505.722589:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+15:3645:x1872758560890112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002505.722601:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786002505.722811:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560890368:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.722862:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.722893:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.722911:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560890368 00000100:00100000:3.0:1786002505.722915:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560890368 00000100:00100000:3.0:1786002505.722935:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3591 00000100:00100000:3.0:1786002505.722941:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560890368:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1786002505.723213:0:20598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed34bb3c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002505.723234:0:20598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20598:1872758560889984:0@lo:104: 00010000:00010000:0.0:1786002505.723254:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784137dc lrc: 3/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137d5 expref: 15 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.723267:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:0.0:1786002505.723270:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002505.723274:0:20598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784137dc lrc: 3/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137d5 expref: 15 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.723283:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46800, rc 0) 00000100:00100000:0.0:1786002505.724760:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:20599:x1872758560889856:12345-0@lo:101:lfsck_namespace.0 Request processed in 4966us (6173us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002505.724769:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3589 00000100:00100000:3.0:1786002505.726142:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560890368:12345-0@lo:1000:lfsck_namespace.0 Request processed in 3195us (3274us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002505.726151:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3591 00000100:00100000:3.0:1786002505.726198:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560890368:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.727734:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560890496:0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.727788:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.727820:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.727838:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560890496 00000100:00100000:3.0:1786002505.727862:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560890496 00000100:00100000:3.0:1786002505.727908:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3592 00000100:00100000:3.0:1786002505.727917:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560890496:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.730407:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560890496:12345-0@lo:1000:lfsck_namespace.0 Request processed in 2486us (2613us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002505.730418:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3592 00000100:00100000:3.0:1786002505.730467:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560890496:0@lo:1000:lfsck_namespace.0 00000001:00080000:0.0:1786002505.731089:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983481 is committed 00000020:00080000:0.0:1786002505.731101:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 396 batchid updated 00010000:00010000:0.0:1786002505.731169:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784137b9 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af5784137b2 expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.731186:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:0.0:1786002505.731191:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784137dc lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137d5 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.731202:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784137dc lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784137d5 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.731212:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784137dc lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784137d5 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.731258:0:10399:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784137dc lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137d5 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002505.731271:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:10399:1872758560890624:0@lo:105: 00000100:00100000:0.0:1786002505.731459:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.731493:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560890624 00000100:00100000:0.0:1786002505.731496:0:10399:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed34bb3c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.731499:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560890624 00000100:00100000:2.0:1786002505.731537:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1786002505.731545:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10399:x1872758560890624:12345-0@lo:105: 00010000:00010000:2.0:1786002505.731555:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.731563:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.731575:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.731582:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1786002505.731582:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 396 00010000:00010000:2.0:1786002505.731588:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 5/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.731595:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 5/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.731606:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed34556b000) 00000004:00080000:0.0:1786002505.731624:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed34bb3c480 with version 748 00000020:00080000:0.0:1786002505.731633:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 395 cancel update log [0x240000401:0x3:0x0].390: rc = 0 00000100:00100000:2.0:1786002505.731640:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10399:x1872758560890624:12345-0@lo:105: Request processed in 96us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.731646:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1786002505.731678:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560889856:0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1786002505.731692:0:20599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002505.731708:0:20599:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002505.731741:0:20599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.731748:0:20599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.731762:0:20599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002505.731775:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560890752:0@lo:101:lfsck_namespace.0 00000100:00100000:2.0:1786002505.731799:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.731808:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560890880:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.731817:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.731833:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.731878:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.731891:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560890752 00000100:00100000:3.0:1786002505.731894:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560890752 00000100:00100000:3.0:1786002505.731911:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560890880 00000100:00100000:3.0:1786002505.731914:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560890880 00000100:00100000:3.0:1786002505.731926:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3593 00000100:00100000:3.0:1786002505.731932:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:20599:x1872758560890752:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1786002505.731946:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002505.731959:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784137ea lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784137e3 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002505.732932:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:10399:1872758560890624:0@lo:105: 00010000:00010000:2.0:1786002505.732948:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002505.732987:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3645:x1872758560890112:12345-0@lo:103:ldlm_bl.0 Request processed in 10405us (12718us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.732995:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000100:00100000:2.0:1786002505.733032:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560890112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002505.733056:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784137ea lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784137e3 expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.733070:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784137ea lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137e3 expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.733076:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xb73071de (ffff9ed245fed000) 00010000:00010000:3.0:1786002505.733079:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 23 00010000:00010000:3.0:1786002505.733083:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a400, rc 0) 00000100:00100000:3.0:1786002505.733119:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:20599:x1872758560890752:12345-0@lo:101:lfsck_namespace.0 Request processed in 1186us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.733125:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3593 00000100:00100000:3.0:1786002505.733144:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3594 00000100:00100000:3.0:1786002505.733151:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560890880:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:3.0:1786002505.733224:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:20601:x1872758560890880:12345-0@lo:1000:lfsck_namespace.0 Request processed in 73us (1388us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002505.733230:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3594 00000100:00100000:3.0:1786002505.733252:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560890880:0@lo:1000:lfsck_namespace.0 00100000:10000000:3.0:1786002505.733282:0:20601:0:(lfsck_namespace.c:6719:lfsck_namespace_assistant_handler_p2()) lustre-MDT0000-osd: namespace LFSCK phase2 scan stop at the No. 16 trace file: rc = 1 00000100:00100000:3.0:1786002505.733303:0:20601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560891008:0@lo:1101:lfsck_namespace.0 00000100:00100000:2.0:1786002505.733505:0:20599:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983481 gen 2 00000004:00080000:2.0:1786002505.733510:0:20599:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983480 committed transno 4294983481 00000004:00080000:2.0:1786002505.733521:0:20599:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983481 committed transno 4294983481 00000100:00100000:2.0:1786002505.733534:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb800 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560890752:0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1786002505.733546:0:20599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137ea expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.733557:0:20599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784137ea expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002505.733569:0:20599:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000020:00080000:0.0:1786002505.733589:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 395 cancel update log [0x200000400:0x3:0x0].391: rc = 0 00000020:00080000:0.0:1786002505.733601:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 396 00000004:00080000:0.0:1786002505.733621:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 748 rpc_version 748 00000020:00100000:0.0:1786002505.733637:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002505.733644:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243e16a00 x1872758560891264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:2.0:1786002505.733700:0:20599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].397, 448 off605544 00000040:00080000:2.0:1786002505.733722:0:20599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].396, 448 off653480 00000004:00080000:2.0:1786002505.733727:0:20599:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed36e7ab300 with version 754 00000004:00080000:2.0:1786002505.733740:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 754 rpc_version 754 00000020:00100000:2.0:1786002505.733755:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002505.733760:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2467f3b80 x1872758560891520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1472/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002505.733773:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f3b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560891520:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002505.733803:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.733814:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab480 going to sleep for 11 seconds 00000100:00100000:0.0:1786002505.734062:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560891264:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002505.734088:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002505.734098:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed34bb3c840 going to sleep for 11 seconds 00000100:00100000:0.0:1786002505.734111:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560891520 00000100:00100000:0.0:1786002505.734115:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560891520 00000100:00100000:0.0:1786002505.734138:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560891264 00000100:00100000:0.0:1786002505.734140:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560891264 00000100:00100000:0.0:1786002505.734154:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3595 00000100:00100000:0.0:1786002505.734160:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:7466:x1872758560891520:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002505.735070:0:20601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.735082:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.735098:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560891008 00000100:00100000:3.0:1786002505.735102:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560891008 00000100:00100000:3.0:1786002505.735121:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3596 00000100:00100000:3.0:1786002505.735127:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560891264:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002505.735223:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560891264:12345-0@lo:1000:osp_up1-0.0 Request processed in 95us (1134us total) trans 4294968462 rc 0/0 00000100:00100000:3.0:1786002505.735229:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3596 00000100:00100000:3.0:1786002505.735267:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e16a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560891264:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002505.735283:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3597 00000100:00100000:3.0:1786002505.735290:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560891008:12345-0@lo:1101:lfsck_namespace.0 00100000:10000000:3.0:1786002505.735305:0:15596:0:(lfsck_namespace.c:5114:lfsck_namespace_in_notify()) lustre-MDT0001-osd: namespace LFSCK handles notify 4 from MDT 0, status 1, flags 0 00000100:00100000:0.0:1786002505.735906:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:7466:x1872758560891520:12345-0@lo:1000:osp_up0-1.0 Request processed in 1744us (2101us total) trans 4294983482 rc 0/0 00000100:00100000:0.0:1786002505.735914:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3595 00000100:00100000:2.0:1786002505.735984:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f3b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560891520:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1786002505.736573:0:20599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137ea expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.736585:0:20599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137ea expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.736594:0:20599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002505.736600:0:20599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:0.0:1786002505.736607:0:20599:0:(lfsck_namespace.c:1395:lfsck_namespace_insert_normal()) lustre-MDT0001-osd: namespace LFSCK insert object [0x240000402:0x186:0x0] with the name subdir399 and type 40000 to the parent [0x200000400:0x5:0x0]: rc = 1 00000100:00100000:3.0:1786002505.736755:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:20601:x1872758560891008:12345-0@lo:1101:lfsck_namespace.0 Request processed in 1465us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.736762:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3597 00000100:00100000:3.0:1786002505.736791:0:20601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0000-mdtlov_UUID:20601:1872758560891008:0@lo:1101:lfsck_namespace.0 00000100:00100000:3.0:1786002505.736796:0:20601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d3c0 going to sleep for 0 seconds 00100000:10000000:3.0:1786002505.736805:0:20601:0:(lfsck_engine.c:1760:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant sync before exit 00000004:00080000:3.0:1786002505.736821:0:20601:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865917973191ns, next at 710286181700ns, rc = 0 00080000:00080000:3.0:1786002505.736828:0:20601:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1786002505.736861:0:20601:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 865918012450ns, next at 686041981081ns, rc = 0 00080000:00080000:3.0:1786002505.736875:0:20601:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1786002505.737106:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560891648:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1786002505.737140:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002505.737156:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed34bb3c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.737186:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560891648 00000100:00100000:2.0:1786002505.737191:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560891648 00000100:00100000:2.0:1786002505.737231:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3598 00000100:00100000:2.0:1786002505.737238:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560891648:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.737303:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560891648:12345-0@lo:1000:lfsck_namespace.0 Request processed in 65us (162us total) trans 0 rc 1/1 00000100:00100000:2.0:1786002505.737310:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3598 00000100:00100000:2.0:1786002505.737332:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e16d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560891648:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.737388:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560891776:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.738272:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.738293:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.738307:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560891776 00000100:00100000:2.0:1786002505.738311:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560891776 00000100:00100000:2.0:1786002505.738334:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3599 00000100:00100000:2.0:1786002505.738340:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560891776:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.738494:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560891776:12345-0@lo:1000:lfsck_namespace.0 Request processed in 153us (221us total) trans 0 rc 1/1 00000100:00100000:2.0:1786002505.738503:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3599 00000100:00100000:2.0:1786002505.738529:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e16d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560891776:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.738623:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e16d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560891904:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.738646:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.738661:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.738673:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560891904 00000100:00100000:2.0:1786002505.738676:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560891904 00000100:00100000:2.0:1786002505.738694:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3600 00000100:00100000:2.0:1786002505.738699:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560891904:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.738751:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560891904:12345-0@lo:1000:lfsck_namespace.0 Request processed in 52us (104us total) trans 0 rc 1/1 00000100:00100000:2.0:1786002505.738758:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3600 00000100:00100000:2.0:1786002505.738778:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e16d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560891904:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.738835:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560892032:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.738893:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.738903:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.738914:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560892032 00000100:00100000:2.0:1786002505.738917:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560892032 00000100:00100000:2.0:1786002505.738933:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3601 00000100:00100000:2.0:1786002505.738938:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560892032:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.738983:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560892032:12345-0@lo:1000:lfsck_namespace.0 Request processed in 45us (89us total) trans 0 rc 1/1 00000100:00100000:2.0:1786002505.738989:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3601 00000100:00100000:2.0:1786002505.739009:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560892032:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.739068:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560892160:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.742355:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.742389:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.743175:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560892160 00000100:00100000:2.0:1786002505.743183:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560892160 00000100:00100000:2.0:1786002505.743238:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3602 00000100:00100000:2.0:1786002505.743247:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560892160:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.743354:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560892160:12345-0@lo:1000:lfsck_namespace.0 Request processed in 108us (1006us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002505.743362:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3602 00000100:00100000:2.0:1786002505.743639:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560892160:0@lo:1000:lfsck_namespace.0 00010000:00010000:2.0:1786002505.743688:0:20599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784137f1 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.743703:0:20599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784137f1 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.743715:0:20599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784137f1 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002505.743754:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 87 committed 00000004:00080000:3.0:1786002505.743773:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 90 committed 00000100:00100000:2.0:1786002505.743775:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560892288:0@lo:1000:lfsck_namespace.0 00000001:00080000:3.0:1786002505.743783:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983482 is committed 00100000:10000000:3.0:1786002505.743804:0:20601:0:(lfsck_engine.c:1766:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant synced before exit: rc = 0 00000100:00100000:2.0:1786002505.743805:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.743821:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.743831:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560892288 00000100:00100000:2.0:1786002505.743834:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560892288 00100000:10000000:3.0:1786002505.743888:0:20601:0:(lfsck_engine.c:1778:lfsck_assistant_engine()) lustre-MDT0000-osd: LFSCK assistant phase2 scan finished: rc = 1 00100000:10000000:3.0:1786002505.743897:0:20601:0:(lfsck_engine.c:1790:lfsck_assistant_engine()) lustre-MDT0000-osd: lfsck_namespace LFSCK assistant thread exit: rc = 1 00000100:00100000:2.0:1786002505.744519:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3603 00000100:00100000:2.0:1786002505.744529:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:20599:x1872758560892288:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.744594:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:20599:x1872758560892288:12345-0@lo:1000:lfsck_namespace.0 Request processed in 67us (787us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002505.744601:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3603 00000100:00100000:2.0:1786002505.744623:0:20599:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983482 gen 2 00000004:00080000:2.0:1786002505.744629:0:20599:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983482 committed transno 4294983482 00000100:00100000:2.0:1786002505.744644:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513100 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560892288:0@lo:1000:lfsck_namespace.0 00010000:00010000:2.0:1786002505.744657:0:20599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784137f1 lrc: 3/0,1 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.744666:0:20599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784137f1 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.744672:0:20599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784137f1 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.744679:0:20599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556bc00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002505.744682:0:20599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784137f1 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.744690:0:20599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784137f1 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.744703:0:20599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9d:0x0].0x0 (ffff9ed24556ec00) 00010000:00010000:2.0:1786002505.744706:0:20599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1786002505.744710:0:20599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784137f1 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.744716:0:20599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556bc00/0x7cee4af5784137f1 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002505.744762:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560892416:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.744786:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.744801:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.744813:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560892416 00000100:00100000:2.0:1786002505.744817:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560892416 00000100:00100000:2.0:1786002505.744836:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3604 00000100:00100000:2.0:1786002505.744842:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:20599:x1872758560892416:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.744928:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:20599:x1872758560892416:12345-0@lo:1000:lfsck_namespace.0 Request processed in 86us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.744935:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3604 00000100:00100000:2.0:1786002505.744957:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560892416:0@lo:1000:lfsck_namespace.0 00010000:00010000:2.0:1786002505.744996:0:20599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 20599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.745004:0:20599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.745014:0:20599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002505.745025:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560892544:0@lo:101:lfsck_namespace.0 00000100:00100000:2.0:1786002505.745059:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.745069:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab480 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.745074:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560892544 00000100:00100000:3.0:1786002505.745078:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560892544 00000100:00100000:3.0:1786002505.753908:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3605 00000100:00100000:3.0:1786002505.753927:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:20599:x1872758560892544:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:3.0:1786002505.753949:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002505.754601:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784137ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784137f8 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.754634:0:20598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413757 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413750 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.758224:0:20598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784137ff lrc: 4/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784137f8 expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.758995:0:20598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413757 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578413750 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002505.759014:0:20598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20598:1872758560892672:0@lo:104: 00000100:00100000:3.0:1786002505.759072:0:20598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.759110:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560892672 00000100:00100000:3.0:1786002505.759117:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560892672 00000100:00100000:3.0:1786002505.759161:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1786002505.759169:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:20598:x1872758560892672:12345-0@lo:104: 00010000:00010000:3.0:1786002505.759182:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a600/0x7cee4af578413750 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578413757 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.759228:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786002505.759234:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:20598:x1872758560892672:12345-0@lo:104: Request processed in 66us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.759241:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1786002505.759277:0:20598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1786002505.759277:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002505.759284:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a600/0x7cee4af578413750 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578413757 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.759292:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002505.759295:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a600/0x7cee4af578413750 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x2 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7cee4af578413757 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002505.759297:0:20598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20598:1872758560892672:0@lo:104: 00010000:00010000:1.0:1786002505.759304:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a600/0x7cee4af578413750 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x2 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578413757 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.759329:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784137ff lrc: 3/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137f8 expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.759330:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a600/0x7cee4af578413750 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x2 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413757 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.759338:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002505.759340:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed35363dc00) 00010000:00010000:3.0:1786002505.759343:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002505.759347:0:20598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784137ff lrc: 3/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137f8 expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.759357:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b000, rc 0) 00010000:00010000:1.0:1786002505.759357:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a600/0x7cee4af578413750 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x2 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413757 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.759364:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a600/0x7cee4af578413750 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x2 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413757 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.759376:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002505.759378:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002505.759380:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002505.759393:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560892544:12345-0@lo:101:lfsck_namespace.0 Request processed in 5474us (14334us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002505.759400:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3605 00000100:00100000:2.0:1786002505.759963:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560892544:0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1786002505.759979:0:20599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.759993:0:20599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002505.760479:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560892800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002505.760523:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.760763:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560892800 00000100:00100000:3.0:1786002505.760769:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560892800 00010000:00010000:3.0:1786002505.760794:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413757 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578413750 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002505.760827:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1621 00000100:00100000:3.0:1786002505.760835:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+13:3645:x1872758560892800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002505.760873:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002505.770899:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578413757 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x23/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578413750 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.770922:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed35363dc00) 00010000:00010000:1.0:1786002505.770928:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784137ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137f8 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.770940:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784137ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784137f8 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.770950:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784137ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784137f8 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002505.770990:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784137ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137f8 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002505.771004:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6505:1872758560892928:0@lo:105: 00000100:00100000:1.0:1786002505.771076:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002505.771311:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40180 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.775181:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560892928 00000100:00100000:3.0:1786002505.775192:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560892928 00000100:00100000:3.0:1786002505.783523:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1786002505.783542:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6505:x1872758560892928:12345-0@lo:105: 00010000:00010000:3.0:1786002505.783558:0:17237:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.783570:0:17237:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.783579:0:17237:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.783592:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 5/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.783599:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 6/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.783607:0:17237:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 6/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002505.783632:0:17237:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed34556b400) 00000100:00100000:3.0:1786002505.783708:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6505:x1872758560892928:12345-0@lo:105: Request processed in 174us (12631us total) trans 0 rc 0/0 00010000:00010000:2.0:1786002505.783744:0:20599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.783754:0:20599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002505.783775:0:20599:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x14bf:0x0] 00010000:00010000:2.0:1786002505.783810:0:20599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556bc00/0x7cee4af578413806 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x7a87ce3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20599 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.783817:0:20599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556bc00/0x7cee4af578413806 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x7a87ce3d bits 0x23/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.783827:0:20599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556bc00/0x7cee4af578413806 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x7a87ce3d bits 0x23/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 20599 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002505.783843:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560893056:0@lo:101:lfsck_namespace.0 00000100:00100000:1.0:1786002505.784144:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6505:1872758560892928:0@lo:105: 00010000:00010000:1.0:1786002505.784159:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002505.784191:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3645:x1872758560892800:12345-0@lo:103:ldlm_bl.0 Request processed in 23356us (23667us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002505.784199:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1621 00000100:00100000:1.0:1786002505.784233:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560892800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002505.785425:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.785451:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab480 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.785470:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560893056 00000100:00100000:2.0:1786002505.785476:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560893056 00000100:00100000:2.0:1786002505.785507:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3606 00000100:00100000:2.0:1786002505.785513:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:20599:x1872758560893056:12345-0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1786002505.785529:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002505.785546:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841380d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x7a87ce3d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413806 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.785571:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841380d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x7a87ce3d bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413806 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.785584:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556ac00/0x7cee4af57841380d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x7a87ce3d bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413806 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.785591:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x7a87ce3d (ffff9ed24556e600) 00010000:00010000:2.0:1786002505.785594:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 23 00010000:00010000:2.0:1786002505.785596:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556ac00, rc 0) 00000100:00100000:2.0:1786002505.785624:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560893056:12345-0@lo:101:lfsck_namespace.0 Request processed in 110us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.785629:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3606 00000100:00100000:2.0:1786002505.785654:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560893056:0@lo:101:lfsck_namespace.0 00010000:00010000:2.0:1786002505.785668:0:20599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556bc00/0x7cee4af578413806 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x7a87ce3d bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841380d expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.785677:0:20599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556bc00/0x7cee4af578413806 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x7a87ce3d bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841380d expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002505.785690:0:20599:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x14bf:0x0] 00000100:00100000:2.0:1786002505.785747:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560893184:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.785769:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.785782:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.785793:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560893184 00000100:00100000:2.0:1786002505.785797:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560893184 00000100:00100000:2.0:1786002505.785817:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3607 00000100:00100000:2.0:1786002505.785822:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560893184:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.785899:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:20599:x1872758560893184:12345-0@lo:1000:lfsck_namespace.0 Request processed in 76us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002505.785904:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3607 00000100:00100000:2.0:1786002505.785924:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f1880 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560893184:0@lo:1000:lfsck_namespace.0 00000040:00080000:2.0:1786002505.786219:0:20599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].398, 576 off606120 00000040:00080000:2.0:1786002505.786249:0:20599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].397, 576 off654056 00000004:00080000:2.0:1786002505.786255:0:20599:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed36e7ab480 with version 755 00000004:00080000:2.0:1786002505.786269:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 755 rpc_version 755 00000020:00100000:2.0:1786002505.786285:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002505.786293:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2457f1880 x1872758560893440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002505.786306:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560893440:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002505.786331:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.786345:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.786357:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560893440 00000100:00100000:2.0:1786002505.786360:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560893440 00000100:00100000:2.0:1786002505.786383:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3608 00000100:00100000:2.0:1786002505.786496:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:7466:x1872758560893440:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002505.786827:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:7466:x1872758560893440:12345-0@lo:1000:osp_up0-1.0 Request processed in 437us (494us total) trans 4294983483 rc 0/0 00000100:00100000:2.0:1786002505.786834:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3608 00000100:00100000:2.0:1786002505.786894:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560893440:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1786002505.786909:0:20599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556bc00/0x7cee4af578413806 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x7a87ce3d bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841380d expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.786920:0:20599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556bc00/0x7cee4af578413806 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x7a87ce3d bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841380d expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.786929:0:20599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002505.786935:0:20599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:2.0:1786002505.786942:0:20599:0:(lfsck_namespace.c:1395:lfsck_namespace_insert_normal()) lustre-MDT0001-osd: namespace LFSCK insert object [0x240000401:0x9d:0x0] with the name [0x240000401:0x9d:0x0]:1 and type 40000 to the parent [0x200000402:0x14bf:0x0]: rc = 1 00000100:00100000:2.0:1786002505.787006:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f1500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560893568:0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.787030:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002505.787039:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.787052:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560893568 00000100:00100000:2.0:1786002505.787055:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560893568 00000100:00100000:2.0:1786002505.787072:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3609 00000100:00100000:2.0:1786002505.787077:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:20599:x1872758560893568:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:2.0:1786002505.788181:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:20599:x1872758560893568:12345-0@lo:1000:lfsck_namespace.0 Request processed in 1101us (1147us total) trans 0 rc 1/1 00000100:00100000:2.0:1786002505.788188:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3609 00000100:00100000:3.0:1786002505.792180:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1786002505.794320:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f1500 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560893568:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1786002505.796322:0:20599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c42d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560893696:0@lo:1000:lfsck_namespace.0 00000100:00100000:0.0:1786002505.796378:0:20599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002505.796459:0:20599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed34bb3c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002505.798061:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560893696 00000100:00100000:1.0:1786002505.798071:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560893696 00000100:00100000:1.0:1786002505.798127:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3610 00000100:00100000:1.0:1786002505.798136:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:20599:x1872758560893696:12345-0@lo:1000:lfsck_namespace.0 00000100:00100000:1.0:1786002505.798244:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:20599:x1872758560893696:12345-0@lo:1000:lfsck_namespace.0 Request processed in 109us (1865us total) trans 0 rc 1/1 00000100:00100000:1.0:1786002505.798253:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3610 00000100:00100000:1.0:1786002505.798291:0:20599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c42d80 pname:cluuid:pid:xid:nid:opc:job lfsck_namespace:lustre-MDT0001-mdtlov_UUID:20599:1872758560893696:0@lo:1000:lfsck_namespace.0 00100000:10000000:1.0:1786002505.799423:0:20599:0:(lfsck_namespace.c:6719:lfsck_namespace_assistant_handler_p2()) lustre-MDT0001-osd: namespace LFSCK phase2 scan stop at the No. 16 trace file: rc = 1 00100000:10000000:1.0:1786002505.799438:0:20599:0:(lfsck_engine.c:1760:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant sync before exit 00000004:00080000:1.0:1786002505.799459:0:20599:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 865980610892ns, next at 0ns, rc = 0 00080000:00080000:1.0:1786002505.799471:0:20599:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1786002505.799494:0:20599:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 865980646557ns, next at 0ns, rc = 0 00080000:00080000:1.0:1786002505.799499:0:20599:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1786002505.818433:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000004:00080000:3.0:1786002505.818453:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000001:00080000:3.0:1786002505.818470:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968462 is committed 00000020:00080000:3.0:1786002505.818477:0:7451:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed36e7ab6c0 refcount 2 committed 0 result 0 batchid 400 00000020:00080000:3.0:1786002505.818483:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebe700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36e7ab300 00000020:00080000:3.0:1786002505.818487:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].396 00000020:00080000:3.0:1786002505.818490:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebe600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245da4600 00000020:00080000:3.0:1786002505.818493:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].397 00000020:00080000:3.0:1786002505.818500:0:7451:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed34bb3c240 refcount 2 committed 0 result 0 batchid 399 00000020:00080000:3.0:1786002505.818503:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed34bb3c900 00000020:00080000:3.0:1786002505.818506:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].395 00000020:00080000:3.0:1786002505.818508:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244a60a00 00000020:00080000:3.0:1786002505.818511:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].396 00000020:00080000:3.0:1786002505.818516:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 398 batchid updated 00000020:00080000:3.0:1786002505.818521:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 397 batchid updated 00000020:00080000:3.0:1786002505.818544:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 400 committed batchid 398 00000004:00080000:3.0:1786002505.818649:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed366d7d3c0 with version 756 00000020:00080000:3.0:1786002505.818659:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 396 cancel update log [0x200000401:0x3:0x0].392: rc = 0 00000020:00080000:3.0:1786002505.818699:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 396 cancel update log [0x240000400:0x3:0x0].393: rc = 0 00100000:10000000:1.0:1786002505.818718:0:20599:0:(lfsck_engine.c:1766:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant synced before exit: rc = 0 00000004:00080000:3.0:1786002505.818719:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed366d7d6c0 with version 757 00000020:00080000:3.0:1786002505.818722:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 397 cancel update log [0x200000401:0x3:0x0].393: rc = 0 00000020:00080000:3.0:1786002505.818739:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 397 cancel update log [0x240000400:0x3:0x0].394: rc = 0 00000004:00080000:3.0:1786002505.818757:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed366d7d180 with version 758 00000020:00080000:3.0:1786002505.818760:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 398 cancel update log [0x200000401:0x3:0x0].394: rc = 0 00100000:10000000:1.0:1786002505.818762:0:20599:0:(lfsck_engine.c:1778:lfsck_assistant_engine()) lustre-MDT0001-osd: LFSCK assistant phase2 scan finished: rc = 1 00100000:10000000:1.0:1786002505.818771:0:20599:0:(lfsck_engine.c:1790:lfsck_assistant_engine()) lustre-MDT0001-osd: lfsck_namespace LFSCK assistant thread exit: rc = 1 00000020:00080000:3.0:1786002505.818776:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 398 cancel update log [0x240000400:0x3:0x0].395: rc = 0 00000020:00080000:3.0:1786002505.818781:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 398 00000004:00080000:3.0:1786002505.818788:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 756 rpc_version 756 00000020:00100000:3.0:1786002505.818815:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002505.818824:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2448fdc00 x1872758560893952/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002505.818861:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560893952:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002505.818931:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.818956:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed35a4ad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.819056:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560893952 00000100:00100000:2.0:1786002505.819063:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560893952 00000100:00100000:2.0:1786002505.819107:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3611 00000100:00100000:2.0:1786002505.819116:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:7466:x1872758560893952:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002505.819232:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:7466:x1872758560893952:12345-0@lo:1000:osp_up0-1.0 Request processed in 117us (300us total) trans 4294983484 rc 0/0 00000100:00100000:2.0:1786002505.819239:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3611 00000100:00100000:3.0:1786002505.820323:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fdc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560893952:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1786002505.820334:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 757 rpc_version 757 00000020:00100000:3.0:1786002505.820351:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002505.820356:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2448ffb80 x1872758560894208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002505.820372:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448ffb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560894208:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002505.820417:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.820439:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed35a4ad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002505.820457:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560894208 00000100:00100000:3.0:1786002505.820462:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560894208 00000100:00100000:3.0:1786002505.820499:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3612 00000100:00100000:3.0:1786002505.820506:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:7466:x1872758560894208:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002505.820601:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:7466:x1872758560894208:12345-0@lo:1000:osp_up0-1.0 Request processed in 95us (184us total) trans 4294983485 rc 0/0 00000100:00100000:3.0:1786002505.820608:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3612 00000100:00100000:3.0:1786002505.820635:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448ffb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560894208:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1786002505.820641:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 758 rpc_version 758 00000020:00100000:3.0:1786002505.820650:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002505.820654:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2448fe300 x1872758560894464/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002505.820664:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fe300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560894464:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002505.820683:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002505.820694:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243311a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002505.820789:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560894464 00000100:00100000:2.0:1786002505.820793:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560894464 00000100:00100000:2.0:1786002505.820820:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3613 00000100:00100000:2.0:1786002505.820826:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:7466:x1872758560894464:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002505.820914:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:7466:x1872758560894464:12345-0@lo:1000:osp_up0-1.0 Request processed in 88us (229us total) trans 4294983486 rc 0/0 00000100:00100000:2.0:1786002505.820919:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3613 00000100:00100000:3.0:1786002505.820982:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fe300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560894464:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1786002506.666100:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002507.641328:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560894592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786002507.641633:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002507.641696:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786002507.641704:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560894720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002507.641729:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002507.641784:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560894592 00000100:00100000:1.0:1786002507.641791:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560894592 00000100:00100000:1.0:1786002507.641868:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560894720 00000100:00100000:1.0:1786002507.641872:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560894720 00000100:00100000:1.0:1786002507.641893:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1786002507.641902:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560894592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002507.641931:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002507.641975:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560894592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002507.641982:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1786002507.641997:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1786002507.642004:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560894720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786002507.642014:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002507.642038:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560894720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002507.642043:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00080000:2.0:1786002507.642468:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002507.642502:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560894720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002507.642515:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560894592:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1786002507.690039:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002508.116144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.116189:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.116224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.116242:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.116262:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.116285:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530830592 00000100:00100000:3.0:1786002508.116294:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530830592 00000100:00100000:3.0:1786002508.116338:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530830720 00000100:00100000:3.0:1786002508.116341:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530830720 00000100:00100000:3.0:1786002508.116361:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 451 00000100:00100000:3.0:1786002508.116370:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758530830592:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002508.116444:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758530830592:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.116451:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 451 00000100:00100000:3.0:1786002508.116478:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 452 00000100:00100000:3.0:1786002508.116484:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758530830720:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002508.116505:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758530830720:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 21us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.116510:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 452 00000100:00100000:3.0:1786002508.116528:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530830208 00000100:00100000:3.0:1786002508.116531:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530830208 00000100:00100000:1.0:1786002508.116550:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530830336 00000100:00100000:3.0:1786002508.116553:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 505 00000100:00100000:1.0:1786002508.116554:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530830336 00000100:00100000:3.0:1786002508.116560:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758530830208:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002508.116582:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758530830208:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.116583:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530830464 00000100:00100000:1.0:1786002508.116585:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530830464 00000100:00100000:3.0:1786002508.116589:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 505 00000100:00100000:1.0:1786002508.116606:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 840 00000100:00100000:1.0:1786002508.116613:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2410:x1872758530830336:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002508.116614:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 841 00000100:00100000:3.0:1786002508.116619:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758530830464:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002508.116641:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758530830464:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 21us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.116647:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 841 00000100:00100000:1.0:1786002508.116653:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2410:x1872758530830336:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 42us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.116660:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 840 00000100:00080000:3.0:1786002508.116665:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786002508.116669:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786002508.116672:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786002508.116674:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002508.138029:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560894848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002508.138100:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002508.138226:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560894848 00000100:00100000:0.0:1786002508.138233:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560894848 00000100:00100000:0.0:1786002508.138281:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3614 00000100:00100000:0.0:1786002508.138291:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:3644:x1872758560894848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002508.138325:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443987456 avail 1297747968 00000100:00100000:0.0:1786002508.138381:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:3644:x1872758560894848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.138388:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3614 00000100:00100000:3.0:1786002508.138488:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560894848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002508.169726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002508.169793:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530830848 00000100:00100000:2.0:1786002508.169802:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530830848 00000100:00100000:2.0:1786002508.169881:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23695 00000100:00100000:2.0:1786002508.169890:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:17796:x1872758530830848:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002508.169909:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002508.169926:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578413814 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a637 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.169983:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.169997:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784137dc lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137d5 expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.170005:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.170039:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784137dc lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af5784137d5 expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002508.170056:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1872758560894976:0@lo:104: 00000100:00100000:2.0:1786002508.170101:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002508.170148:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002508.170208:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786002508.170220:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560894976 00000100:00100000:0.0:1786002508.170223:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560894976 00000100:00100000:0.0:1786002508.170257:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1786002508.170264:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243665450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6520:x1872758560894976:12345-0@lo:104: 00010000:00010000:0.0:1786002508.170275:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.170321:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786002508.170326:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243665450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6520:x1872758560894976:12345-0@lo:104: Request processed in 63us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.170335:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00010000:00010000:1.0:1786002508.170420:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002508.170427:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.170436:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002508.170444:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.170453:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.170480:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.170491:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002508.170519:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 1/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.170527:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b000/0x7cee4af5784137d5 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137dc expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.170545:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002508.170547:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002508.170548:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002508.170556:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002508.170566:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560895104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002508.170594:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002508.170886:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560895104 00000100:00100000:0.0:1786002508.170891:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560895104 00010000:00010000:0.0:1786002508.170907:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784137dc lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af5784137d5 expref: 17 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002508.170928:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1622 00000100:00100000:0.0:1786002508.170934:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+17:3644:x1872758560895104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002508.170941:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1786002508.171124:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1872758560894976:0@lo:104: 00010000:00010000:2.0:1786002508.171145:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002508.175240:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983486 is committed 00010000:00010000:1.0:1786002508.175376:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784137dc lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af5784137d5 expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.175394:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:1.0:1786002508.175399:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.175409:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.175417:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.175449:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002508.175527:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3644:x1872758560895104:12345-0@lo:103:ldlm_bl.0 Request processed in 4591us (4931us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.175540:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1622 00010000:00010000:3.0:1786002508.175879:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.175889:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002508.175936:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1786002508.175941:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002508.175996:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578413814 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a637 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.176016:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a637 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.176025:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:3.0:1786002508.176027:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002508.176032:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed3429eb600, rc 0) 00000100:00100000:3.0:1786002508.176074:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:17796:x1872758530830848:12345-192.168.203.49@tcp:101:ls.0 Request processed in 6185us (6355us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.176082:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23695 00000100:00100000:0.0:1786002508.178355:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560895104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002508.179739:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.179810:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530830976 00000100:00100000:1.0:1786002508.179818:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530830976 00000100:00100000:1.0:1786002508.179896:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23696 00000100:00100000:1.0:1786002508.179907:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:17796:x1872758530830976:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002508.179926:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002508.179945:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af578413822 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a63e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.180000:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413829 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.180014:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578413796 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841378f expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.180021:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413829 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.180052:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578413796 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af57841378f expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002508.180066:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560895232:0@lo:104: 00000100:00100000:1.0:1786002508.180107:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002508.180141:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40600 going to sleep for 11 seconds 00000100:00100000:3.0:1786002508.180322:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560895232 00000100:00100000:3.0:1786002508.180327:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560895232 00000100:00100000:3.0:1786002508.180365:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:3.0:1786002508.180374:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6521:x1872758560895232:12345-0@lo:104: 00010000:00010000:3.0:1786002508.180386:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578413796 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.180446:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786002508.180452:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6521:x1872758560895232:12345-0@lo:104: Request processed in 80us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.180458:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00010000:00010000:3.0:1786002508.180480:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002508.180486:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578413796 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.180495:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002508.180500:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7cee4af578413796 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.180508:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578413796 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.180544:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413796 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.180551:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002508.180571:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 1/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413796 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.180579:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245f5b200/0x7cee4af57841378f lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578413796 expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.180597:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002508.180599:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002508.180601:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002508.180612:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560895360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002508.180639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002508.180753:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560895360 00000100:00100000:1.0:1786002508.180758:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560895360 00010000:00010000:1.0:1786002508.180775:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578413796 lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af57841378f expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002508.180808:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623 00000100:00100000:1.0:1786002508.180815:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1872758560895360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002508.180824:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1786002508.180977:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560895232:0@lo:104: 00010000:00010000:1.0:1786002508.180996:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413829 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1786002508.193149:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 400 batchid updated 00010000:00010000:1.0:1786002508.193270:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578413796 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af57841378f expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.193288:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:1.0:1786002508.193294:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413829 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.193304:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413829 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.193311:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413829 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.193344:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002508.193412:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1872758560895360:12345-0@lo:103:ldlm_bl.0 Request processed in 12596us (12770us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.193423:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623 00000020:00080000:3.0:1786002508.193508:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 400 00000004:00080000:3.0:1786002508.193567:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed2419a23c0 with version 759 00000020:00080000:3.0:1786002508.193584:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 399 cancel update log [0x200000401:0x3:0x0].395: rc = 0 00000020:00080000:3.0:1786002508.193650:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 399 cancel update log [0x240000400:0x3:0x0].396: rc = 0 00000004:00080000:3.0:1786002508.193680:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed2419a2f00 with version 760 00000020:00080000:3.0:1786002508.193683:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 400 cancel update log [0x200000401:0x3:0x0].396: rc = 0 00000020:00080000:3.0:1786002508.193705:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 400 cancel update log [0x240000400:0x3:0x0].397: rc = 0 00000020:00080000:3.0:1786002508.193713:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 400 00000100:00100000:3.0:1786002508.193746:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560895360:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002508.193957:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413829 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.193966:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413829 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002508.194013:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1786002508.194018:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786002508.194068:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af578413822 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a63e expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.194083:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413829 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a63e expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.194091:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:0.0:1786002508.194093:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002508.194097:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f200, rc 0) 00000100:00100000:0.0:1786002508.194142:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17796:x1872758530830976:12345-192.168.203.49@tcp:101:ls.0 Request processed in 14237us (14407us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.194150:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23696 00000004:00080000:1.0:1786002508.194216:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 759 rpc_version 759 00000020:00100000:1.0:1786002508.194241:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002508.194248:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2454c3480 x1872758560895616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002508.194266:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560895616:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002508.194302:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002508.194329:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40600 going to sleep for 11 seconds 00000100:00100000:0.0:1786002508.194818:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560895616 00000100:00100000:0.0:1786002508.194824:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560895616 00000100:00100000:0.0:1786002508.194892:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3615 00000100:00100000:0.0:1786002508.194900:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:7466:x1872758560895616:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002508.195020:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:7466:x1872758560895616:12345-0@lo:1000:osp_up0-1.0 Request processed in 120us (717us total) trans 4294983487 rc 0/0 00000100:00100000:0.0:1786002508.195028:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3615 00000100:00100000:3.0:1786002508.195099:0:7466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983486 gen 2 00000004:00080000:3.0:1786002508.195105:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983483 committed transno 4294983486 00000020:00080000:3.0:1786002508.195109:0:7466:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed36e7abd80 refcount 2 committed 0 result 0 batchid 401 00000020:00080000:3.0:1786002508.195113:0:7466:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebec00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36e7ab480 00000020:00080000:3.0:1786002508.195117:0:7466:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].397 00000020:00080000:3.0:1786002508.195119:0:7466:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebe000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245da4800 00000020:00080000:3.0:1786002508.195122:0:7466:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].398 00000004:00080000:3.0:1786002508.195146:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983484 committed transno 4294983486 00000004:00080000:3.0:1786002508.195155:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983485 committed transno 4294983486 00000004:00080000:3.0:1786002508.195162:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983486 committed transno 4294983486 00000100:00100000:3.0:1786002508.195172:0:7466:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed2454c3480 x1872758560895616/t4294983487(4294983487) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1786002524 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786002508.195187:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560895616:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1786002508.195207:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 760 rpc_version 760 00000020:00100000:3.0:1786002508.195219:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002508.195223:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244ffad80 x1872758560895872/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002508.195236:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560895872:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002508.195272:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002508.195291:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf180 going to sleep for 11 seconds 00000100:00100000:3.0:1786002508.195304:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560895872 00000100:00100000:3.0:1786002508.195307:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560895872 00000100:00100000:3.0:1786002508.195332:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3616 00000100:00100000:3.0:1786002508.195338:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:7466:x1872758560895872:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002508.195559:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:7466:x1872758560895872:12345-0@lo:1000:osp_up0-1.0 Request processed in 220us (296us total) trans 4294983488 rc 0/0 00000100:00100000:3.0:1786002508.195566:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3616 00000100:00100000:3.0:1786002508.195598:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560895872:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1786002508.195699:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 401 committed batchid 400 00000020:00080000:0.0:1786002508.195727:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 400 00000100:00100000:1.0:1786002508.235319:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.235820:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530831104 00000100:00100000:3.0:1786002508.235830:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530831104 00000100:00100000:3.0:1786002508.235924:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5013 00000100:00100000:3.0:1786002508.235935:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:17796:x1872758530831104:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:1.0:1786002508.240009:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:17796:x1872758530831104:12345-192.168.203.49@tcp:37:ls.0 Request processed in 4066us (4688us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.240022:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5013 00000100:00100000:0.0:1786002508.264923:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.264985:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530831232 00000100:00100000:1.0:1786002508.264995:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530831232 00000100:00100000:1.0:1786002508.265046:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5014 00000100:00100000:1.0:1786002508.265056:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b54bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17796:x1872758530831232:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:0.0:1786002508.270115:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b54bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17796:x1872758530831232:12345-192.168.203.49@tcp:37:ls.0 Request processed in 5051us (5191us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.270127:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5014 00000100:00100000:3.0:1786002508.281818:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.282335:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530831488 00000100:00100000:1.0:1786002508.282345:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530831488 00000100:00100000:1.0:1786002508.282406:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23697 00000100:00100000:1.0:1786002508.282416:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:17796:x1872758530831488:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002508.282434:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002508.282451:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578413830 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a645 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282509:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413837 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282532:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413837 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282542:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413837 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282559:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af57841383e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282566:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af57841383e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282571:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af57841383e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282615:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413845 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282623:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413845 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282629:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413845 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282642:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413837 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282649:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413837 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282656:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413837 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282663:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413837 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282669:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002508.282673:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413837 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282680:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413837 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282691:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:1.0:1786002508.282694:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002508.282698:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413837 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282705:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413837 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282717:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af57841383e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282723:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af57841383e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282730:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af57841383e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282735:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002508.282738:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af57841383e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282744:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af57841383e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282750:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x3115f8b0 (ffff9ed35363db00) 00010000:00010000:1.0:1786002508.282753:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002508.282756:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af57841383e lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282765:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af57841383e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282795:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578413830 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a645 expref: 15 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282808:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413845 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a645 expref: 14 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.282816:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6d:0x0].0x0 (ffff9ed35363d900) 00010000:00010000:1.0:1786002508.282818:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002508.282820:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fc00, rc 0) 00000100:00100000:1.0:1786002508.282900:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:17796:x1872758530831488:12345-192.168.203.49@tcp:101:ls.0 Request processed in 484us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.282907:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23697 00000100:00100000:2.0:1786002508.290055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.290115:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530831744 00000100:00100000:3.0:1786002508.290123:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530831744 00000100:00100000:3.0:1786002508.290178:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23698 00000100:00100000:3.0:1786002508.290188:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:17796:x1872758530831744:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.290213:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.290234:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af57841384c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a64c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002508.290368:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6d:0x0]: returning size 4096 00010000:00010000:3.0:1786002508.290464:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af57841384c lrc: 1/0,0 mode: --/CR res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a64c expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.290476:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6d:0x0].0x0 (ffff9ed245fed800) 00010000:00010000:3.0:1786002508.290479:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002508.290483:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af57841384c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a64c expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.290500:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b200, rc 0) 00000100:00100000:3.0:1786002508.290554:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17796:x1872758530831744:12345-192.168.203.49@tcp:101:ls.0 Request processed in 367us (507us total) trans 4294968463 rc 301/301 00000100:00100000:3.0:1786002508.290560:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23698 00000100:00100000:3.0:1786002508.301562:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002508.301632:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530831872 00000100:00100000:2.0:1786002508.301642:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530831872 00000100:00100000:2.0:1786002508.301702:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23699 00000100:00100000:2.0:1786002508.301714:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:17796:x1872758530831872:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002508.301741:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002508.301762:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af57841385a lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a653 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.301823:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578413861 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.301837:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578413861 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.301879:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578413861 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002508.301960:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6d:0x0]: returning size 4096 00000004:00200000:2.0:1786002508.301965:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1786002508.301987:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578413861 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.302014:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af57841385a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a653 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.302038:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578413861 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a653 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.302046:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6d:0x0].0x0 (ffff9ed24556e800) 00010000:00010000:2.0:1786002508.302049:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002508.302053:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229a00, rc 0) 00000100:00100000:2.0:1786002508.302102:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:17796:x1872758530831872:12345-192.168.203.49@tcp:101:ls.0 Request processed in 391us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002508.302109:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23699 00000100:00100000:2.0:1786002508.305838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.306096:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530832000 00000100:00100000:3.0:1786002508.306105:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530832000 00000100:00100000:3.0:1786002508.306153:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23700 00000100:00100000:3.0:1786002508.306162:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:17796:x1872758530832000:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.306181:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.306215:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413868 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a65a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.306266:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af57841386f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.306283:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af57841386f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.306294:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af57841386f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002508.306333:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x3c:0x0]: returning size 4096 00000004:00200000:3.0:1786002508.306338:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002508.306369:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413868 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a65a expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.306398:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af57841386f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a65a expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.306406:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x3c:0x0].0x0 (ffff9ed245fed300) 00010000:00010000:3.0:1786002508.306409:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002508.306413:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5bc00, rc 0) 00000100:00100000:3.0:1786002508.306464:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17796:x1872758530832000:12345-192.168.203.49@tcp:101:ls.0 Request processed in 302us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.306471:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23700 00000100:00100000:3.0:1786002508.311229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.311342:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530832128 00000100:00100000:0.0:1786002508.311350:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530832128 00000100:00100000:0.0:1786002508.311415:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23701 00000100:00100000:0.0:1786002508.311425:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:17796:x1872758530832128:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002508.311442:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002508.311463:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578413876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a661 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.311532:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af57841387d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.311548:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af57841387d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.311559:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af57841387d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002508.311601:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 4096 00000004:00200000:0.0:1786002508.311606:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786002508.311641:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578413876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a661 expref: 16 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.311656:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af57841387d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a661 expref: 15 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.311664:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9ed2456ef600) 00010000:00010000:0.0:1786002508.311667:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002508.311670:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47200, rc 0) 00000100:00100000:0.0:1786002508.311724:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:17796:x1872758530832128:12345-192.168.203.49@tcp:101:ls.0 Request processed in 301us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.311732:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23701 00000100:00100000:3.0:1786002508.330874:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.331767:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530832256 00000100:00100000:1.0:1786002508.331777:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530832256 00000100:00100000:1.0:1786002508.331824:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5015 00000100:00100000:1.0:1786002508.331833:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17796:x1872758530832256:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:3.0:1786002508.338937:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17796:x1872758530832256:12345-192.168.203.49@tcp:37:ls.0 Request processed in 7095us (8088us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.338950:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5015 00000100:00100000:3.0:1786002508.380820:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.390176:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530832384 00000100:00100000:0.0:1786002508.390197:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530832384 00000100:00100000:0.0:1786002508.390253:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5016 00000100:00100000:0.0:1786002508.390263:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:17796:x1872758530832384:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:2.0:1786002508.406702:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:17796:x1872758530832384:12345-192.168.203.49@tcp:37:ls.0 Request processed in 16433us (25882us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002508.406714:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5016 00000100:00100000:1.0:1786002508.418024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.418219:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530832640 00000100:00100000:3.0:1786002508.418229:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530832640 00000100:00100000:3.0:1786002508.418286:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5017 00000100:00100000:3.0:1786002508.418295:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:17796:x1872758530832640:12345-192.168.203.49@tcp:35:ls.0 00000040:00080000:3.0:1786002508.418682:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].399, 344 off606464 00000040:00080000:3.0:1786002508.418730:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].398, 424 off654480 00000004:00080000:3.0:1786002508.418737:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed36faafd80 with version 761 00000004:00080000:2.0:1786002508.418873:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 761 rpc_version 761 00000020:00100000:2.0:1786002508.418903:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002508.418911:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2457f2300 x1872758560896128/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002508.418933:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f2300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560896128:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002508.418980:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002508.419010:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560896128 00000100:00100000:3.0:1786002508.419014:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560896128 00000100:00100000:2.0:1786002508.419033:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002508.419043:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3617 00000100:00100000:3.0:1786002508.419050:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:7466:x1872758560896128:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002508.419295:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:7466:x1872758560896128:12345-0@lo:1000:osp_up0-1.0 Request processed in 245us (312us total) trans 4294983489 rc 0/0 00000100:00100000:3.0:1786002508.419303:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3617 00000100:00100000:2.0:1786002508.419373:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f2300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560896128:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002508.419462:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:17796:x1872758530832640:12345-192.168.203.49@tcp:35:ls.0 Request processed in 1167us (1447us total) trans 4294968464 rc 0/0 00000100:00100000:3.0:1786002508.419469:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5017 00000100:00100000:3.0:1786002508.424929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.425015:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530832896 00000100:00100000:1.0:1786002508.425024:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530832896 00000100:00100000:1.0:1786002508.425088:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23702 00000100:00100000:1.0:1786002508.425098:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:17796:x1872758530832896:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002508.425120:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002508.425140:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413884 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a668 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425227:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af57841388b lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425241:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af57841388b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425253:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af57841388b lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425268:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413892 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425276:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413892 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425283:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413892 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002508.425414:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x72:0x0]: returning size 4096 00010000:00010000:1.0:1786002508.425486:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af57841388b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425500:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af57841388b lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425507:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af57841388b lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425519:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af57841388b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425525:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002508.425530:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af57841388b lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425537:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af57841388b lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425548:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:1.0:1786002508.425551:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002508.425554:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af57841388b lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425561:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af57841388b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425572:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413892 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425578:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413892 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425583:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413892 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425587:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002508.425590:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413892 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425595:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413892 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425600:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x94df4dce (ffff9ed35363db00) 00010000:00010000:1.0:1786002508.425602:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002508.425605:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413892 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425610:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413892 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425645:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413884 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a668 expref: 14 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425654:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:1.0:1786002508.425656:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002508.425660:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413884 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a668 expref: 14 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.425668:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f000, rc 0) 00000100:00100000:1.0:1786002508.425730:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:17796:x1872758530832896:12345-192.168.203.49@tcp:101:ls.0 Request processed in 634us (810us total) trans 4294968465 rc 301/301 00000100:00100000:1.0:1786002508.425738:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23702 00000100:00100000:1.0:1786002508.445331:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.445405:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530833024 00000100:00100000:3.0:1786002508.445414:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530833024 00000100:00100000:3.0:1786002508.445464:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23703 00000100:00100000:3.0:1786002508.445483:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:17796:x1872758530833024:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.445505:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.445533:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784138a0 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a66f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.445618:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784138a7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.445645:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784138a7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.445656:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784138a7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002508.445721:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x72:0x0]: returning size 4096 00000004:00200000:3.0:1786002508.445726:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1786002508.445743:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784138a7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.445766:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784138a0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x72:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a66f expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.445781:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784138a7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x72:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a66f expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.445790:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x72:0x0].0x0 (ffff9ed245fed800) 00010000:00010000:3.0:1786002508.445793:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786002508.445796:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b200, rc 0) 00000100:00100000:3.0:1786002508.445893:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:17796:x1872758530833024:12345-192.168.203.49@tcp:101:ls.0 Request processed in 411us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.445900:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23703 00000100:00100000:2.0:1786002508.455616:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.455712:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530833152 00000100:00100000:3.0:1786002508.455721:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530833152 00000100:00100000:3.0:1786002508.455776:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23704 00000100:00100000:3.0:1786002508.455786:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:17796:x1872758530833152:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.455806:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.455826:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784138ae lrc: 2/0,0 mode: --/CR res: [0x240000400:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a676 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.456087:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784138b5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.456102:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784138b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.456113:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784138b5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002508.456158:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x3e:0x0]: returning size 4096 00000004:00200000:2.0:1786002508.456164:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002508.456210:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af5784138ae lrc: 0/0,0 mode: --/CR res: [0x240000400:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a676 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.456228:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784138b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a676 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.456241:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x3e:0x0].0x0 (ffff9ed245fed100) 00010000:00010000:2.0:1786002508.456245:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002508.456248:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229400, rc 0) 00000100:00100000:2.0:1786002508.456343:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:17796:x1872758530833152:12345-192.168.203.49@tcp:101:ls.0 Request processed in 558us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002508.456351:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23704 00000100:00100000:1.0:1786002508.470888:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.470957:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530833280 00000100:00100000:3.0:1786002508.470966:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530833280 00000100:00100000:3.0:1786002508.471022:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23705 00000100:00100000:3.0:1786002508.471033:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:17796:x1872758530833280:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.471052:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.471085:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af5784138bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a67d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.471138:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784138c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.471151:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784138c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.471162:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784138c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002508.471214:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 4096 00000004:00200000:3.0:1786002508.471219:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002508.471250:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af5784138bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a67d expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.471266:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784138c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a67d expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.471274:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9ed245fed600) 00010000:00010000:3.0:1786002508.471277:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002508.471281:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a200, rc 0) 00000100:00100000:3.0:1786002508.471332:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17796:x1872758530833280:12345-192.168.203.49@tcp:101:ls.0 Request processed in 302us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.471338:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23705 00000100:00100000:2.0:1786002508.490142:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.490330:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530833408 00000100:00100000:0.0:1786002508.490344:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530833408 00000100:00100000:0.0:1786002508.490407:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5018 00000100:00100000:0.0:1786002508.490419:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:17796:x1872758530833408:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:0.0:1786002508.498677:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:17796:x1872758530833408:12345-192.168.203.49@tcp:37:ls.0 Request processed in 8249us (8533us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.498690:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5018 00000100:00100000:1.0:1786002508.504948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.505028:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530833536 00000100:00100000:3.0:1786002508.505038:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530833536 00000100:00100000:3.0:1786002508.505098:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5019 00000100:00100000:3.0:1786002508.505108:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b549050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17796:x1872758530833536:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:3.0:1786002508.510449:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b549050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17796:x1872758530833536:12345-192.168.203.49@tcp:37:ls.0 Request processed in 5333us (5500us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.510463:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5019 00000100:00100000:2.0:1786002508.521576:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.521712:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530833792 00000100:00100000:0.0:1786002508.521721:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530833792 00000100:00100000:0.0:1786002508.521779:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5020 00000100:00100000:0.0:1786002508.521789:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:17796:x1872758530833792:12345-192.168.203.49@tcp:35:ls.0 00000040:00080000:0.0:1786002508.522067:0:14493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].400, 344 off606808 00000040:00080000:0.0:1786002508.522113:0:14493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].399, 424 off654904 00000004:00080000:0.0:1786002508.522118:0:14493:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed2456d8300 with version 762 00000004:00080000:3.0:1786002508.522181:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 762 rpc_version 762 00000020:00100000:3.0:1786002508.522218:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002508.522227:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244ff9180 x1872758560896384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002508.522249:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560896384:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002508.522301:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002508.522356:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf840 going to sleep for 11 seconds 00000100:00100000:0.0:1786002508.522499:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560896384 00000100:00100000:0.0:1786002508.522504:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560896384 00000100:00100000:0.0:1786002508.522551:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3618 00000100:00100000:0.0:1786002508.522558:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:7466:x1872758560896384:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002508.522693:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:7466:x1872758560896384:12345-0@lo:1000:osp_up0-1.0 Request processed in 135us (391us total) trans 4294983490 rc 0/0 00000100:00100000:0.0:1786002508.522701:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3618 00000100:00100000:0.0:1786002508.522751:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560896384:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002508.522828:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17796:x1872758530833792:12345-192.168.203.49@tcp:35:ls.0 Request processed in 1041us (1262us total) trans 4294968466 rc 0/0 00000100:00100000:0.0:1786002508.522836:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5020 00000100:00100000:1.0:1786002508.526317:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.526782:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530834048 00000100:00100000:0.0:1786002508.526790:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530834048 00000100:00100000:0.0:1786002508.526886:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23706 00000100:00100000:0.0:1786002508.526897:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17796:x1872758530834048:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002508.526916:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002508.526934:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784138ca lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a684 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.526996:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784138d1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.527010:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784138d1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.527019:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784138d1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.527032:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af5784138d8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.527039:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af5784138d8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.527045:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af5784138d8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002508.527147:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x141d:0x0]: returning size 4096 00010000:00010000:0.0:1786002508.528821:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784138d1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.528836:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784138d1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.528843:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784138d1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529069:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784138d1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529075:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002508.529079:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784138d1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529087:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784138d1 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529100:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:0.0:1786002508.529103:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002508.529108:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784138d1 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529114:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784138d1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529128:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af5784138d8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529134:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af5784138d8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529139:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af5784138d8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529144:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002508.529147:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af5784138d8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529156:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af5784138d8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529163:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xee075455 (ffff9ed2456ef500) 00010000:00010000:0.0:1786002508.529165:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002508.529168:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af5784138d8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529174:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af5784138d8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529493:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784138ca lrc: 1/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a684 expref: 18 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529505:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:0.0:1786002508.529508:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002508.529565:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784138ca lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a684 expref: 18 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.529577:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46e00, rc 0) 00000100:00100000:0.0:1786002508.529689:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:17796:x1872758530834048:12345-192.168.203.49@tcp:101:ls.0 Request processed in 2792us (3378us total) trans 4294983491 rc 301/301 00000100:00100000:0.0:1786002508.529698:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23706 00000100:00100000:2.0:1786002508.535609:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.535716:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530834176 00000100:00100000:0.0:1786002508.535725:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530834176 00000100:00100000:0.0:1786002508.535781:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23707 00000100:00100000:0.0:1786002508.535792:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:17796:x1872758530834176:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002508.535818:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002508.535838:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784138e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x141d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a68b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.535963:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af5784138ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x141d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.535977:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af5784138ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x141d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.535988:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af5784138ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x141d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002508.536056:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x141d:0x0]: returning size 4096 00000004:00200000:0.0:1786002508.536061:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1786002508.536080:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af5784138ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x141d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.536103:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784138e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x141d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a68b expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.536120:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af5784138ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x141d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a68b expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.536128:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x141d:0x0].0x0 (ffff9ed2456efc00) 00010000:00010000:0.0:1786002508.536130:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786002508.536133:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46000, rc 0) 00000100:00100000:0.0:1786002508.536180:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530834176:12345-192.168.203.49@tcp:101:ls.0 Request processed in 390us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.536199:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23707 00000100:00100000:2.0:1786002508.540319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.540404:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530834304 00000100:00100000:1.0:1786002508.540412:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530834304 00000100:00100000:1.0:1786002508.540471:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23708 00000100:00100000:1.0:1786002508.540481:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530834304:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002508.540499:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002508.540674:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af5784138f4 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a692 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.540736:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784138fb lrc: 3/1,0 mode: --/PR res: [0x200000400:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.540748:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784138fb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.540760:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784138fb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002508.540803:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x4b:0x0]: returning size 4096 00000004:00200000:1.0:1786002508.540809:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786002508.540841:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af5784138f4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a692 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.540886:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784138fb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a692 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.540895:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x4b:0x0].0x0 (ffff9ed35363db00) 00010000:00010000:1.0:1786002508.540898:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002508.540901:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fe00, rc 0) 00000100:00100000:1.0:1786002508.540958:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:17796:x1872758530834304:12345-192.168.203.49@tcp:101:ls.0 Request processed in 478us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.540965:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23708 00000100:00100000:1.0:1786002508.544101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.544165:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530834432 00000100:00100000:0.0:1786002508.544173:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530834432 00000100:00100000:0.0:1786002508.544231:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23709 00000100:00100000:0.0:1786002508.544240:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:17796:x1872758530834432:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002508.544266:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002508.544285:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46a00/0x7cee4af578413902 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a699 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.544339:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af578413909 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.544351:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af578413909 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.544361:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af578413909 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002508.544417:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x4b:0x0]: returning size 4096 00000004:00200000:0.0:1786002508.544422:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786002508.544455:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46a00/0x7cee4af578413902 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a699 expref: 18 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.544469:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af578413909 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a699 expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.544477:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x4b:0x0].0x0 (ffff9ed2456ef500) 00010000:00010000:0.0:1786002508.544480:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002508.544483:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46e00, rc 0) 00000100:00100000:0.0:1786002508.544547:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:17796:x1872758530834432:12345-192.168.203.49@tcp:101:ls.0 Request processed in 307us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.544554:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23709 00000100:00100000:2.0:1786002508.551828:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.552019:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530834560 00000100:00100000:3.0:1786002508.552030:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530834560 00000100:00100000:3.0:1786002508.552081:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5021 00000100:00100000:3.0:1786002508.552090:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:17796:x1872758530834560:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:2.0:1786002508.558480:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:17796:x1872758530834560:12345-192.168.203.49@tcp:37:ls.0 Request processed in 6381us (6651us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002508.558494:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5021 00000100:00100000:1.0:1786002508.565935:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.566018:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530834688 00000100:00100000:0.0:1786002508.566028:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530834688 00000100:00100000:0.0:1786002508.567239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5022 00000100:00100000:0.0:1786002508.567254:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:17796:x1872758530834688:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:1.0:1786002508.572245:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:17796:x1872758530834688:12345-192.168.203.49@tcp:37:ls.0 Request processed in 4988us (6310us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.572262:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5022 00000100:00100000:1.0:1786002508.576399:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002508.576538:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530834944 00000100:00100000:2.0:1786002508.576547:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530834944 00000100:00100000:2.0:1786002508.576967:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5023 00000100:00100000:2.0:1786002508.576978:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:17796:x1872758530834944:12345-192.168.203.49@tcp:35:ls.0 00000040:00080000:2.0:1786002508.577341:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].393, 344 off593736 00000040:00080000:2.0:1786002508.577394:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].392, 424 off642712 00000004:00080000:2.0:1786002508.577400:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245d3fb40 with version 749 00000004:00080000:3.0:1786002508.577463:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 749 rpc_version 749 00000020:00100000:3.0:1786002508.577489:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002508.577497:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244ffbb80 x1872758560896640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002508.577533:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560896640:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002508.577956:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002508.578010:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf900 going to sleep for 11 seconds 00000100:00100000:1.0:1786002508.578271:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560896640 00000100:00100000:1.0:1786002508.578277:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560896640 00000100:00100000:1.0:1786002508.578316:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3619 00000100:00100000:1.0:1786002508.578324:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b580450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1872758560896640:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002508.578481:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b580450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560896640:12345-0@lo:1000:osp_up1-0.0 Request processed in 157us (525us total) trans 4294968467 rc 0/0 00000100:00100000:1.0:1786002508.578488:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3619 00000100:00100000:0.0:1786002508.578702:0:7805:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968462 gen 2 00000004:00080000:0.0:1786002508.578708:0:7805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968461 committed transno 4294968462 00000020:00080000:0.0:1786002508.578713:0:7805:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2456d8780 refcount 2 committed 0 result 0 batchid 397 00000020:00080000:0.0:1786002508.578717:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed243d19e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2456d8cc0 00000020:00080000:0.0:1786002508.578720:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].391 00000020:00080000:0.0:1786002508.578723:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed243d19600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245da4e00 00000020:00080000:0.0:1786002508.578725:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].392 00000004:00080000:0.0:1786002508.578747:0:7805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968462 committed transno 4294968462 00000100:00100000:0.0:1786002508.578759:0:7805:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed244ffbb80 x1872758560896640/t4294968467(4294968467) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 1786002524 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786002508.578779:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560896640:0@lo:1000:osp_up1-0.0 00000020:00080000:2.0:1786002508.579010:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 397 committed batchid 396 00000020:00080000:2.0:1786002508.579040:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 396 00000100:00100000:2.0:1786002508.579142:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:17796:x1872758530834944:12345-192.168.203.49@tcp:35:ls.0 Request processed in 2164us (2749us total) trans 4294983492 rc 0/0 00000100:00100000:2.0:1786002508.579153:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5023 00000100:00100000:3.0:1786002508.584200:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002508.584508:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530835200 00000100:00100000:2.0:1786002508.584523:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530835200 00000100:00100000:2.0:1786002508.584581:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23710 00000100:00100000:2.0:1786002508.584590:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:17796:x1872758530835200:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002508.584608:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002508.584625:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413910 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6a0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.584691:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413917 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.584704:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413917 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.584714:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413917 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.584727:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841391e lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.584734:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841391e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.584740:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841391e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002508.584844:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x90:0x0]: returning size 4096 00010000:00010000:2.0:1786002508.584956:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413917 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.584967:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413917 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.584972:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413917 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.584978:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413917 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.584985:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002508.584990:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413917 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.584998:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413917 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.585008:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:2.0:1786002508.585011:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002508.585015:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413917 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.585021:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413917 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.585033:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841391e lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.585039:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841391e lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.585046:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841391e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.585051:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002508.585053:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841391e lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.585058:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841391e lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.585065:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xce6cbcc (ffff9ed24556ec00) 00010000:00010000:2.0:1786002508.585067:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002508.585070:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841391e lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.585076:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841391e lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.585111:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413910 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6a0 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.585121:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:2.0:1786002508.585124:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002508.585127:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413910 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6a0 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.585137:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228e00, rc 0) 00000100:00100000:2.0:1786002508.585381:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530835200:12345-192.168.203.49@tcp:101:ls.0 Request processed in 791us (1194us total) trans 4294968468 rc 301/301 00000100:00100000:2.0:1786002508.585389:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23710 00000100:00100000:0.0:1786002508.592933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.593010:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530835328 00000100:00100000:1.0:1786002508.593020:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530835328 00000100:00100000:1.0:1786002508.593082:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23711 00000100:00100000:1.0:1786002508.593092:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530835328:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002508.593114:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002508.593136:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ec00/0x7cee4af57841392c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x90:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.593238:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578413933 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.593251:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578413933 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.593261:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578413933 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002508.593322:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x90:0x0]: returning size 4096 00000004:00200000:1.0:1786002508.593327:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1786002508.593344:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578413933 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.593368:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ec00/0x7cee4af57841392c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x90:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6a7 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.593394:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578413933 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6a7 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.593403:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x90:0x0].0x0 (ffff9ed35363d100) 00010000:00010000:1.0:1786002508.593406:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786002508.593409:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e000, rc 0) 00000100:00100000:1.0:1786002508.593459:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:17796:x1872758530835328:12345-192.168.203.49@tcp:101:ls.0 Request processed in 370us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.593466:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23711 00000100:00100000:1.0:1786002508.605928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002508.605999:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530835456 00000100:00100000:2.0:1786002508.606009:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530835456 00000100:00100000:2.0:1786002508.606072:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23712 00000100:00100000:2.0:1786002508.606081:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:17796:x1872758530835456:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002508.606101:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002508.606120:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841393a lrc: 2/0,0 mode: --/CR res: [0x240000400:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6ae expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.606175:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af578413941 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.606187:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af578413941 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.606209:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af578413941 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002508.606248:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x4d:0x0]: returning size 4096 00000004:00200000:2.0:1786002508.606253:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002508.606285:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841393a lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ae expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.606302:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af578413941 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ae expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.606310:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4d:0x0].0x0 (ffff9ed24556ec00) 00010000:00010000:2.0:1786002508.606313:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002508.606316:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228600, rc 0) 00000100:00100000:2.0:1786002508.606364:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:17796:x1872758530835456:12345-192.168.203.49@tcp:101:ls.0 Request processed in 283us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002508.606373:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23712 00000100:00100000:3.0:1786002508.610178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.610356:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530835584 00000100:00100000:1.0:1786002508.610365:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530835584 00000100:00100000:1.0:1786002508.610425:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23713 00000100:00100000:1.0:1786002508.610434:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:17796:x1872758530835584:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002508.610455:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002508.610475:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578413948 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6b5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.610523:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841394f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.610535:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841394f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.610550:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841394f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002508.610602:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 4096 00000004:00200000:1.0:1786002508.610607:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1786002508.610640:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578413948 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6b5 expref: 22 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.610656:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841394f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6b5 expref: 21 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.610664:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9ed35363d700) 00010000:00010000:1.0:1786002508.610667:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002508.610670:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fa00, rc 0) 00000100:00100000:1.0:1786002508.610726:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:17796:x1872758530835584:12345-192.168.203.49@tcp:101:ls.0 Request processed in 292us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.610733:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23713 00000100:00100000:0.0:1786002508.626959:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.627043:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530835712 00000100:00100000:1.0:1786002508.627053:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530835712 00000100:00100000:1.0:1786002508.627118:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5024 00000100:00100000:1.0:1786002508.627129:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b54a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:17796:x1872758530835712:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:1.0:1786002508.634286:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b54a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:17796:x1872758530835712:12345-192.168.203.49@tcp:37:ls.0 Request processed in 7149us (7324us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.634298:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5024 00000100:00100000:3.0:1786002508.638234:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002508.638454:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530835840 00000100:00100000:2.0:1786002508.638463:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530835840 00000100:00100000:2.0:1786002508.638513:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5025 00000100:00100000:2.0:1786002508.638522:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:17796:x1872758530835840:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:3.0:1786002508.643090:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:17796:x1872758530835840:12345-192.168.203.49@tcp:37:ls.0 Request processed in 4561us (4854us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.643103:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5025 00000100:00100000:1.0:1786002508.649776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.649901:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530836096 00000100:00100000:0.0:1786002508.649910:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530836096 00000100:00100000:0.0:1786002508.649962:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5026 00000100:00100000:0.0:1786002508.649972:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:17796:x1872758530836096:12345-192.168.203.49@tcp:35:ls.0 00000040:00080000:0.0:1786002508.650236:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].401, 344 off607152 00000040:00080000:0.0:1786002508.650278:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].400, 424 off655328 00000004:00080000:0.0:1786002508.650283:0:6523:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed36e7ab300 with version 763 00000004:00080000:3.0:1786002508.651014:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 763 rpc_version 763 00000020:00100000:2.0:1786002508.651163:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002508.651173:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2465ff480 x1872758560896896/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002508.651246:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465ff480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560896896:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002508.651300:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002508.651401:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f480 going to sleep for 11 seconds 00000100:00100000:0.0:1786002508.651657:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560896896 00000100:00100000:0.0:1786002508.651662:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560896896 00000100:00100000:0.0:1786002508.651733:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3620 00000100:00100000:0.0:1786002508.651742:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:7466:x1872758560896896:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002508.651916:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:7466:x1872758560896896:12345-0@lo:1000:osp_up0-1.0 Request processed in 175us (615us total) trans 4294983493 rc 0/0 00000100:00100000:0.0:1786002508.651924:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3620 00000100:00100000:2.0:1786002508.652036:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465ff480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560896896:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002508.652163:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:17796:x1872758530836096:12345-192.168.203.49@tcp:35:ls.0 Request processed in 2190us (2393us total) trans 4294968469 rc 0/0 00000100:00100000:1.0:1786002508.652172:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5026 00000100:00100000:1.0:1786002508.656238:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002508.656326:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530836352 00000100:00100000:2.0:1786002508.656334:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530836352 00000100:00100000:2.0:1786002508.656392:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23714 00000100:00100000:2.0:1786002508.656401:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:17796:x1872758530836352:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002508.656418:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002508.656436:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413956 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6bc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656496:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841395d lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656508:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841395d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656522:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841395d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656536:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413964 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656543:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413964 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656549:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413964 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656607:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af57841396b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656614:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af57841396b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656620:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af57841396b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656633:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841395d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656640:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841395d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656647:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841395d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656653:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841395d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656664:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002508.656668:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841395d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656674:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841395d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656684:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:2.0:1786002508.656687:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002508.656691:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841395d lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656697:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841395d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656709:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413964 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656715:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413964 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656721:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413964 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656726:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002508.656728:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413964 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656734:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413964 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656744:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xb5c6597d (ffff9ed24556e300) 00010000:00010000:2.0:1786002508.656747:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002508.656749:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413964 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656755:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413964 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656780:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413956 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6bc expref: 23 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656791:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af57841396b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6bc expref: 22 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.656797:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x95:0x0].0x0 (ffff9ed24556e900) 00010000:00010000:2.0:1786002508.656799:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002508.656802:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229200, rc 0) 00000100:00100000:2.0:1786002508.656887:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:17796:x1872758530836352:12345-192.168.203.49@tcp:101:ls.0 Request processed in 487us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002508.656894:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23714 00000100:00100000:2.0:1786002508.660498:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.660705:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530836608 00000100:00100000:3.0:1786002508.660715:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530836608 00000100:00100000:3.0:1786002508.660769:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23715 00000100:00100000:3.0:1786002508.660778:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:17796:x1872758530836608:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.660798:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.660818:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af578413972 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6c3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002508.661138:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x95:0x0]: returning size 4096 00010000:00010000:2.0:1786002508.661332:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af578413972 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6c3 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.661347:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x95:0x0].0x0 (ffff9ed245fed200) 00010000:00010000:2.0:1786002508.661350:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002508.661356:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af578413972 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6c3 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.661386:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5be00, rc 0) 00000100:00100000:2.0:1786002508.661442:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:17796:x1872758530836608:12345-192.168.203.49@tcp:101:ls.0 Request processed in 665us (952us total) trans 4294968470 rc 301/301 00000100:00100000:2.0:1786002508.661449:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23715 00000100:00100000:1.0:1786002508.665332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.665403:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530836736 00000100:00100000:3.0:1786002508.665412:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530836736 00000100:00100000:3.0:1786002508.665460:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23716 00000100:00100000:3.0:1786002508.665469:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:17796:x1872758530836736:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.665490:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.665508:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413980 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6ca expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.665570:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413987 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.665706:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413987 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x95:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.665719:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413987 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x95:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002508.665803:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x95:0x0]: returning size 4096 00000004:00200000:3.0:1786002508.665807:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1786002508.665825:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413987 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x95:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.665952:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413980 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ca expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.665974:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413987 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x95:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ca expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.665982:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x95:0x0].0x0 (ffff9ed245fedb00) 00010000:00010000:3.0:1786002508.665985:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002508.665988:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b800, rc 0) 00000100:00100000:3.0:1786002508.666073:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17796:x1872758530836736:12345-192.168.203.49@tcp:101:ls.0 Request processed in 604us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.666080:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23716 00000100:00100000:1.0:1786002508.669450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.669740:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530836864 00000100:00100000:3.0:1786002508.669748:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530836864 00000100:00100000:3.0:1786002508.669821:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23717 00000100:00100000:3.0:1786002508.669829:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17796:x1872758530836864:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.669869:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.669888:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841398e lrc: 2/0,0 mode: --/CR res: [0x240000400:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.669934:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413995 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.669946:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413995 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.669957:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413995 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002508.669996:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x4f:0x0]: returning size 4096 00000004:00200000:3.0:1786002508.670001:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002508.670030:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af57841398e lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d1 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.670045:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413995 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d1 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.670053:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4f:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:3.0:1786002508.670055:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002508.670058:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a600, rc 0) 00000100:00100000:3.0:1786002508.670118:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530836864:12345-192.168.203.49@tcp:101:ls.0 Request processed in 288us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.670126:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23717 00000100:00100000:2.0:1786002508.673355:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.673436:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530836992 00000100:00100000:0.0:1786002508.673444:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530836992 00000100:00100000:0.0:1786002508.673510:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23718 00000100:00100000:0.0:1786002508.673520:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:17796:x1872758530836992:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002508.673537:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002508.673559:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af57841399c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6d8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.673625:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784139a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.673638:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784139a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.673648:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784139a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002508.673686:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 4096 00000004:00200000:0.0:1786002508.673691:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786002508.673726:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af57841399c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d8 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.673742:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784139a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d8 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.673750:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:0.0:1786002508.673754:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002508.673757:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46a00, rc 0) 00000100:00100000:0.0:1786002508.673805:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17796:x1872758530836992:12345-192.168.203.49@tcp:101:ls.0 Request processed in 287us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.673813:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23718 00000100:00100000:2.0:1786002508.680494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.680636:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530837120 00000100:00100000:3.0:1786002508.680645:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530837120 00000100:00100000:3.0:1786002508.680697:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5027 00000100:00100000:3.0:1786002508.680706:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530837120:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:3.0:1786002508.686095:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530837120:12345-192.168.203.49@tcp:37:ls.0 Request processed in 5380us (5600us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.686107:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5027 00000100:00100000:2.0:1786002508.695539:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.695707:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530837248 00000100:00100000:1.0:1786002508.695716:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530837248 00000100:00100000:1.0:1786002508.695766:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5028 00000100:00100000:1.0:1786002508.695775:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17796:x1872758530837248:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:1.0:1786002508.700925:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17796:x1872758530837248:12345-192.168.203.49@tcp:37:ls.0 Request processed in 5141us (5385us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.700938:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5028 00000100:00100000:3.0:1786002508.708746:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002508.708974:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530837504 00000100:00100000:2.0:1786002508.708983:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530837504 00000100:00100000:2.0:1786002508.709085:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5029 00000100:00100000:2.0:1786002508.709095:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b54b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530837504:12345-192.168.203.49@tcp:35:ls.0 00000040:00080000:2.0:1786002508.709331:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].402, 344 off607496 00000040:00080000:2.0:1786002508.709384:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].402, 424 off655784 00000004:00080000:2.0:1786002508.709389:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245d3fcc0 with version 764 00000004:00080000:3.0:1786002508.711268:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 764 rpc_version 764 00000020:00100000:3.0:1786002508.711304:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002508.711314:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244ffa680 x1872758560897152/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1400/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002508.711336:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560897152:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002508.711399:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002508.711455:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002508.711666:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560897152 00000100:00100000:2.0:1786002508.711674:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560897152 00000100:00100000:2.0:1786002508.711718:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3621 00000100:00100000:2.0:1786002508.711727:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:7466:x1872758560897152:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002508.712017:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:7466:x1872758560897152:12345-0@lo:1000:osp_up0-1.0 Request processed in 291us (616us total) trans 4294983494 rc 0/0 00000100:00100000:2.0:1786002508.712025:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3621 00000100:00100000:3.0:1786002508.712216:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560897152:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002508.712431:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b54b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17796:x1872758530837504:12345-192.168.203.49@tcp:35:ls.0 Request processed in 3337us (3692us total) trans 4294968471 rc 0/0 00000100:00100000:2.0:1786002508.712440:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5029 00010000:00010000:0.0:1786002508.714426:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002508.721779:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.721954:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530837760 00000100:00100000:3.0:1786002508.721962:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530837760 00000100:00100000:3.0:1786002508.722020:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23719 00000100:00100000:3.0:1786002508.722030:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17796:x1872758530837760:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.722053:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.722070:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af5784139aa lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.722137:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784139b1 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.722156:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784139b1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.722167:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784139b1 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.722178:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.722200:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784137ab lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137a4 expref: 6 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.722209:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.722240:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784137ab lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af5784137a4 expref: 6 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002508.722255:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758560897280:0@lo:104: 00000100:00100000:3.0:1786002508.722304:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002508.722606:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002508.723062:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560897280 00000100:00100000:2.0:1786002508.723067:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560897280 00000100:00100000:2.0:1786002508.723105:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1786002508.723113:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6520:x1872758560897280:12345-0@lo:104: 00010000:00010000:2.0:1786002508.723124:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784137ab expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.723217:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786002508.723224:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6520:x1872758560897280:12345-0@lo:104: Request processed in 112us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002508.723231:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1786002508.723413:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758560897280:0@lo:104: 00010000:00010000:0.0:1786002508.723431:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.723566:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002508.723572:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784137ab expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.723685:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002508.723690:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7cee4af5784137ab expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.723699:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af5784137ab expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.723728:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137ab expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.723735:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1786002508.723779:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560897408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002508.723814:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786002508.723893:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137ab expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.723901:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed34556a800/0x7cee4af5784137a4 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137ab expref: -99 pid: 20601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.723921:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002508.723923:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002508.723925:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002508.723971:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560897408 00000100:00100000:2.0:1786002508.723976:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560897408 00010000:00010000:2.0:1786002508.723995:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784137ab lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af5784137a4 expref: 7 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002508.724020:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:2.0:1786002508.724026:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed346569450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1872758560897408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002508.724035:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1786002508.726167:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968471 is committed 00000001:00080000:0.0:1786002508.726198:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968467 is committed 00000020:00080000:0.0:1786002508.726210:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 401 batchid updated 00010000:00010000:2.0:1786002508.726326:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784137ab lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x23/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af5784137a4 expref: 6 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.726343:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x95dc2b73 (ffff9ed24556ea00) 00010000:00010000:2.0:1786002508.726348:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.726357:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.726364:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.726402:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002508.726483:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.726491:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002508.726610:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560897536:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786002508.726843:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002508.726900:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8600 going to sleep for 11 seconds 00000020:00080000:1.0:1786002508.726965:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 401 00000004:00080000:1.0:1786002508.727009:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed36fb40c00 with version 765 00000020:00080000:1.0:1786002508.727026:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 401 cancel update log [0x200000401:0x3:0x0].397: rc = 0 00000020:00080000:1.0:1786002508.727091:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 401 cancel update log [0x240000400:0x3:0x0].398: rc = 0 00000020:00080000:1.0:1786002508.727100:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 401 00000004:00080000:0.0:1786002508.727149:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 765 rpc_version 765 00000020:00100000:0.0:1786002508.727165:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002508.727172:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244ff9f80 x1872758560897792/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002508.727195:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560897792:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002508.727222:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002508.727245:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002508.727335:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560897536 00000100:00100000:1.0:1786002508.727341:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560897536 00000100:00100000:1.0:1786002508.727388:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560897792 00000100:00100000:1.0:1786002508.727391:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560897792 00000100:00100000:1.0:1786002508.727412:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3622 00000100:00100000:1.0:1786002508.727420:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:6520:x1872758560897536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1786002508.727491:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:6520:x1872758560897536:12345-0@lo:1000:mdt00_000.0 Request processed in 71us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.727498:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3622 00000100:00100000:1.0:1786002508.727511:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3623 00000100:00100000:1.0:1786002508.727516:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:7466:x1872758560897792:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002508.727611:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:7466:x1872758560897792:12345-0@lo:1000:osp_up0-1.0 Request processed in 94us (388us total) trans 4294983495 rc 0/0 00000100:00100000:1.0:1786002508.727618:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3623 00000100:00100000:1.0:1786002508.727788:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560897792:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002508.727808:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560897536:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1786002508.727877:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f800/0x7cee4af5784139bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x148b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727888:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f800/0x7cee4af5784139bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727896:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f800/0x7cee4af5784139bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727908:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784139b1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727914:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784139b1 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727920:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784139b1 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727925:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784139b1 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727930:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002508.727934:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784139b1 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727940:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784139b1 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727949:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:1.0:1786002508.727951:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002508.727956:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784139b1 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727962:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af5784139b1 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727971:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727976:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727981:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727985:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002508.727988:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727992:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.727999:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x95dc2b73 (ffff9ed24556ea00) 00010000:00010000:1.0:1786002508.728001:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002508.728003:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.728009:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af5784139b8 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.728050:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af5784139aa lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6df expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.728067:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f800/0x7cee4af5784139bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6df expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.728075:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x148b:0x0].0x0 (ffff9ed35363d400) 00010000:00010000:1.0:1786002508.728077:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002508.728079:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f800, rc 0) 00000100:00100000:1.0:1786002508.728120:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530837760:12345-192.168.203.49@tcp:101:ls.0 Request processed in 6092us (6349us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.728127:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23719 00000100:00100000:1.0:1786002508.731756:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.731812:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530838016 00000100:00100000:3.0:1786002508.731820:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530838016 00000100:00100000:2.0:1786002508.731994:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed346569450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560897408:12345-0@lo:103:ldlm_bl.0 Request processed in 7966us (8177us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002508.732006:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:2.0:1786002508.732074:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560897408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002508.732119:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23720 00000100:00100000:3.0:1786002508.732128:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17796:x1872758530838016:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.732145:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.732164:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784139c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x148b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6e6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002508.732304:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x148b:0x0]: returning size 4096 00010000:00010000:3.0:1786002508.732384:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784139c6 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6e6 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.732397:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x148b:0x0].0x0 (ffff9ed245fedc00) 00010000:00010000:3.0:1786002508.732400:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002508.732404:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784139c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6e6 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.732422:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5aa00, rc 0) 00000100:00100000:3.0:1786002508.732464:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530838016:12345-192.168.203.49@tcp:101:ls.0 Request processed in 337us (715us total) trans 4294983496 rc 301/301 00000100:00100000:3.0:1786002508.732470:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23720 00000100:00100000:1.0:1786002508.737047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.737172:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530838144 00000100:00100000:0.0:1786002508.737180:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530838144 00000100:00100000:0.0:1786002508.737241:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23721 00000100:00100000:0.0:1786002508.737250:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530838144:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002508.737271:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002508.737290:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af5784139d4 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6ed expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.737339:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af5784139db lrc: 3/1,0 mode: --/PR res: [0x200000400:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.737352:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af5784139db lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.737362:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af5784139db lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002508.737557:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x82:0x0]: returning size 4096 00000004:00200000:0.0:1786002508.737563:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786002508.737696:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af5784139d4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ed expref: 26 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.737718:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af5784139db lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ed expref: 25 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.737726:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x82:0x0].0x0 (ffff9ed38214d400) 00010000:00010000:0.0:1786002508.737729:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002508.737732:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46c00, rc 0) 00000100:00100000:0.0:1786002508.737786:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17796:x1872758530838144:12345-192.168.203.49@tcp:101:ls.0 Request processed in 536us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.737793:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23721 00000100:00100000:2.0:1786002508.741301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.741447:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530838272 00000100:00100000:1.0:1786002508.741457:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530838272 00000100:00100000:1.0:1786002508.741520:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23722 00000100:00100000:1.0:1786002508.741532:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530838272:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002508.741550:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002508.741571:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784139e2 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742079:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af5784139e9 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742092:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af5784139e9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742103:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af5784139e9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742117:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af5784139e9 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742124:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af5784139e9 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742130:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af5784139e9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742137:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002508.742140:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af5784139e9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742147:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af5784139e9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742158:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed35363dd00) 00010000:00010000:1.0:1786002508.742160:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002508.742165:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af5784139e9 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742171:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af5784139e9 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742278:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784139e2 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6f4 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742289:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed35363dd00) 00010000:00010000:1.0:1786002508.742291:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002508.742295:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784139e2 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6f4 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.742308:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e200, rc 0) 00000100:00100000:1.0:1786002508.742395:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530838272:12345-192.168.203.49@tcp:101:ls.0 Request processed in 866us (1102us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002508.742403:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23722 00000100:00100000:1.0:1786002508.748639:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.748844:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530838400 00000100:00100000:3.0:1786002508.748890:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530838400 00000100:00100000:3.0:1786002508.748946:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23723 00000100:00100000:3.0:1786002508.748956:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17796:x1872758530838400:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.748976:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.748996:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784139f0 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a6fb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.749059:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784139f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x148b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.749071:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784139f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x148b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.749086:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784139f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x148b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002508.749166:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x148b:0x0]: returning size 4096 00000004:00200000:3.0:1786002508.749171:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1786002508.749200:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784139f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x148b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.749223:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784139f0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6fb expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.749247:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784139f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x148b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6fb expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.749256:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x148b:0x0].0x0 (ffff9ed245fed500) 00010000:00010000:3.0:1786002508.749258:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002508.749261:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5ba00, rc 0) 00000100:00100000:3.0:1786002508.749319:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17796:x1872758530838400:12345-192.168.203.49@tcp:101:ls.0 Request processed in 364us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.749326:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23723 00000100:00100000:3.0:1786002508.756090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.756180:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530838528 00000100:00100000:0.0:1786002508.756198:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530838528 00000100:00100000:0.0:1786002508.756260:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23724 00000100:00100000:0.0:1786002508.756271:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530838528:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002508.756291:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002508.756312:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af5784139fe lrc: 2/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a702 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756436:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a05 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756450:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a05 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756461:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a05 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756469:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a05 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756475:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a05 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756481:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a05 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756486:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002508.756490:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a05 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756496:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a05 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756507:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:0.0:1786002508.756510:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002508.756526:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a05 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756533:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a05 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756562:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af5784139fe lrc: 1/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a702 expref: 19 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756573:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:0.0:1786002508.756716:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002508.756722:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af5784139fe lrc: 0/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a702 expref: 19 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.756736:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46400, rc 0) 00000100:00100000:0.0:1786002508.756795:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530838528:12345-192.168.203.49@tcp:101:ls.0 Request processed in 527us (713us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002508.756803:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23724 00000100:00100000:2.0:1786002508.760108:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.760210:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530838656 00000100:00100000:1.0:1786002508.760219:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530838656 00000100:00100000:1.0:1786002508.760305:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23725 00000100:00100000:1.0:1786002508.760315:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530838656:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002508.760334:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002508.760355:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413a0c lrc: 2/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a709 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760479:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413a13 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760492:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413a13 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760502:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413a13 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760525:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413a13 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760532:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413a13 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760543:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413a13 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760549:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002508.760553:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413a13 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760560:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413a13 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760570:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed35363dd00) 00010000:00010000:1.0:1786002508.760757:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002508.760764:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413a13 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760770:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413a13 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760801:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413a0c lrc: 1/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a709 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760812:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed35363dd00) 00010000:00010000:1.0:1786002508.760814:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002508.760818:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413a0c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a709 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.760831:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f000, rc 0) 00000100:00100000:1.0:1786002508.760917:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530838656:12345-192.168.203.49@tcp:101:ls.0 Request processed in 603us (815us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002508.760927:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23725 00000100:00100000:0.0:1786002508.766259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.766363:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530838784 00000100:00100000:3.0:1786002508.766382:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530838784 00000100:00100000:3.0:1786002508.766429:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23726 00000100:00100000:3.0:1786002508.766439:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530838784:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.766458:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.766478:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af578413a1a lrc: 2/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a710 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766617:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413a21 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766631:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413a21 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766641:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413a21 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766651:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413a21 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766657:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413a21 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766664:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413a21 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766671:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002508.766675:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413a21 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766682:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413a21 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766693:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed245fed700) 00010000:00010000:3.0:1786002508.766696:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002508.766701:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413a21 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766707:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413a21 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766738:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af578413a1a lrc: 1/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a710 expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766748:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed245fed700) 00010000:00010000:3.0:1786002508.766751:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002508.766754:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af578413a1a lrc: 0/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a710 expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.766770:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b600, rc 0) 00000100:00100000:3.0:1786002508.766829:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530838784:12345-192.168.203.49@tcp:101:ls.0 Request processed in 391us (578us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002508.766837:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23726 00000100:00100000:0.0:1786002508.775061:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.775147:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530838912 00000100:00100000:1.0:1786002508.775156:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530838912 00000100:00100000:1.0:1786002508.775218:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5030 00000100:00100000:1.0:1786002508.775229:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17796:x1872758530838912:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:1.0:1786002508.787013:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17796:x1872758530838912:12345-192.168.203.49@tcp:37:ls.0 Request processed in 11777us (11950us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.787025:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5030 00000100:00100000:2.0:1786002508.794507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.795047:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530839040 00000100:00100000:0.0:1786002508.795058:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530839040 00000100:00100000:0.0:1786002508.795116:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23727 00000100:00100000:0.0:1786002508.795127:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:17796:x1872758530839040:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002508.795146:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002508.795167:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a28 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a717 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.795209:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a28 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a717 expref: 19 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.795225:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a28 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a717 expref: 19 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.795236:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:0.0:1786002508.795239:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002508.795243:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47a00, rc 0) 00000100:00100000:0.0:1786002508.795296:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:17796:x1872758530839040:12345-192.168.203.49@tcp:101:ls.0 Request processed in 171us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.795303:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23727 00000100:00100000:0.0:1786002508.799175:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002508.799303:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530839168 00000100:00100000:2.0:1786002508.799312:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530839168 00000100:00100000:2.0:1786002508.799367:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5031 00000100:00100000:2.0:1786002508.799385:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:17796:x1872758530839168:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:2.0:1786002508.799822:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:17796:x1872758530839168:12345-192.168.203.49@tcp:37:ls.0 Request processed in 438us (655us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002508.799830:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5031 00000100:00100000:2.0:1786002508.809463:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.810100:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530839424 00000100:00100000:1.0:1786002508.810109:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530839424 00000100:00100000:1.0:1786002508.810149:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5032 00000100:00100000:1.0:1786002508.810157:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17796:x1872758530839424:12345-192.168.203.49@tcp:35:ls.0 00000100:00100000:1.0:1786002508.810455:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17796:x1872758530839424:12345-192.168.203.49@tcp:35:ls.0 Request processed in 297us (1001us total) trans 4294983497 rc 0/0 00000100:00100000:1.0:1786002508.810463:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5032 00000100:00100000:2.0:1786002508.815023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.815097:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530839680 00000100:00100000:3.0:1786002508.815106:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530839680 00000100:00100000:3.0:1786002508.815158:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23728 00000100:00100000:3.0:1786002508.815167:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17796:x1872758530839680:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.815200:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.815220:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413a2f lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a71e expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.815298:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a36 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.815311:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a36 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.815321:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a36 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.815332:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.815341:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784137c7 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137c0 expref: 18 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.815349:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.815387:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784137c7 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af5784137c0 expref: 18 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002508.815403:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560897920:0@lo:104: 00000100:00100000:3.0:1786002508.815446:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002508.815508:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf000 going to sleep for 11 seconds 00000100:00100000:0.0:1786002508.815993:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560897920 00000100:00100000:0.0:1786002508.815998:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560897920 00000100:00100000:0.0:1786002508.816039:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1786002508.816047:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:14496:x1872758560897920:12345-0@lo:104: 00010000:00010000:0.0:1786002508.816059:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af5784137c0 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784137c7 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.816129:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786002508.816135:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:14496:x1872758560897920:12345-0@lo:104: Request processed in 89us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.816142:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1786002508.816513:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560897920:0@lo:104: 00010000:00010000:3.0:1786002508.816530:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.816597:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002508.816604:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af5784137c0 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784137c7 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.816613:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002508.816617:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af5784137c0 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7cee4af5784137c7 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.816624:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af5784137c0 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af5784137c7 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.816657:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af5784137c0 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137c7 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.816663:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002508.816691:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af5784137c0 lrc: 1/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137c7 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.816699:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c47c00/0x7cee4af5784137c0 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137c7 expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.816718:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002508.816721:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002508.816723:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002508.816818:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560898048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002508.816890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002508.817144:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560898048 00000100:00100000:1.0:1786002508.817149:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560898048 00010000:00010000:1.0:1786002508.817170:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784137c7 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af5784137c0 expref: 19 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002508.817295:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00100000:1.0:1786002508.824313:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+19:3644:x1872758560898048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002508.824345:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1786002508.826795:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983497 is committed 00000001:00080000:0.0:1786002508.826809:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983495 is committed 00000020:00080000:0.0:1786002508.826817:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 397 batchid updated 00000020:00080000:2.0:1786002508.826917:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 397 00000004:00080000:2.0:1786002508.826974:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed366d7de40 with version 750 00000020:00080000:2.0:1786002508.826992:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 397 cancel update log [0x240000401:0x3:0x0].391: rc = 0 00000020:00080000:2.0:1786002508.827067:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 397 cancel update log [0x200000400:0x3:0x0].392: rc = 0 00000020:00080000:2.0:1786002508.827076:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 397 00010000:00010000:1.0:1786002508.827193:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784137c7 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x23/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af5784137c0 expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.827211:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xf8280fc8 (ffff9ed243ce3b00) 00010000:00010000:1.0:1786002508.827217:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.827231:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.827239:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.827271:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002508.827354:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3644:x1872758560898048:12345-0@lo:103:ldlm_bl.0 Request processed in 10049us (10462us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.827363:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00010000:00010000:3.0:1786002508.827441:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.827451:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002508.827570:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560898176:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002508.827621:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002508.827649:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf180 going to sleep for 11 seconds 00000100:00100000:2.0:1786002508.827894:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560898048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002508.828019:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560898176 00000100:00100000:1.0:1786002508.828026:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560898176 00000100:00100000:1.0:1786002508.828069:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3624 00000100:00100000:1.0:1786002508.828077:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14496:x1872758560898176:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1786002508.828161:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14496:x1872758560898176:12345-0@lo:1000:mdt00_004.0 Request processed in 84us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.828168:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3624 00000100:00100000:3.0:1786002508.828311:0:14496:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968467 gen 2 00000004:00080000:3.0:1786002508.828316:0:14496:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968467 committed transno 4294968467 00000020:00080000:3.0:1786002508.828321:0:14496:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed245d3f6c0 refcount 2 committed 0 result 0 batchid 398 00000020:00080000:3.0:1786002508.828325:0:14496:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebed00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d3fb40 00000020:00080000:3.0:1786002508.828328:0:14496:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].392 00000020:00080000:3.0:1786002508.828330:0:14496:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d00000 00000020:00080000:3.0:1786002508.828333:0:14496:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].393 00000100:00100000:3.0:1786002508.828355:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560898176:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1786002508.828404:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af578413a44 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x104:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828417:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af578413a44 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828425:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af578413a44 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828437:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a36 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828443:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a36 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828449:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a36 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828455:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a36 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828462:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002508.828465:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a36 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828473:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a36 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828482:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:3.0:1786002508.828485:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002508.828489:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a36 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828494:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a36 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828504:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828509:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1786002508.828662:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 398 committed batchid 397 00000020:00080000:2.0:1786002508.828702:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 397 00010000:00010000:3.0:1786002508.828738:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828743:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002508.828746:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828752:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828761:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xf8280fc8 (ffff9ed243ce3b00) 00010000:00010000:3.0:1786002508.828763:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002508.828766:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828776:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a3d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828820:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413a2f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a71e expref: 25 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828833:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af578413a44 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a71e expref: 24 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.828840:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x104:0x0].0x0 (ffff9ed245fed700) 00010000:00010000:3.0:1786002508.828842:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002508.828875:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5be00, rc 0) 00000100:00100000:3.0:1786002508.828968:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530839680:12345-192.168.203.49@tcp:101:ls.0 Request processed in 13801us (13952us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.828975:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23728 00000004:00080000:0.0:1786002508.829040:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 750 rpc_version 750 00000020:00100000:0.0:1786002508.829061:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002508.829069:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2448fca80 x1872758560898432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002508.829087:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560898432:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002508.829120:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002508.829143:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002508.831087:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560898432 00000100:00100000:1.0:1786002508.831096:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560898432 00000100:00100000:1.0:1786002508.831137:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3625 00000100:00100000:1.0:1786002508.831146:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7805:x1872758560898432:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002508.831299:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7805:x1872758560898432:12345-0@lo:1000:osp_up1-0.0 Request processed in 153us (2177us total) trans 4294968472 rc 0/0 00000100:00100000:1.0:1786002508.831307:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3625 00000100:00100000:3.0:1786002508.831534:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560898432:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002508.845312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.845387:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530839936 00000100:00100000:1.0:1786002508.845397:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530839936 00000100:00100000:1.0:1786002508.845456:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23729 00000100:00100000:1.0:1786002508.845467:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:17796:x1872758530839936:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002508.845487:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002508.845509:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413a4b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x104:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a725 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002508.845683:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x104:0x0]: returning size 4096 00010000:00010000:1.0:1786002508.845771:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413a4b lrc: 1/0,0 mode: --/CR res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a725 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.845785:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x104:0x0].0x0 (ffff9ed35363dd00) 00010000:00010000:1.0:1786002508.845788:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002508.845793:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413a4b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a725 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002508.845810:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f000, rc 0) 00000100:00100000:1.0:1786002508.845904:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:17796:x1872758530839936:12345-192.168.203.49@tcp:101:ls.0 Request processed in 439us (599us total) trans 4294968473 rc 301/301 00000100:00100000:1.0:1786002508.845911:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23729 00000100:00100000:2.0:1786002508.853606:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.853737:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530840064 00000100:00100000:3.0:1786002508.853746:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530840064 00000100:00100000:3.0:1786002508.853804:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23730 00000100:00100000:3.0:1786002508.853816:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:17796:x1872758530840064:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.853839:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.853897:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af578413a59 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a72c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.853954:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a60 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.853971:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a60 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.853984:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a60 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002508.854034:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x86:0x0]: returning size 4096 00000004:00200000:3.0:1786002508.854038:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002508.854073:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b600/0x7cee4af578413a59 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a72c expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.854090:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a72c expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.854098:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x86:0x0].0x0 (ffff9ed245fedc00) 00010000:00010000:3.0:1786002508.854101:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002508.854105:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5aa00, rc 0) 00000100:00100000:3.0:1786002508.854153:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:17796:x1872758530840064:12345-192.168.203.49@tcp:101:ls.0 Request processed in 340us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002508.854160:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23730 00000100:00100000:2.0:1786002508.858165:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.858240:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530840192 00000100:00100000:3.0:1786002508.858250:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530840192 00000100:00100000:3.0:1786002508.858305:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23731 00000100:00100000:3.0:1786002508.858316:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530840192:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.858334:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.858355:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a733 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858463:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413a6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858476:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858486:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858495:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858501:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413a6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858507:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858526:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002508.858531:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858538:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413a6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858549:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002508.858552:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002508.858557:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413a6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858564:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413a6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858768:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a67 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a733 expref: 25 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858777:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002508.858779:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002508.858782:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a733 expref: 25 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.858796:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a000, rc 0) 00000100:00100000:3.0:1786002508.860815:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530840192:12345-192.168.203.49@tcp:101:ls.0 Request processed in 2494us (2651us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002508.860826:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23731 00000100:00100000:0.0:1786002508.865126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002508.865290:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530840320 00000100:00100000:2.0:1786002508.865298:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530840320 00000100:00100000:2.0:1786002508.865356:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23732 00000100:00100000:2.0:1786002508.865374:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:17796:x1872758530840320:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002508.865395:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002508.865416:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413a75 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a73a expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.865490:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578413a7c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x104:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.865503:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578413a7c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x104:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.865787:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578413a7c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x104:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002508.865904:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x104:0x0]: returning size 4096 00000004:00200000:2.0:1786002508.865909:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1786002508.865926:0:10360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578413a7c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x104:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.865951:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413a75 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a73a expref: 23 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.865985:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578413a7c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x104:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a73a expref: 22 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002508.865995:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x104:0x0].0x0 (ffff9ed24556ef00) 00010000:00010000:2.0:1786002508.865998:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002508.866001:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228800, rc 0) 00000100:00100000:2.0:1786002508.866057:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:17796:x1872758530840320:12345-192.168.203.49@tcp:101:ls.0 Request processed in 692us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002508.866065:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23732 00000100:00100000:2.0:1786002508.875302:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.875392:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530840448 00000100:00100000:0.0:1786002508.875401:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530840448 00000100:00100000:0.0:1786002508.875471:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23733 00000100:00100000:0.0:1786002508.875481:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530840448:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002508.875500:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002508.875532:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413a83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a741 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.875887:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.875901:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.875912:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.875921:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.875927:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.875933:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.875939:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002508.875943:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.875950:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.875961:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002508.875964:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002508.875970:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.875975:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.876005:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413a83 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a741 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.876015:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002508.876018:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002508.876021:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413a83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a741 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.876034:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47600, rc 0) 00000100:00100000:0.0:1786002508.876088:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530840448:12345-192.168.203.49@tcp:101:ls.0 Request processed in 609us (795us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002508.876095:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23733 00000100:00100000:0.0:1786002508.896661:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.896787:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530840576 00000100:00100000:3.0:1786002508.896797:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530840576 00000100:00100000:3.0:1786002508.896911:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23734 00000100:00100000:3.0:1786002508.896970:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530840576:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002508.897052:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002508.897074:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413a91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a748 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897179:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897202:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897212:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897223:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897230:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897237:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897243:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002508.897247:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897253:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897264:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002508.897267:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002508.897271:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897276:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413a98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897304:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413a91 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a748 expref: 25 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897313:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002508.897315:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002508.897318:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413a91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a748 expref: 25 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.897331:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47600, rc 0) 00000100:00100000:0.0:1786002508.897482:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530840576:12345-192.168.203.49@tcp:101:ls.0 Request processed in 562us (831us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002508.903392:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23734 00000100:00100000:0.0:1786002508.911920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.912246:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530840704 00000100:00100000:3.0:1786002508.912255:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530840704 00000100:00100000:3.0:1786002508.912311:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23735 00000100:00100000:3.0:1786002508.912321:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530840704:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.912339:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.912359:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a74f expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912466:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413aa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912480:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912491:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912500:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912507:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413aa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912513:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912518:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002508.912522:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912528:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912537:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002508.912540:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002508.912544:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413aa6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912550:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413aa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912942:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a9f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a74f expref: 25 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912955:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002508.912958:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002508.912962:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413a9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a74f expref: 25 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.912978:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a000, rc 0) 00000100:00100000:3.0:1786002508.913122:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530840704:12345-192.168.203.49@tcp:101:ls.0 Request processed in 800us (1208us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002508.913130:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23735 00000100:00100000:2.0:1786002508.924959:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.925108:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530840832 00000100:00100000:0.0:1786002508.925117:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530840832 00000100:00100000:0.0:1786002508.925265:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5033 00000100:00100000:0.0:1786002508.925275:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:17796:x1872758530840832:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:1.0:1786002508.934630:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:17796:x1872758530840832:12345-192.168.203.49@tcp:37:ls.0 Request processed in 9346us (9669us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002508.934643:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5033 00000100:00100000:3.0:1786002508.941505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.941806:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530840960 00000100:00100000:0.0:1786002508.941815:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530840960 00000100:00100000:0.0:1786002508.941908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23736 00000100:00100000:0.0:1786002508.941919:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530840960:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002508.941938:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002508.941959:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413aad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a756 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.941991:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a756 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.942006:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a756 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.942024:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002508.942027:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002508.942033:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47000, rc 0) 00000100:00100000:0.0:1786002508.942086:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17796:x1872758530840960:12345-192.168.203.49@tcp:101:ls.0 Request processed in 169us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.942093:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23736 00000100:00100000:2.0:1786002508.950276:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002508.950414:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530841088 00000100:00100000:1.0:1786002508.950423:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530841088 00000100:00100000:1.0:1786002508.950479:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5034 00000100:00100000:1.0:1786002508.950489:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b54a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17796:x1872758530841088:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:1.0:1786002508.950645:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b54a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17796:x1872758530841088:12345-192.168.203.49@tcp:37:ls.0 Request processed in 157us (377us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002508.950662:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5034 00000100:00100000:1.0:1786002508.964308:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.967431:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530841344 00000100:00100000:0.0:1786002508.967444:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530841344 00000100:00100000:1.0:1786002508.970301:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5035 00000100:00100000:1.0:1786002508.970313:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:17796:x1872758530841344:12345-192.168.203.49@tcp:35:ls.0 00000100:00100000:1.0:1786002508.970803:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17796:x1872758530841344:12345-192.168.203.49@tcp:35:ls.0 Request processed in 492us (6501us total) trans 4294968474 rc 0/0 00000100:00100000:1.0:1786002508.970812:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5035 00000100:00100000:3.0:1786002508.985654:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002508.987351:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530841600 00000100:00100000:0.0:1786002508.987370:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530841600 00000100:00100000:0.0:1786002508.987434:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23737 00000100:00100000:0.0:1786002508.987443:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:17796:x1872758530841600:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002508.987467:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002508.987487:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47600/0x7cee4af578413ab4 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a75d expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987549:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413abb lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987561:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413abb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987571:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413abb lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987583:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47e00/0x7cee4af578413ac2 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x44749f58 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987590:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47e00/0x7cee4af578413ac2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987596:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47e00/0x7cee4af578413ac2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987646:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47c00/0x7cee4af578413ac9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987663:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47c00/0x7cee4af578413ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987670:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47c00/0x7cee4af578413ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987682:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413abb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987689:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413abb lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987696:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413abb lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987702:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413abb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987708:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002508.987712:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413abb lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987719:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413abb lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987729:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:0.0:1786002508.987733:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002508.987737:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413abb lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987743:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413abb lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987756:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47e00/0x7cee4af578413ac2 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987762:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47e00/0x7cee4af578413ac2 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987767:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47e00/0x7cee4af578413ac2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987772:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002508.987774:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47e00/0x7cee4af578413ac2 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987780:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47e00/0x7cee4af578413ac2 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987785:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x44749f58 (ffff9ed2456ef100) 00010000:00010000:0.0:1786002508.987787:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002508.987790:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47e00/0x7cee4af578413ac2 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987795:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47e00/0x7cee4af578413ac2 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987823:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47600/0x7cee4af578413ab4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a75d expref: 25 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987840:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47c00/0x7cee4af578413ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a75d expref: 24 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002508.987897:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed2456ef900) 00010000:00010000:0.0:1786002508.987900:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002508.987902:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47c00, rc 0) 00000100:00100000:0.0:1786002508.987967:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530841600:12345-192.168.203.49@tcp:101:ls.0 Request processed in 525us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002508.987974:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23737 00000100:00100000:2.0:1786002508.997728:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002508.997889:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530841856 00000100:00100000:3.0:1786002508.997899:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530841856 00000100:00100000:3.0:1786002508.997954:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23738 00000100:00100000:3.0:1786002508.997964:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17796:x1872758530841856:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002508.997981:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002508.997999:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413ad0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a764 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002508.998150:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14bf:0x0]: returning size 4096 00010000:00010000:3.0:1786002508.998240:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413ad0 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a764 expref: 27 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.998255:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed35363dc00) 00010000:00010000:3.0:1786002508.998258:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002508.998264:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578413ad0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a764 expref: 27 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002508.998278:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a000, rc 0) 00000100:00100000:3.0:1786002508.998340:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17796:x1872758530841856:12345-192.168.203.49@tcp:101:ls.0 Request processed in 378us (620us total) trans 4294983498 rc 301/301 00000100:00100000:3.0:1786002508.998347:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23738 00000100:00100000:3.0:1786002509.006980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.007274:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530841984 00000100:00100000:2.0:1786002509.007283:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530841984 00000100:00100000:2.0:1786002509.007383:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23739 00000100:00100000:2.0:1786002509.007394:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17796:x1872758530841984:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002509.007414:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002509.007434:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229800/0x7cee4af578413ade lrc: 2/0,0 mode: --/CR res: [0x240000401:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a76b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.007492:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af578413ae5 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.007505:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af578413ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x9d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.007520:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af578413ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x9d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002509.007562:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x9d:0x0]: returning size 4096 00000004:00200000:2.0:1786002509.007566:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002509.007601:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229800/0x7cee4af578413ade lrc: 0/0,0 mode: --/CR res: [0x240000401:0x9d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a76b expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.007621:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af578413ae5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x9d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a76b expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.007630:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9d:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:2.0:1786002509.007633:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002509.007646:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228c00, rc 0) 00000100:00100000:2.0:1786002509.007714:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17796:x1872758530841984:12345-192.168.203.49@tcp:101:ls.0 Request processed in 322us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.007722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23739 00000100:00100000:1.0:1786002509.012540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.012616:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530842112 00000100:00100000:0.0:1786002509.012625:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530842112 00000100:00100000:0.0:1786002509.012770:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23740 00000100:00100000:0.0:1786002509.012780:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17796:x1872758530842112:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002509.012803:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002509.012823:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413aec lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a772 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.012914:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af578413af3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.012928:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784137ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137f8 expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.012937:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af578413af3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.012966:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784137ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af5784137f8 expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002509.012981:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1872758560898560:0@lo:104: 00000100:00100000:0.0:1786002509.013153:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002509.013211:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002509.013266:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560898560 00000100:00100000:1.0:1786002509.013271:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560898560 00000100:00100000:1.0:1786002509.013305:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1786002509.013312:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6520:x1872758560898560:12345-0@lo:104: 00010000:00010000:1.0:1786002509.013323:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.013374:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786002509.013380:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6520:x1872758560898560:12345-0@lo:104: Request processed in 69us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.013386:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00010000:00010000:1.0:1786002509.013407:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002509.013412:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.013421:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002509.013425:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.013438:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.013461:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.013468:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002509.013493:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.013500:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556b400/0x7cee4af5784137f8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137ff expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.013518:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002509.013520:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002509.013522:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002509.013533:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560898688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002509.013562:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002509.013592:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560898688 00000100:00100000:1.0:1786002509.013596:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560898688 00010000:00010000:1.0:1786002509.013611:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784137ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af5784137f8 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002509.013633:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00100000:1.0:1786002509.013736:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3645:x1872758560898688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002509.013747:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1786002509.014209:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1872758560898560:0@lo:104: 00010000:00010000:1.0:1786002509.014227:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af578413af3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002509.016709:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983498 is committed 00000020:00080000:1.0:1786002509.016719:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 398 batchid updated 00010000:00010000:3.0:1786002509.016827:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784137ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af5784137f8 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.016873:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed35363dc00) 00010000:00010000:3.0:1786002509.016880:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af578413af3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.016888:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af578413af3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.016896:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af578413af3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.016920:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002509.016985:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3645:x1872758560898688:12345-0@lo:103:ldlm_bl.0 Request processed in 3333us (3421us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002509.016993:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000020:00080000:2.0:1786002509.017055:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 398 00000004:00080000:2.0:1786002509.017104:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed366d7d0c0 with version 751 00000020:00080000:2.0:1786002509.017119:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 398 cancel update log [0x240000401:0x3:0x0].392: rc = 0 00000020:00080000:2.0:1786002509.017190:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 398 cancel update log [0x200000400:0x3:0x0].393: rc = 0 00000020:00080000:2.0:1786002509.017199:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 398 00000004:00080000:3.0:1786002509.017359:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 751 rpc_version 751 00000020:00100000:3.0:1786002509.017385:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002509.017393:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2455f8700 x1872758560898944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002509.017412:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f8700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560898944:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002509.017447:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002509.017476:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf180 going to sleep for 11 seconds 00010000:00010000:1.0:1786002509.017585:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af578413af3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.017594:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af578413af3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002509.017729:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14bf:0x0]: returning size 4096 00000004:00200000:1.0:1786002509.017734:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1786002509.017754:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af578413af3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.017780:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413aec lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a772 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.017801:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af578413af3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a772 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.017809:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed35363dc00) 00010000:00010000:1.0:1786002509.017811:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002509.017814:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47e00, rc 0) 00000100:00100000:1.0:1786002509.018897:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17796:x1872758530842112:12345-192.168.203.49@tcp:101:ls.0 Request processed in 6115us (6362us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.018906:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23740 00000100:00100000:0.0:1786002509.018999:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560898688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002509.019502:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560898944 00000100:00100000:2.0:1786002509.019509:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560898944 00000100:00100000:2.0:1786002509.019551:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3626 00000100:00100000:2.0:1786002509.019559:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7805:x1872758560898944:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002509.019804:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560898944:12345-0@lo:1000:osp_up1-0.0 Request processed in 246us (2356us total) trans 4294968475 rc 0/0 00000100:00100000:2.0:1786002509.019812:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3626 00000100:00100000:3.0:1786002509.020141:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f8700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560898944:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002509.025798:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.025911:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530842240 00000100:00100000:0.0:1786002509.025920:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530842240 00000100:00100000:0.0:1786002509.025967:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5036 00000100:00100000:0.0:1786002509.025976:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17796:x1872758530842240:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:2.0:1786002509.039274:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17796:x1872758530842240:12345-192.168.203.49@tcp:37:ls.0 Request processed in 13290us (13475us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.039287:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5036 00000100:00100000:1.0:1786002509.059609:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.060179:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530842496 00000100:00100000:2.0:1786002509.060244:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530842496 00000100:00100000:2.0:1786002509.060301:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5037 00000100:00100000:2.0:1786002509.060312:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17796:x1872758530842496:12345-192.168.203.49@tcp:35:ls.0 00000100:00100000:2.0:1786002509.060593:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244eb4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1872758560899072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786002509.061259:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002509.061326:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3de40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002509.065260:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560899072 00000100:00100000:1.0:1786002509.065274:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560899072 00000100:00100000:0.0:1786002509.069376:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3627 00000100:00100000:0.0:1786002509.069390:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1872758560899072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786002509.069516:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1872758560899072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (8257us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.069523:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3627 00000100:00100000:2.0:1786002509.069604:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244eb4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1872758560899072:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:2.0:1786002509.069817:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].394, 320 off594056 00000040:00080000:2.0:1786002509.069890:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].393, 400 off643112 00000004:00080000:2.0:1786002509.069896:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245e3d540 with version 752 00000004:00080000:1.0:1786002509.072462:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 752 rpc_version 752 00000020:00100000:1.0:1786002509.072501:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002509.072510:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed245c41880 x1872758560899328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1536/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002509.072534:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560899328:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002509.072588:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002509.074748:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002509.078347:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560899328 00000100:00100000:3.0:1786002509.078366:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560899328 00000100:00100000:3.0:1786002509.078459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3628 00000100:00100000:3.0:1786002509.078469:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560899328:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002509.078801:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560899328:12345-0@lo:1000:osp_up1-0.0 Request processed in 333us (6212us total) trans 4294968476 rc 0/0 00000100:00100000:3.0:1786002509.078809:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3628 00000100:00100000:3.0:1786002509.078896:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560899328:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002509.079002:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17796:x1872758530842496:12345-192.168.203.49@tcp:35:ls.0 Request processed in 18691us (19400us total) trans 4294983499 rc 0/0 00000100:00100000:3.0:1786002509.079009:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5037 00000100:00100000:3.0:1786002509.085353:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.085481:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530842752 00000100:00100000:0.0:1786002509.085490:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530842752 00000100:00100000:0.0:1786002509.085543:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23741 00000100:00100000:0.0:1786002509.085552:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17796:x1872758530842752:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002509.085571:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002509.085589:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413afa lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a779 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.085813:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af578413b01 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.085827:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af578413b01 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.085839:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af578413b01 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.085894:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46800/0x7cee4af578413b08 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x2153044 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.085901:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46800/0x7cee4af578413b08 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.085908:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46800/0x7cee4af578413b08 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.085959:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413b0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.085967:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413b0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.085973:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413b0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.085987:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af578413b01 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.085994:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af578413b01 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086000:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af578413b01 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086006:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af578413b01 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086016:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002509.086020:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af578413b01 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086029:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af578413b01 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086048:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:0.0:1786002509.086051:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002509.086055:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af578413b01 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086061:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46400/0x7cee4af578413b01 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086072:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46800/0x7cee4af578413b08 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086077:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46800/0x7cee4af578413b08 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086082:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46800/0x7cee4af578413b08 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086087:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002509.086089:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46800/0x7cee4af578413b08 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086094:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46800/0x7cee4af578413b08 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086104:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x2153044 (ffff9ed2456ef200) 00010000:00010000:0.0:1786002509.086106:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002509.086108:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46800/0x7cee4af578413b08 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086113:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46800/0x7cee4af578413b08 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086146:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413afa lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a779 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086158:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413b0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a779 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.086166:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff9ed2456efa00) 00010000:00010000:0.0:1786002509.086169:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002509.086171:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46200, rc 0) 00000100:00100000:0.0:1786002509.086219:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17796:x1872758530842752:12345-192.168.203.49@tcp:101:ls.0 Request processed in 668us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.086226:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23741 00000100:00100000:1.0:1786002509.098515:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.098885:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530843008 00000100:00100000:2.0:1786002509.098895:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530843008 00000100:00100000:2.0:1786002509.098945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23742 00000100:00100000:2.0:1786002509.098954:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17796:x1872758530843008:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002509.098975:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002509.098994:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578413b16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a780 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002509.099334:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14f6:0x0]: returning size 4096 00010000:00010000:2.0:1786002509.099792:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578413b16 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a780 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.099806:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff9ed24556e000) 00010000:00010000:2.0:1786002509.099809:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002509.099814:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578413b16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a780 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.099830:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229800, rc 0) 00000100:00100000:2.0:1786002509.100169:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:17796:x1872758530843008:12345-192.168.203.49@tcp:101:ls.0 Request processed in 1214us (1660us total) trans 4294983500 rc 301/301 00000100:00100000:2.0:1786002509.100177:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23742 00000100:00100000:1.0:1786002509.119626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.119836:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530843136 00000100:00100000:0.0:1786002509.119884:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530843136 00000100:00100000:0.0:1786002509.119932:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23743 00000100:00100000:0.0:1786002509.119942:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:17796:x1872758530843136:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002509.119965:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002509.119984:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47800/0x7cee4af578413b24 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a787 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.120056:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578413b2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.120069:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578413b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.120079:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578413b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002509.120159:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14f6:0x0]: returning size 4096 00000004:00200000:0.0:1786002509.120163:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1786002509.120181:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578413b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.120211:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47800/0x7cee4af578413b24 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a787 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.120231:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578413b2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a787 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.120239:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff9ed2456efd00) 00010000:00010000:0.0:1786002509.120242:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002509.120245:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46800, rc 0) 00000100:00100000:0.0:1786002509.120303:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:17796:x1872758530843136:12345-192.168.203.49@tcp:101:ls.0 Request processed in 361us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.120310:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23743 00000100:00100000:3.0:1786002509.140084:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.140263:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530843264 00000100:00100000:0.0:1786002509.140272:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530843264 00000100:00100000:0.0:1786002509.140328:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23744 00000100:00100000:0.0:1786002509.140337:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:17796:x1872758530843264:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002509.140356:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002509.140386:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47800/0x7cee4af578413b32 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a78e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.140437:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af578413b39 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.140450:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af578413b39 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.140460:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af578413b39 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002509.140579:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xb7:0x0]: returning size 4096 00000004:00200000:0.0:1786002509.140584:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786002509.140617:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47800/0x7cee4af578413b32 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a78e expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.140646:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af578413b39 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a78e expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.140704:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xb7:0x0].0x0 (ffff9ed2456ef200) 00010000:00010000:0.0:1786002509.140707:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002509.140711:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46400, rc 0) 00000100:00100000:0.0:1786002509.140807:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:17796:x1872758530843264:12345-192.168.203.49@tcp:101:ls.0 Request processed in 469us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.140814:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23744 00000100:00100000:2.0:1786002509.157585:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.157842:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530843392 00000100:00100000:3.0:1786002509.157877:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530843392 00000100:00100000:3.0:1786002509.157931:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23745 00000100:00100000:3.0:1786002509.157942:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17796:x1872758530843392:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002509.157962:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002509.157985:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af578413b40 lrc: 2/0,0 mode: --/CR res: [0x240000401:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a795 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.158054:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413b47 lrc: 3/1,0 mode: --/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.158073:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413b47 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.158084:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413b47 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002509.158129:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0xb7:0x0]: returning size 4096 00000004:00200000:3.0:1786002509.158134:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002509.158170:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af578413b40 lrc: 0/0,0 mode: --/CR res: [0x240000401:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a795 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.158287:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413b47 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a795 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.158295:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb7:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002509.158298:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002509.158300:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a000, rc 0) 00000100:00100000:3.0:1786002509.158472:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17796:x1872758530843392:12345-192.168.203.49@tcp:101:ls.0 Request processed in 531us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002509.158479:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23745 00000100:00100000:3.0:1786002509.162107:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758560899456:0@lo:400:kworker.0 00000100:00100000:3.0:1786002509.162172:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002509.162525:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560899456 00000100:00100000:2.0:1786002509.162532:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560899456 00000100:00100000:2.0:1786002509.162576:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1786002509.162585:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758560899456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002509.162631:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758560899456:12345-0@lo:400:kworker.0 Request processed in 47us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.162946:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872758560899712:0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.162978:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002509.162995:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560900224:0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.163015:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002509.163028:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560900736:0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.163111:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002509.163132:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1786002509.163138:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758560899840:0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.163245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002509.163264:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758560900352:0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.163287:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002509.163303:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560900864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002509.163325:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002509.163352:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560899712 00000100:00100000:0.0:1786002509.163356:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560899712 00000100:00100000:2.0:1786002509.163874:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1786002509.163919:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560900224 00000100:00100000:2.0:1786002509.163923:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560900224 00000100:00100000:2.0:1786002509.163958:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560900736 00000100:00100000:2.0:1786002509.163961:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560900736 00000100:00100000:2.0:1786002509.163979:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1786002509.163986:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560900224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.164136:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560899840 00000100:00100000:0.0:1786002509.164140:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560899840 00000100:00100000:0.0:1786002509.164160:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560900352 00000100:00100000:0.0:1786002509.164163:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560900352 00000100:00100000:0.0:1786002509.164179:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1786002509.164334:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1786002509.164343:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560900736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002509.164394:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560900736:12345-0@lo:400:kworker.0 Request processed in 52us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.164400:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1786002509.164419:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560900864 00000100:00100000:1.0:1786002509.164423:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560900864 00000100:00100000:1.0:1786002509.164448:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1786002509.164454:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560900864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786002509.164472:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1786002509.164503:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560900864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.164509:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1786002509.164529:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758560899584:0@lo:400:kworker.0 00000100:00100000:1.0:1786002509.164554:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002509.164566:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560900096:0@lo:400:kworker.0 00000100:00100000:1.0:1786002509.164589:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002509.164607:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560900608:0@lo:400:kworker.0 00000100:00100000:1.0:1786002509.164659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002509.164678:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1786002509.164684:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758560899968:0@lo:400:kworker.0 00000100:00100000:1.0:1786002509.164705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002509.164714:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758560900480:0@lo:400:kworker.0 00000100:00100000:1.0:1786002509.164740:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002509.164750:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560900992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002509.164768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002509.164793:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560900096 00000100:00100000:1.0:1786002509.164797:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560900096 00000100:00100000:1.0:1786002509.164821:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560900608 00000100:00100000:1.0:1786002509.164824:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560900608 00000100:00100000:1.0:1786002509.164873:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1786002509.164881:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560900096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002509.164916:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560900096:12345-0@lo:400:kworker.0 Request processed in 36us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.164922:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1786002509.164935:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1786002509.164941:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560900608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002509.164969:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560900608:12345-0@lo:400:kworker.0 Request processed in 28us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.164975:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1786002509.164994:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560900992 00000100:00100000:1.0:1786002509.164999:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560900992 00000100:00100000:1.0:1786002509.165018:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1786002509.165024:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560900992:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002509.165318:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872758560899712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.165352:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872758560899712:12345-0@lo:400:kworker.0 Request processed in 38us (2373us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.165542:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560900224:12345-0@lo:400:kworker.0 Request processed in 43us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.165551:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00080000:2.0:1786002509.165567:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786002509.165571:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786002509.165573:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002509.165614:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560900864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002509.165628:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872758560899712:0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.165726:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:0.0:1786002509.165742:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560899584 00000100:00100000:0.0:1786002509.165746:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560899584 00000100:00100000:0.0:1786002509.165759:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560899968 00000100:00100000:0.0:1786002509.165762:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560899968 00000100:00100000:0.0:1786002509.165778:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560900480 00000100:00100000:0.0:1786002509.165780:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560900480 00000100:00100000:0.0:1786002509.165792:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:0.0:1786002509.165798:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758560899840:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1786002509.165914:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1786002509.165989:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560900224:0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.168393:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758560899840:12345-0@lo:400:kworker.0 Request processed in 2589us (5204us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.168404:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:0.0:1786002509.168431:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1786002509.168443:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758560900352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.168479:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758560900352:12345-0@lo:400:kworker.0 Request processed in 41us (5192us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.168484:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1786002509.168495:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1786002509.168501:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758560899584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.168525:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758560899584:12345-0@lo:400:kworker.0 Request processed in 24us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.168530:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1786002509.168540:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1786002509.168545:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758560899968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.168567:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758560899968:12345-0@lo:400:kworker.0 Request processed in 22us (3861us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.168572:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1786002509.168581:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:0.0:1786002509.168587:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758560900480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.168608:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758560900480:12345-0@lo:400:kworker.0 Request processed in 22us (3868us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.168614:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:0.0:1786002509.168971:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758560899968:0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.168983:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758560900480:0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.168992:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758560899584:0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.169003:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560900096:0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.169013:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560900608:0@lo:400:kworker.0 00000100:00100000:3.0:1786002509.169373:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758560899456:0@lo:400:kworker.0 00000100:00080000:3.0:1786002509.172451:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002509.173663:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560900992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8634us (8889us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.173676:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1786002509.174220:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560900992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002509.177202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.177333:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530843520 00000100:00100000:0.0:1786002509.177341:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530843520 00000100:00100000:0.0:1786002509.177399:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5038 00000100:00100000:0.0:1786002509.177408:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:17796:x1872758530843520:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:2.0:1786002509.179752:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560900736:0@lo:400:kworker.0 00000100:00100000:2.0:1786002509.179796:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758560899840:0@lo:400:kworker.0 00000100:00100000:2.0:1786002509.179807:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758560900352:0@lo:400:kworker.0 00000100:00100000:0.0:1786002509.188307:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:17796:x1872758530843520:12345-192.168.203.49@tcp:37:ls.0 Request processed in 10888us (11111us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.188320:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5038 00000100:00100000:2.0:1786002509.194882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.194985:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530843648 00000100:00100000:3.0:1786002509.194993:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530843648 00000100:00100000:3.0:1786002509.195095:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5039 00000100:00100000:3.0:1786002509.195107:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b548050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17796:x1872758530843648:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:3.0:1786002509.213555:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b548050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17796:x1872758530843648:12345-192.168.203.49@tcp:37:ls.0 Request processed in 18441us (18709us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002509.213568:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5039 00000100:00100000:2.0:1786002509.229272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.231950:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530843904 00000100:00100000:0.0:1786002509.231964:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530843904 00000100:00100000:1.0:1786002509.234627:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5040 00000100:00100000:1.0:1786002509.234642:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:17796:x1872758530843904:12345-192.168.203.49@tcp:35:ls.0 00000100:00100000:1.0:1786002509.234894:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:17796:x1872758530843904:12345-192.168.203.49@tcp:35:ls.0 Request processed in 254us (5629us total) trans 4294983501 rc 0/0 00000100:00100000:1.0:1786002509.234902:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5040 00000100:00100000:0.0:1786002509.244278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.244621:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530844160 00000100:00100000:2.0:1786002509.244630:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530844160 00000100:00100000:2.0:1786002509.244699:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23746 00000100:00100000:2.0:1786002509.244710:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:17796:x1872758530844160:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002509.244743:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002509.244762:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413b4e lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a79c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.244833:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413b55 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.244882:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413b55 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.244893:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413b55 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.244910:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578413b5c lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x83604406 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.244918:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578413b5c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.244931:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578413b5c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.244989:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578413b63 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.244997:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578413b63 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245005:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578413b63 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245018:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413b55 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245025:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413b55 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245621:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413b55 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245634:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413b55 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245639:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002509.245643:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413b55 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245657:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413b55 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245669:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:2.0:1786002509.245672:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002509.245676:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413b55 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245681:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413b55 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245695:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578413b5c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245701:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578413b5c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245705:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578413b5c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245709:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002509.245712:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578413b5c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245720:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578413b5c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245727:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x83604406 (ffff9ed24556e000) 00010000:00010000:2.0:1786002509.245729:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002509.245731:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578413b5c lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245736:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578413b5c lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245770:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413b4e lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a79c expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245783:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578413b63 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a79c expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.245791:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:2.0:1786002509.245793:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002509.245796:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229800, rc 0) 00000100:00100000:2.0:1786002509.246108:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17796:x1872758530844160:12345-192.168.203.49@tcp:101:ls.0 Request processed in 1399us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.246116:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23746 00000100:00100000:3.0:1786002509.260782:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.261122:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530844416 00000100:00100000:0.0:1786002509.261132:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530844416 00000100:00100000:0.0:1786002509.261196:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23747 00000100:00100000:0.0:1786002509.261208:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17796:x1872758530844416:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002509.261229:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002509.261252:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47400/0x7cee4af578413b6a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7a3 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002509.261619:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x16c:0x0]: returning size 4096 00010000:00010000:0.0:1786002509.261713:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47400/0x7cee4af578413b6a lrc: 1/0,0 mode: --/CR res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7a3 expref: 29 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.261728:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:0.0:1786002509.261731:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002509.261736:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47400/0x7cee4af578413b6a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7a3 expref: 29 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.261752:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47400, rc 0) 00000100:00100000:0.0:1786002509.261808:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:17796:x1872758530844416:12345-192.168.203.49@tcp:101:ls.0 Request processed in 603us (1036us total) trans 4294968477 rc 301/301 00000100:00100000:0.0:1786002509.261815:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23747 00000100:00100000:1.0:1786002509.275958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.276053:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530844544 00000100:00100000:0.0:1786002509.276062:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530844544 00000100:00100000:0.0:1786002509.276124:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23748 00000100:00100000:0.0:1786002509.276134:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:17796:x1872758530844544:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002509.276158:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002509.276178:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47400/0x7cee4af578413b78 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.276256:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413b7f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.276269:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413b7f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.276284:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413b7f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002509.276376:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x16c:0x0]: returning size 4096 00000004:00200000:0.0:1786002509.276382:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1786002509.276398:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413b7f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.276423:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47400/0x7cee4af578413b78 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7aa expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.276443:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413b7f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7aa expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.276451:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff9ed2456ef300) 00010000:00010000:0.0:1786002509.276454:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002509.276457:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47800, rc 0) 00000100:00100000:0.0:1786002509.276515:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:17796:x1872758530844544:12345-192.168.203.49@tcp:101:ls.0 Request processed in 382us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.276521:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23748 00000100:00100000:3.0:1786002509.288399:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.288559:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530844672 00000100:00100000:2.0:1786002509.288569:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530844672 00000100:00100000:2.0:1786002509.288622:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23749 00000100:00100000:2.0:1786002509.288631:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:17796:x1872758530844672:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002509.288654:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002509.288676:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413b86 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7b1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.288731:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578413b8d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.288744:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578413b8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.288755:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578413b8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002509.288798:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xbc:0x0]: returning size 4096 00000004:00200000:2.0:1786002509.288803:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002509.288834:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413b86 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b1 expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.288898:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578413b8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b1 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.288907:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbc:0x0].0x0 (ffff9ed24556e000) 00010000:00010000:2.0:1786002509.288910:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002509.288913:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229000, rc 0) 00000100:00100000:2.0:1786002509.288966:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:17796:x1872758530844672:12345-192.168.203.49@tcp:101:ls.0 Request processed in 336us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.288973:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23749 00000100:00100000:3.0:1786002509.294830:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.294973:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530844800 00000100:00100000:0.0:1786002509.294981:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530844800 00000100:00100000:0.0:1786002509.295043:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23750 00000100:00100000:0.0:1786002509.295052:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17796:x1872758530844800:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002509.295073:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002509.295094:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578413b94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7b8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.295155:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413b9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.295178:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.295196:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002509.295240:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xbc:0x0]: returning size 4096 00000004:00200000:0.0:1786002509.295245:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786002509.295279:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578413b94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b8 expref: 34 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.295295:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413b9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b8 expref: 33 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.295315:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbc:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:0.0:1786002509.295318:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002509.295321:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47600, rc 0) 00000100:00100000:0.0:1786002509.295382:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:17796:x1872758530844800:12345-192.168.203.49@tcp:101:ls.0 Request processed in 331us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.295388:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23750 00000100:00100000:1.0:1786002509.308759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.308879:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530844928 00000100:00100000:3.0:1786002509.308889:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530844928 00000100:00100000:3.0:1786002509.308937:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5041 00000100:00100000:3.0:1786002509.308947:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:17796:x1872758530844928:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:3.0:1786002509.313713:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:17796:x1872758530844928:12345-192.168.203.49@tcp:37:ls.0 Request processed in 4758us (4954us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002509.313727:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5041 00000100:00100000:0.0:1786002509.325498:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002509.329295:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530845056 00000100:00100000:1.0:1786002509.329309:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530845056 00000100:00100000:1.0:1786002509.329730:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5042 00000100:00100000:1.0:1786002509.329743:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:17796:x1872758530845056:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:2.0:1786002509.337013:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:17796:x1872758530845056:12345-192.168.203.49@tcp:37:ls.0 Request processed in 7264us (11513us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.337039:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5042 00000100:00100000:2.0:1786002509.351805:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.351908:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530845312 00000100:00100000:3.0:1786002509.351916:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530845312 00000100:00100000:3.0:1786002509.351972:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5043 00000100:00100000:3.0:1786002509.351982:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:17796:x1872758530845312:12345-192.168.203.49@tcp:35:ls.0 00000100:00100000:3.0:1786002509.352347:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:17796:x1872758530845312:12345-192.168.203.49@tcp:35:ls.0 Request processed in 365us (549us total) trans 4294968478 rc 0/0 00000100:00100000:3.0:1786002509.352354:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5043 00000100:00100000:3.0:1786002509.357791:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.358696:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530845568 00000100:00100000:2.0:1786002509.358706:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530845568 00000100:00100000:2.0:1786002509.358771:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23751 00000100:00100000:2.0:1786002509.358781:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:17796:x1872758530845568:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002509.358801:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002509.358819:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413ba2 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7bf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.358933:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413ba9 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.358947:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.358958:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.358971:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413bb0 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.358978:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.358984:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359047:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578413bb7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359055:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578413bb7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359062:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578413bb7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359077:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413ba9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359083:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413ba9 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359090:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359096:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413ba9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359101:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002509.359105:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413ba9 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359112:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413ba9 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359122:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:2.0:1786002509.359124:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002509.359129:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413ba9 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359135:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578413ba9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359148:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359153:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359387:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359393:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed3429ea000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002509.359396:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359403:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359411:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xee50ff8a (ffff9ed24556eb00) 00010000:00010000:2.0:1786002509.359414:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002509.359417:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413bb0 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359422:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413bb0 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359454:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578413ba2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7bf expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359466:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578413bb7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7bf expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.359478:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16f:0x0].0x0 (ffff9ed24556e400) 00010000:00010000:2.0:1786002509.359481:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002509.359483:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2423b4600, rc 0) 00000100:00100000:2.0:1786002509.359542:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+34:17796:x1872758530845568:12345-192.168.203.49@tcp:101:ls.0 Request processed in 763us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.359549:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23751 00000100:00100000:1.0:1786002509.364389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.364686:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530845824 00000100:00100000:3.0:1786002509.364695:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530845824 00000100:00100000:3.0:1786002509.364752:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23752 00000100:00100000:3.0:1786002509.364762:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:17796:x1872758530845824:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002509.364788:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002509.364810:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af578413bbe lrc: 2/0,0 mode: --/CR res: [0x240000402:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7c6 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002509.365005:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x16f:0x0]: returning size 4096 00010000:00010000:3.0:1786002509.365093:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af578413bbe lrc: 1/0,0 mode: --/CR res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7c6 expref: 33 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.365107:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16f:0x0].0x0 (ffff9ed245fedd00) 00010000:00010000:3.0:1786002509.365109:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002509.365114:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af578413bbe lrc: 0/0,0 mode: --/CR res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7c6 expref: 33 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.365132:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b000, rc 0) 00000100:00100000:3.0:1786002509.365390:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17796:x1872758530845824:12345-192.168.203.49@tcp:101:ls.0 Request processed in 628us (1008us total) trans 4294968479 rc 301/301 00000100:00100000:3.0:1786002509.365398:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23752 00000100:00100000:3.0:1786002509.370055:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002509.370128:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530845952 00000100:00100000:1.0:1786002509.370138:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530845952 00000100:00100000:1.0:1786002509.370197:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23753 00000100:00100000:1.0:1786002509.370207:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17796:x1872758530845952:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002509.370231:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002509.370252:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413bcc lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7cd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.370325:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413bd3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.370339:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.370349:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002509.370437:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x16f:0x0]: returning size 4096 00000004:00200000:1.0:1786002509.370442:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1786002509.370460:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.370488:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413bcc lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7cd expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.370510:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413bd3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7cd expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.370519:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16f:0x0].0x0 (ffff9ed366e56300) 00010000:00010000:1.0:1786002509.370522:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002509.370525:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7ee00, rc 0) 00000100:00100000:1.0:1786002509.370591:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:17796:x1872758530845952:12345-192.168.203.49@tcp:101:ls.0 Request processed in 386us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.370598:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23753 00000100:00100000:0.0:1786002509.377935:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.378061:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530846080 00000100:00100000:2.0:1786002509.378070:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530846080 00000100:00100000:2.0:1786002509.378133:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23754 00000100:00100000:2.0:1786002509.378143:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:17796:x1872758530846080:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002509.378172:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002509.378199:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413bda lrc: 2/0,0 mode: --/CR res: [0x240000400:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.378253:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578413be1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.378266:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578413be1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.378276:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578413be1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002509.378319:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xbe:0x0]: returning size 4096 00000004:00200000:2.0:1786002509.378324:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002509.378354:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413bda lrc: 0/0,0 mode: --/CR res: [0x240000400:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7d4 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.378389:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578413be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7d4 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.378398:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbe:0x0].0x0 (ffff9ed24556eb00) 00010000:00010000:2.0:1786002509.378401:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002509.378404:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2423b4a00, rc 0) 00000100:00100000:2.0:1786002509.378458:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+34:17796:x1872758530846080:12345-192.168.203.49@tcp:101:ls.0 Request processed in 317us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.378465:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23754 00000100:00100000:2.0:1786002509.388548:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.388637:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530846208 00000100:00100000:3.0:1786002509.388647:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530846208 00000100:00100000:3.0:1786002509.388709:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23755 00000100:00100000:3.0:1786002509.388719:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+34:17796:x1872758530846208:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002509.388739:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002509.388761:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413be8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7db expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.388817:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413bef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.388829:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.388880:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002509.388930:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xbe:0x0]: returning size 4096 00000004:00200000:3.0:1786002509.388935:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1786002509.388970:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413be8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xbe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7db expref: 36 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.388988:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413bef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7db expref: 35 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.388996:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbe:0x0].0x0 (ffff9ed245fedd00) 00010000:00010000:3.0:1786002509.388999:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002509.389002:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b400, rc 0) 00000100:00100000:3.0:1786002509.389055:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530846208:12345-192.168.203.49@tcp:101:ls.0 Request processed in 337us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002509.389062:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23755 00000100:00100000:3.0:1786002509.401076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.401234:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530846336 00000100:00100000:2.0:1786002509.401245:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530846336 00000100:00100000:2.0:1786002509.401299:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5044 00000100:00100000:2.0:1786002509.401309:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b54b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+34:17796:x1872758530846336:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:2.0:1786002509.415460:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b54b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+34:17796:x1872758530846336:12345-192.168.203.49@tcp:37:ls.0 Request processed in 14143us (14383us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.415473:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5044 00000100:00100000:2.0:1786002509.422496:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.422569:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530846464 00000100:00100000:3.0:1786002509.422577:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530846464 00000100:00100000:3.0:1786002509.422628:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5045 00000100:00100000:3.0:1786002509.422637:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530846464:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:1.0:1786002509.435754:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530846464:12345-192.168.203.49@tcp:37:ls.0 Request processed in 13108us (13258us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.435770:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5045 00000100:00100000:0.0:1786002509.454426:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.454517:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530846720 00000100:00100000:2.0:1786002509.454527:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530846720 00000100:00100000:2.0:1786002509.454581:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5046 00000100:00100000:2.0:1786002509.454591:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+34:17796:x1872758530846720:12345-192.168.203.49@tcp:35:ls.0 00000100:00100000:2.0:1786002509.454878:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530846720:12345-192.168.203.49@tcp:35:ls.0 Request processed in 288us (512us total) trans 4294968480 rc 0/0 00000100:00100000:2.0:1786002509.454889:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5046 00000100:00100000:0.0:1786002509.467042:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002509.467305:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530846976 00000100:00100000:1.0:1786002509.467315:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530846976 00000100:00100000:1.0:1786002509.467378:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23756 00000100:00100000:1.0:1786002509.467388:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530846976:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002509.467405:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002509.467424:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413bf6 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7e2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467499:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413bfd lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467512:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413bfd lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467522:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413bfd lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467536:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578413c04 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467542:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578413c04 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467548:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578413c04 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467597:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578413c0b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467608:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578413c0b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467614:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578413c0b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467627:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413bfd lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467634:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413bfd lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467640:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413bfd lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467646:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413bfd lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467653:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002509.467657:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413bfd lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467664:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413bfd lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467675:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:1.0:1786002509.467679:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002509.467684:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413bfd lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467690:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413bfd lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467705:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578413c04 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467712:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578413c04 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467718:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578413c04 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467722:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002509.467725:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578413c04 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467731:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578413c04 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467737:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xfe89f9f8 (ffff9ed366e56400) 00010000:00010000:1.0:1786002509.467739:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002509.467742:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578413c04 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467747:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578413c04 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467775:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578413bf6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7e2 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467787:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578413c0b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7e2 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.467799:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x27:0x0].0x0 (ffff9ed366e56700) 00010000:00010000:1.0:1786002509.467801:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002509.467803:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f400, rc 0) 00000100:00100000:1.0:1786002509.468359:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:17796:x1872758530846976:12345-192.168.203.49@tcp:101:ls.0 Request processed in 969us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.468376:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23756 00000100:00100000:2.0:1786002509.485499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.491786:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530847232 00000100:00100000:0.0:1786002509.491802:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530847232 00000100:00100000:1.0:1786002509.494872:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23757 00000100:00100000:1.0:1786002509.494889:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530847232:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002509.494916:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002509.494936:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413c12 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7e9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002509.495108:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x27:0x0]: returning size 4096 00010000:00010000:1.0:1786002509.496688:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413c12 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7e9 expref: 37 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.496706:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x27:0x0].0x0 (ffff9ed366e56400) 00010000:00010000:1.0:1786002509.496710:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002509.496715:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413c12 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7e9 expref: 37 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.496737:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f000, rc 0) 00000100:00100000:1.0:1786002509.496807:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:17796:x1872758530847232:12345-192.168.203.49@tcp:101:ls.0 Request processed in 1922us (11316us total) trans 4294968481 rc 301/301 00000100:00100000:1.0:1786002509.496815:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23757 00000100:00100000:2.0:1786002509.505207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.505335:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530847360 00000100:00100000:0.0:1786002509.505344:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530847360 00000100:00100000:0.0:1786002509.505412:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23758 00000100:00100000:0.0:1786002509.505422:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:17796:x1872758530847360:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002509.505443:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002509.505464:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47400/0x7cee4af578413c20 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7f0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.505556:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413c27 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.505569:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413c27 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x27:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.505580:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413c27 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x27:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002509.505666:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x27:0x0]: returning size 4096 00000004:00200000:0.0:1786002509.505671:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1786002509.505691:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413c27 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x27:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.505718:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47400/0x7cee4af578413c20 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7f0 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.505741:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413c27 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x27:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7f0 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.505748:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x27:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:0.0:1786002509.505752:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002509.505755:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46600, rc 0) 00000100:00100000:0.0:1786002509.505816:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:17796:x1872758530847360:12345-192.168.203.49@tcp:101:ls.0 Request processed in 395us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.505823:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23758 00000100:00100000:0.0:1786002509.521737:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.521826:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530847488 00000100:00100000:2.0:1786002509.521836:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530847488 00000100:00100000:2.0:1786002509.521936:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23759 00000100:00100000:2.0:1786002509.521945:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:17796:x1872758530847488:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002509.521965:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002509.521987:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c2e lrc: 2/0,0 mode: --/CR res: [0x240000400:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.522051:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413c35 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.522063:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413c35 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.522074:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413c35 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002509.522118:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x17:0x0]: returning size 4096 00000004:00200000:2.0:1786002509.522123:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002509.522158:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c2e lrc: 0/0,0 mode: --/CR res: [0x240000400:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7f7 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.522175:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413c35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7f7 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.522196:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x17:0x0].0x0 (ffff9ed24556ea00) 00010000:00010000:2.0:1786002509.522200:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002509.522204:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2423b4000, rc 0) 00000100:00100000:2.0:1786002509.522256:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+38:17796:x1872758530847488:12345-192.168.203.49@tcp:101:ls.0 Request processed in 312us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.522262:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23759 00000100:00100000:3.0:1786002509.545541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.545992:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530847616 00000100:00100000:0.0:1786002509.546001:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530847616 00000100:00100000:0.0:1786002509.546062:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23760 00000100:00100000:0.0:1786002509.546072:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:17796:x1872758530847616:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002509.546091:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002509.546111:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578413c3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a7fe expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.546167:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413c43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.546187:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.546198:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002509.546243:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x17:0x0]: returning size 4096 00000004:00200000:0.0:1786002509.546250:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786002509.546285:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578413c3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7fe expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.546301:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7fe expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.546309:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:0.0:1786002509.546312:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002509.546315:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34c00, rc 0) 00000100:00100000:0.0:1786002509.546378:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:17796:x1872758530847616:12345-192.168.203.49@tcp:101:ls.0 Request processed in 307us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.546384:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23760 00000100:00100000:0.0:1786002509.562203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002509.562292:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530847744 00000100:00100000:1.0:1786002509.562302:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530847744 00000100:00100000:1.0:1786002509.562357:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5047 00000100:00100000:1.0:1786002509.562376:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+38:17796:x1872758530847744:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:2.0:1786002509.566710:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+38:17796:x1872758530847744:12345-192.168.203.49@tcp:37:ls.0 Request processed in 4334us (4504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.566723:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5047 00000100:00100000:2.0:1786002509.580575:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.586459:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530847872 00000100:00100000:0.0:1786002509.586474:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530847872 00000100:00100000:1.0:1786002509.586636:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5048 00000100:00100000:1.0:1786002509.586647:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:17796:x1872758530847872:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:2.0:1786002509.607943:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:17796:x1872758530847872:12345-192.168.203.49@tcp:37:ls.0 Request processed in 21288us (27366us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.607957:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5048 00000100:00100000:0.0:1786002509.613329:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.613559:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530848128 00000100:00100000:2.0:1786002509.613569:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530848128 00000100:00100000:2.0:1786002509.613627:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5049 00000100:00100000:2.0:1786002509.613637:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+38:17796:x1872758530848128:12345-192.168.203.49@tcp:35:ls.0 00000040:00080000:2.0:1786002509.613961:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].403, 344 off607840 00000040:00080000:2.0:1786002509.614010:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].403, 424 off656208 00000004:00080000:2.0:1786002509.614263:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245e3d240 with version 766 00000004:00080000:1.0:1786002509.614318:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 766 rpc_version 766 00000020:00100000:1.0:1786002509.614347:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002509.614355:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2457f1f80 x1872758560901248/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002509.614442:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f1f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560901248:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002509.614494:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002509.614607:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560901248 00000100:00100000:3.0:1786002509.614613:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560901248 00000100:00100000:3.0:1786002509.614644:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3629 00000100:00100000:3.0:1786002509.614652:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7466:x1872758560901248:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002509.614794:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:7466:x1872758560901248:12345-0@lo:1000:osp_up0-1.0 Request processed in 142us (299us total) trans 4294983502 rc 0/0 00000100:00100000:3.0:1786002509.614802:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3629 00000100:00100000:1.0:1786002509.618603:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8180 going to sleep for 11 seconds 00000100:00100000:1.0:1786002509.618648:0:7466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983495 gen 2 00000004:00080000:1.0:1786002509.618654:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983487 committed transno 4294983495 00000004:00080000:1.0:1786002509.618673:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983488 committed transno 4294983495 00000004:00080000:1.0:1786002509.618681:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983489 committed transno 4294983495 00000020:00080000:1.0:1786002509.618686:0:7466:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed36faaf9c0 refcount 2 committed 0 result 0 batchid 402 00000020:00080000:1.0:1786002509.618690:0:7466:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245747000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36faafd80 00000020:00080000:1.0:1786002509.618693:0:7466:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].398 00000020:00080000:1.0:1786002509.618696:0:7466:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37ba65900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245da5800 00000020:00080000:1.0:1786002509.618699:0:7466:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].399 00000004:00080000:1.0:1786002509.618717:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983490 committed transno 4294983495 00000020:00080000:1.0:1786002509.618721:0:7466:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed2456d8d80 refcount 2 committed 0 result 0 batchid 403 00000020:00080000:1.0:1786002509.618723:0:7466:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed343bc5c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2456d8300 00000020:00080000:1.0:1786002509.618728:0:7466:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].399 00000020:00080000:1.0:1786002509.618730:0:7466:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed343bc5200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244a61400 00000020:00080000:1.0:1786002509.618732:0:7466:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].400 00000004:00080000:1.0:1786002509.618743:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983493 committed transno 4294983495 00000020:00080000:1.0:1786002509.618746:0:7466:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed36e7ab6c0 refcount 2 committed 0 result 0 batchid 404 00000020:00080000:1.0:1786002509.618749:0:7466:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2465a7500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36e7ab300 00000020:00080000:1.0:1786002509.618751:0:7466:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].400 00000020:00080000:1.0:1786002509.618753:0:7466:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed343bc5000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244a61a00 00000020:00080000:1.0:1786002509.618755:0:7466:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].401 00000004:00080000:1.0:1786002509.618763:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983494 committed transno 4294983495 00000020:00080000:1.0:1786002509.618766:0:7466:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed245d3fe40 refcount 2 committed 0 result 0 batchid 405 00000020:00080000:1.0:1786002509.618768:0:7466:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebe600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d3fcc0 00000020:00080000:1.0:1786002509.618771:0:7466:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].402 00000020:00080000:1.0:1786002509.618773:0:7466:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebe700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d01600 00000020:00080000:1.0:1786002509.618776:0:7466:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].402 00000004:00080000:1.0:1786002509.618787:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983495 committed transno 4294983495 00000100:00100000:1.0:1786002509.618805:0:7466:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed2457f1f80 x1872758560901248/t4294983502(4294983502) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 1786002525 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786002509.618836:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f1f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560901248:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002509.619416:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+39:17796:x1872758530848128:12345-192.168.203.49@tcp:35:ls.0 Request processed in 5777us (6091us total) trans 4294968482 rc 0/0 00000100:00100000:3.0:1786002509.619426:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5049 00000020:00080000:2.0:1786002509.620583:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 405 committed batchid 401 00000020:00080000:2.0:1786002509.620641:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 401 00000100:00100000:2.0:1786002509.629979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002509.630115:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530848384 00000100:00100000:1.0:1786002509.630125:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530848384 00000100:00100000:1.0:1786002509.630189:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23761 00000100:00100000:1.0:1786002509.630198:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:17796:x1872758530848384:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002509.630217:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002509.630233:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413c4a lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a805 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.630299:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413c51 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.630312:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413c51 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.630322:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413c51 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.630332:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.630341:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784137ea lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784137e3 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.630350:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 4/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.630390:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784137ea lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af5784137e3 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002509.630405:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560901376:0@lo:104: 00000100:00100000:1.0:1786002509.630445:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002509.630496:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8180 going to sleep for 11 seconds 00000100:00100000:3.0:1786002509.630588:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560901376 00000100:00100000:3.0:1786002509.630593:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560901376 00000100:00100000:3.0:1786002509.630625:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1786002509.630632:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:14496:x1872758560901376:12345-0@lo:104: 00010000:00010000:3.0:1786002509.630644:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784137ea expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.630698:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786002509.630704:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:14496:x1872758560901376:12345-0@lo:104: Request processed in 73us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002509.630711:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1786002509.630790:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560901376:0@lo:104: 00010000:00010000:0.0:1786002509.630809:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.631267:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002509.631273:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784137ea expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.631281:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556be00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002509.631286:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0x7cee4af5784137ea expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.631295:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af5784137ea expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.631321:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137ea expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.631327:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002509.631353:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 1/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137ea expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.631368:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed34556be00/0x7cee4af5784137e3 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784137ea expref: -99 pid: 20599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.631387:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002509.631389:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002509.631390:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002509.631430:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560901504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002509.631461:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002509.631537:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560901504 00000100:00100000:2.0:1786002509.631542:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560901504 00010000:00010000:2.0:1786002509.631562:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784137ea lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af5784137e3 expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002509.631588:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627 00000100:00100000:2.0:1786002509.631595:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3647:x1872758560901504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002509.631603:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1786002509.633827:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983502 is committed 00000001:00080000:0.0:1786002509.633861:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983501 is committed 00010000:00010000:2.0:1786002509.644368:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784137ea lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0xb73071de bits 0x23/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af5784137e3 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.644391:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xb73071de (ffff9ed245fed000) 00010000:00010000:2.0:1786002509.644397:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.644406:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.644415:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.644502:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002509.644581:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758560901504:12345-0@lo:103:ldlm_bl.0 Request processed in 12984us (13117us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.644593:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627 00000100:00100000:1.0:1786002509.644682:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560901504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002509.647725:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.647741:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002509.648712:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244eb6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560901632:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1786002509.648776:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002509.648818:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002509.648982:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560901632 00000100:00100000:2.0:1786002509.648990:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560901632 00000100:00100000:2.0:1786002509.649045:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3630 00000100:00100000:2.0:1786002509.649055:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14496:x1872758560901632:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1786002509.649144:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14496:x1872758560901632:12345-0@lo:1000:mdt00_004.0 Request processed in 90us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.649156:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3630 00000100:00100000:1.0:1786002509.649218:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244eb6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560901632:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1786002509.649273:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578413c5f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649287:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578413c5f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649298:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578413c5f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649315:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413c51 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649322:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413c51 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649327:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413c51 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649333:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413c51 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649339:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ea00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002509.649342:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413c51 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649349:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413c51 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649359:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:1.0:1786002509.649370:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002509.649375:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413c51 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649381:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578413c51 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649393:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649399:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649406:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649411:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002509.649413:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649420:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649428:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xb73071de (ffff9ed245fed000) 00010000:00010000:1.0:1786002509.649430:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002509.649433:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649438:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c58 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649481:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413c4a lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a805 expref: 36 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649494:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578413c5f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a805 expref: 35 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.649501:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff9ed366e56400) 00010000:00010000:1.0:1786002509.649503:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002509.649505:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7ec00, rc 0) 00000100:00100000:1.0:1786002509.649553:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530848384:12345-192.168.203.49@tcp:101:ls.0 Request processed in 19356us (19583us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.649564:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23761 00000100:00100000:1.0:1786002509.665200:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.665378:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530848640 00000100:00100000:3.0:1786002509.665387:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530848640 00000100:00100000:3.0:1786002509.665446:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23762 00000100:00100000:3.0:1786002509.665456:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+39:17796:x1872758530848640:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002509.665489:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002509.665513:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af578413c66 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a80c expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002509.665669:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x186:0x0]: returning size 4096 00010000:00010000:3.0:1786002509.665746:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af578413c66 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a80c expref: 41 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.665759:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:3.0:1786002509.665762:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002509.665767:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b000/0x7cee4af578413c66 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a80c expref: 41 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.665785:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b000, rc 0) 00000100:00100000:3.0:1786002509.665898:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:17796:x1872758530848640:12345-192.168.203.49@tcp:101:ls.0 Request processed in 386us (659us total) trans 4294968483 rc 301/301 00000100:00100000:3.0:1786002509.665906:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23762 00000100:00100000:0.0:1786002509.686441:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.686638:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530848768 00000100:00100000:2.0:1786002509.686648:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530848768 00000100:00100000:2.0:1786002509.686711:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23763 00000100:00100000:2.0:1786002509.686721:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:17796:x1872758530848768:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002509.686744:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002509.686766:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578413c74 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a813 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.686822:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.686836:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.686898:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002509.686945:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xcb:0x0]: returning size 4096 00000004:00200000:2.0:1786002509.686949:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1786002509.686980:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578413c74 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a813 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.686997:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a813 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.687005:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcb:0x0].0x0 (ffff9ed24556ed00) 00010000:00010000:2.0:1786002509.687008:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002509.687012:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2423b4c00, rc 0) 00000100:00100000:2.0:1786002509.687072:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+41:17796:x1872758530848768:12345-192.168.203.49@tcp:101:ls.0 Request processed in 353us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.687079:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23763 00000100:00100000:2.0:1786002509.698784:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002509.698886:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530848896 00000100:00100000:1.0:1786002509.698895:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530848896 00000100:00100000:1.0:1786002509.698951:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23764 00000100:00100000:1.0:1786002509.698960:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530848896:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002509.698979:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002509.699002:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413c82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a81a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699118:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699141:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699152:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699163:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699170:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699175:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699181:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002509.699185:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699193:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699205:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed35363d800) 00010000:00010000:1.0:1786002509.699208:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002509.699213:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699219:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413c89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699250:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413c82 lrc: 1/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a81a expref: 36 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699260:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed35363d800) 00010000:00010000:1.0:1786002509.699263:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002509.699266:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413c82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a81a expref: 36 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.699279:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e200, rc 0) 00000100:00100000:1.0:1786002509.699340:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530848896:12345-192.168.203.49@tcp:101:ls.0 Request processed in 380us (563us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002509.699347:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23764 00000100:00100000:1.0:1786002509.716939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.717030:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530849024 00000100:00100000:0.0:1786002509.717039:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530849024 00000100:00100000:0.0:1786002509.717094:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23765 00000100:00100000:0.0:1786002509.717103:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+41:17796:x1872758530849024:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002509.717122:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002509.717343:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578413c90 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a821 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.717420:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578413c97 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.717433:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578413c97 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x186:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.717445:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578413c97 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x186:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002509.717542:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x186:0x0]: returning size 4096 00000004:00200000:0.0:1786002509.717547:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1786002509.717565:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578413c97 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x186:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.717592:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578413c90 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a821 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.717613:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578413c97 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x186:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a821 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.717627:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff9ed36e785f00) 00010000:00010000:0.0:1786002509.717630:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002509.717634:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35e00, rc 0) 00000100:00100000:0.0:1786002509.717748:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+42:17796:x1872758530849024:12345-192.168.203.49@tcp:101:ls.0 Request processed in 645us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.717755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23765 00000100:00100000:0.0:1786002509.731355:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.736795:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530849152 00000100:00100000:3.0:1786002509.736809:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530849152 00000100:00100000:3.0:1786002509.736903:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23766 00000100:00100000:3.0:1786002509.736915:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530849152:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002509.736935:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002509.736955:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413c9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a828 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.737344:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413ca5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.737358:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.737427:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.737437:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.737443:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413ca5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.737449:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.737455:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002509.737459:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.738250:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.738266:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:3.0:1786002509.738269:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002509.738274:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413ca5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.738330:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af578413ca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.738445:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413c9e lrc: 1/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a828 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.738457:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:3.0:1786002509.738460:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002509.738464:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413c9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a828 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.738538:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b000, rc 0) 00000100:00100000:3.0:1786002509.738638:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530849152:12345-192.168.203.49@tcp:101:ls.0 Request processed in 1725us (7291us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002509.738647:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23766 00010000:00010000:3.0:1786002509.740477:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002509.755798:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.757455:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530849280 00000100:00100000:3.0:1786002509.758269:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530849280 00000100:00100000:2.0:1786002509.762439:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23767 00000100:00100000:2.0:1786002509.762626:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530849280:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:2.0:1786002509.762649:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002509.762672:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578413cac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a82f expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762790:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413cb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762804:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762814:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762823:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762829:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413cb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762836:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762866:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed3429ea000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002509.762871:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762878:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762888:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed24556e700) 00010000:00010000:2.0:1786002509.762892:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002509.762895:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413cb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762901:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413cb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762933:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578413cac lrc: 1/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a82f expref: 36 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762942:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed24556e700) 00010000:00010000:2.0:1786002509.762944:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002509.762947:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578413cac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a82f expref: 36 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.762961:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2423b4400, rc 0) 00000100:00100000:2.0:1786002509.766873:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530849280:12345-192.168.203.49@tcp:101:ls.0 Request processed in 570us (7230us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002509.766893:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23767 00000100:00100000:1.0:1786002509.774540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.780532:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530849408 00000100:00100000:0.0:1786002509.780546:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530849408 00000100:00100000:0.0:1786002509.780654:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23768 00000100:00100000:0.0:1786002509.780667:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530849408:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002509.780687:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002509.780711:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413cba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a836 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780820:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578413cc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780833:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578413cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780866:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578413cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780876:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578413cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780882:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578413cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780889:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578413cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780895:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002509.780899:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578413cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780906:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578413cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780916:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed36e785200) 00010000:00010000:0.0:1786002509.780919:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002509.780923:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578413cc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780929:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578413cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780957:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413cba lrc: 1/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a836 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780966:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed36e785200) 00010000:00010000:0.0:1786002509.780968:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002509.780972:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413cba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a836 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.780983:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34400, rc 0) 00000100:00100000:0.0:1786002509.781055:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530849408:12345-192.168.203.49@tcp:101:ls.0 Request processed in 391us (6523us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002509.781065:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23768 00000100:00100000:0.0:1786002509.797510:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.797636:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530849536 00000100:00100000:2.0:1786002509.797646:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530849536 00000100:00100000:2.0:1786002509.797702:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5050 00000100:00100000:2.0:1786002509.797713:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+42:17796:x1872758530849536:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:2.0:1786002509.809753:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+42:17796:x1872758530849536:12345-192.168.203.49@tcp:37:ls.0 Request processed in 12032us (12242us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.809765:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5050 00000100:00100000:1.0:1786002509.813164:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.813296:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530849664 00000100:00100000:3.0:1786002509.813307:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530849664 00000100:00100000:3.0:1786002509.813372:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23769 00000100:00100000:3.0:1786002509.813382:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:17796:x1872758530849664:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:3.0:1786002509.813401:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002509.813423:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413cc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a83d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.813454:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a83d expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.813467:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a83d expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.813477:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:3.0:1786002509.813480:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002509.813483:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b000, rc 0) 00000100:00100000:3.0:1786002509.813539:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:17796:x1872758530849664:12345-192.168.203.49@tcp:101:ls.0 Request processed in 159us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002509.813546:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23769 00000100:00100000:0.0:1786002509.821111:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.821274:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530849792 00000100:00100000:3.0:1786002509.821284:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530849792 00000100:00100000:3.0:1786002509.821339:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5051 00000100:00100000:3.0:1786002509.821349:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:17796:x1872758530849792:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:3.0:1786002509.821494:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:17796:x1872758530849792:12345-192.168.203.49@tcp:37:ls.0 Request processed in 146us (391us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002509.821502:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5051 00000100:00100000:2.0:1786002509.874695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002509.874785:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530850048 00000100:00100000:1.0:1786002509.874795:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530850048 00000100:00100000:1.0:1786002509.874890:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5052 00000100:00100000:1.0:1786002509.874900:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+42:17796:x1872758530850048:12345-192.168.203.49@tcp:35:ls.0 00000100:00100000:1.0:1786002509.875093:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+43:17796:x1872758530850048:12345-192.168.203.49@tcp:35:ls.0 Request processed in 193us (405us total) trans 4294968484 rc 0/0 00000100:00100000:1.0:1786002509.875101:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5052 00000100:00100000:2.0:1786002509.929902:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.930618:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530850304 00000100:00100000:0.0:1786002509.930627:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530850304 00000100:00100000:0.0:1786002509.930685:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23770 00000100:00100000:0.0:1786002509.930694:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+43:17798:x1872758530850304:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:0.0:1786002509.930717:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002509.930737:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413ccf lrc: 2/0,0 mode: --/CR res: [0x240000402:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a852 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002509.930947:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x95:0x0]: returning size 4096 00010000:00010000:0.0:1786002509.931046:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413ccf lrc: 1/0,0 mode: --/CR res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a852 expref: 45 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.931060:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x95:0x0].0x0 (ffff9ed245fedb00) 00010000:00010000:0.0:1786002509.931064:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002509.931069:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413ccf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a852 expref: 45 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.931083:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35a00, rc 0) 00000100:00100000:0.0:1786002509.931144:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+44:17798:x1872758530850304:12345-192.168.203.49@tcp:101:rm.0 Request processed in 450us (1250us total) trans 4294968485 rc 301/301 00000100:00100000:0.0:1786002509.931151:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23770 00000100:00100000:0.0:1786002509.935762:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002509.935880:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530850432 00000100:00100000:3.0:1786002509.935888:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530850432 00000100:00100000:3.0:1786002509.935938:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3631 00000100:00100000:3.0:1786002509.935947:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+44:2410:x1872758530850432:12345-192.168.203.49@tcp:63:ll_sa.0 00010000:00010000:3.0:1786002509.935980:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002509.935997:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af578413cdd lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a844 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936060:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af578413ce4 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936074:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af578413ce4 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936085:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af578413ce4 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936099:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c400/0x7cee4af578413ceb lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936106:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c400/0x7cee4af578413ceb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936113:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c400/0x7cee4af578413ceb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936168:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af578413cf2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936186:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af578413cf2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936194:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af578413cf2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002509.936265:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x72:0x0]: returning size 4096 00000004:00200000:3.0:1786002509.936269:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1786002509.936525:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af578413cf2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936538:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af578413ce4 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936544:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af578413ce4 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936551:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af578413ce4 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936557:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002509.936560:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af578413ce4 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936567:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af578413ce4 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936578:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:3.0:1786002509.936581:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002509.936585:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af578413ce4 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936590:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af578413ce4 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936602:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c400/0x7cee4af578413ceb lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936607:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c400/0x7cee4af578413ceb lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936613:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c400/0x7cee4af578413ceb lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936619:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002509.936622:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c400/0x7cee4af578413ceb lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936627:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c400/0x7cee4af578413ceb lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936634:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x94df4dce (ffff9ed245fede00) 00010000:00010000:3.0:1786002509.936636:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002509.936639:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c400/0x7cee4af578413ceb lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936649:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c400/0x7cee4af578413ceb lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936677:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a400/0x7cee4af578413cdd lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a844 expref: 46 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936691:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af578413cf2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a844 expref: 45 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936698:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x72:0x0].0x0 (ffff9ed245fed800) 00010000:00010000:3.0:1786002509.936700:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786002509.936702:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8da00, rc 0) 00010000:00010000:3.0:1786002509.936707:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002509.936715:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af578413cf9 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a84b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936737:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578413d00 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936745:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578413d00 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936753:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578413d00 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936764:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af578413d07 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936771:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af578413d07 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936777:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af578413d07 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936800:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578413d0e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936807:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578413d0e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936813:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578413d0e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002509.936879:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x90:0x0]: returning size 4096 00000004:00200000:3.0:1786002509.936883:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1786002509.936895:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578413d0e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936904:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578413d00 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936910:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578413d00 lrc: 2/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936915:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578413d00 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936920:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8de00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002509.936923:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578413d00 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936929:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578413d00 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936938:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:3.0:1786002509.936940:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002509.936943:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578413d00 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936948:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578413d00 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936956:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af578413d07 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936962:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af578413d07 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936967:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af578413d07 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936972:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002509.936974:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af578413d07 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936980:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af578413d07 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936986:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xce6cbcc (ffff9ed245fed400) 00010000:00010000:3.0:1786002509.936988:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002509.936990:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af578413d07 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.936995:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af578413d07 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.937020:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af578413cf9 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a84b expref: 47 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.937031:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578413d0e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a84b expref: 46 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.937038:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x90:0x0].0x0 (ffff9ed35363d100) 00010000:00010000:3.0:1786002509.937040:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786002509.937042:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d400, rc 0) 00000100:00100000:3.0:1786002509.938249:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:2410:x1872758530850432:12345-192.168.203.49@tcp:63:ll_sa.0 Request processed in 2298us (2489us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002509.938260:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3631 00000100:00100000:2.0:1786002509.956028:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002509.956796:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530850688 00000100:00100000:1.0:1786002509.956806:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530850688 00000100:00100000:1.0:1786002509.956888:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5053 00000100:00100000:1.0:1786002509.956898:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:17798:x1872758530850688:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:1.0:1786002509.957118:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530850688:12345-192.168.203.49@tcp:35:rm.0 Request processed in 221us (1098us total) trans 4294968486 rc 0/0 00000100:00100000:1.0:1786002509.957126:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5053 00000100:00100000:0.0:1786002509.965521:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002509.969031:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002509.969118:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530851072 00000100:00100000:0.0:1786002509.969128:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530851072 00000100:00100000:0.0:1786002509.969190:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23771 00000100:00100000:0.0:1786002509.969200:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530851072:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002509.969258:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002509.969285:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b800/0x7cee4af578413987 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x95:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ca expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.969304:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x95:0x0].0x0 (ffff9ed245fedb00) 00010000:00010000:0.0:1786002509.969315:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002509.969360:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.969377:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.969386:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002509.969406:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560901760:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1786002509.969452:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002509.969510:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002509.969608:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560901760 00000100:00100000:2.0:1786002509.969613:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560901760 00000100:00100000:2.0:1786002509.969649:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3632 00000100:00100000:2.0:1786002509.969656:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6522:x1872758560901760:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002509.969670:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002509.969684:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413d1c lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413d15 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.969706:0:15596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a637 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.969715:0:15596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413d1c lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413d15 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.969738:0:15596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a637 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.969751:0:15596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a637 expref: 35 pid: 6520 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002509.969767:0:15596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560901888:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002509.969824:0:15596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d180 going to sleep for 11 seconds 00000100:00100000:1.0:1786002509.974257:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530850816 00000100:00100000:1.0:1786002509.974268:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530850816 00000100:00100000:1.0:1786002509.974435:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1399 00000100:00100000:1.0:1786002509.974446:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:2410:x1872758530850816:12345-192.168.203.49@tcp:103:rm.0 00010000:00010000:1.0:1786002509.974461:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002509.974484:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af57841396b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6bc expref: 36 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.974503:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x95:0x0].0x0 (ffff9ed24556e900) 00010000:00010000:1.0:1786002509.974512:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002509.974559:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:2410:x1872758530850816:12345-192.168.203.49@tcp:103:rm.0 Request processed in 116us (9047us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.974566:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1399 00000100:00100000:2.0:1786002509.974658:0:15596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560901888:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002509.974685:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413d1c lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d15 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.974694:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:2.0:1786002509.974697:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002509.974701:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413d1c lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d15 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.974711:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed3429ea000, rc 0) 00000100:00100000:2.0:1786002509.974774:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6522:x1872758560901760:12345-0@lo:101:mdt00_002.0 Request processed in 5118us (5319us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.974781:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3632 00000100:00100000:3.0:1786002509.975742:0:6522:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983502 gen 2 00000004:00080000:3.0:1786002509.975749:0:6522:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983502 committed transno 4294983502 00000100:00100000:3.0:1786002509.975770:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560901760:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1786002509.975785:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.975796:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002509.981402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002509.981534:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530851200 00000100:00100000:1.0:1786002509.981544:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530851200 00010000:00010000:1.0:1786002509.981579:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a637 expref: 35 pid: 6520 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002509.981618:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1628 00000100:00100000:1.0:1786002509.981627:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:2413:x1872758530851200:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002509.981641:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002509.981648:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a637 expref: 35 pid: 6520 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.981661:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a637 expref: 35 pid: 6520 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.981681:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af57841381b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a637 expref: 35 pid: 6520 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.981697:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:1.0:1786002509.981703:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413d1c lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d15 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.981714:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413d1c lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413d15 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.981722:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413d1c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413d15 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.981754:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413d1c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d15 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002509.981772:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6505:1872758560902016:0@lo:105: 00000100:00100000:1.0:1786002509.981812:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002509.981879:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002509.981965:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560902016 00000100:00100000:0.0:1786002509.981970:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560902016 00000100:00100000:0.0:1786002509.981995:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1786002509.982001:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6505:x1872758560902016:12345-0@lo:105: 00010000:00010000:0.0:1786002509.982011:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.982025:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.982032:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.982039:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.982046:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.982063:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002509.982087:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f35a00) 00000100:00100000:0.0:1786002509.982129:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6505:x1872758560902016:12345-0@lo:105: Request processed in 128us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002509.982136:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1786002509.982459:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6505:1872758560902016:0@lo:105: 00010000:00010000:2.0:1786002509.982474:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002509.982517:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+34:2413:x1872758530851200:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 890us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002509.982524:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1628 00010000:00010000:1.0:1786002509.982688:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.982698:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002509.982718:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1786002509.982748:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578413d23 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.982755:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578413d23 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.982763:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578413d23 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002509.982777:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560902144:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1786002509.982804:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002509.982822:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002509.982919:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560902144 00000100:00100000:3.0:1786002509.982924:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560902144 00000100:00100000:3.0:1786002509.982951:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3633 00000100:00100000:3.0:1786002509.982957:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:6522:x1872758560902144:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1786002509.982970:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002509.982984:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578413d2a lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413d23 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.983003:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578413d2a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413d23 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.983014:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578413d2a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d23 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002509.983021:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xb5c6597d (ffff9ed245fed400) 00010000:00010000:3.0:1786002509.983024:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002509.983026:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c200, rc 0) 00000100:00100000:3.0:1786002509.983069:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560902144:12345-0@lo:101:mdt00_002.0 Request processed in 112us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002509.983074:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3633 00000100:00100000:2.0:1786002509.983188:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560902144:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002509.983200:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578413d23 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413d2a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.983214:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578413d23 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d2a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002509.983224:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:2.0:1786002509.983252:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560902272:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786002509.983277:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002509.983301:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002509.983529:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560902272 00000100:00100000:3.0:1786002509.983534:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560902272 00000100:00100000:3.0:1786002509.983561:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3634 00000100:00100000:3.0:1786002509.983568:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560902272:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786002509.983620:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560902272:12345-0@lo:1000:mdt00_002.0 Request processed in 53us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002509.983626:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3634 00000100:00100000:2.0:1786002509.984273:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560902272:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786002509.984384:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560902400:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786002509.984411:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002509.984436:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002509.984498:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560902400 00000100:00100000:3.0:1786002509.984503:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560902400 00000100:00100000:3.0:1786002509.984533:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3635 00000100:00100000:3.0:1786002509.984540:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560902400:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786002509.984617:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560902400:12345-0@lo:1000:mdt00_002.0 Request processed in 78us (205us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002509.984627:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3635 00000100:00100000:2.0:1786002509.984732:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560902400:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1786002509.984773:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.984782:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.984790:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002509.984801:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560902528:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1786002509.984822:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002509.984873:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d180 going to sleep for 11 seconds 00000100:00100000:1.0:1786002509.986569:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560902528 00000100:00100000:1.0:1786002509.986577:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560902528 00000100:00100000:1.0:1786002509.986621:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3636 00000100:00100000:1.0:1786002509.986629:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560902528:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002509.986643:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002509.986660:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413d38 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413d31 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.986685:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413d38 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413d31 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.986698:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413d38 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d31 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002509.986706:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x95:0x0].0x0 (ffff9ed35363dd00) 00010000:00010000:1.0:1786002509.986709:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002509.986713:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f600, rc 0) 00000100:00100000:1.0:1786002509.986761:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6522:x1872758560902528:12345-0@lo:101:mdt00_002.0 Request processed in 133us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002509.986767:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3636 00000100:00100000:2.0:1786002509.989621:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560902528:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002509.989644:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413d38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.989657:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.989691:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413d3f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x95:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.989701:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413d3f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.989708:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413d3f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.989724:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.989735:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413995 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d1 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.989742:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 4/0,1 mode: --/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.989769:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413995 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d1 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002509.989782:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413995 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d1 expref: 46 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002509.989794:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758560902656:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002509.989895:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d180 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.002302:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.002448:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758560902656:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002510.002475:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.007962:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530851328 00000100:00100000:3.0:1786002510.007976:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530851328 00010000:00010000:3.0:1786002510.008096:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413995 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d1 expref: 47 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.008147:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1629 00000100:00100000:3.0:1786002510.008157:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:2412:x1872758530851328:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002510.008171:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.008176:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413995 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d1 expref: 47 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.008190:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413995 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d1 expref: 47 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.008210:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a600/0x7cee4af578413995 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d1 expref: 47 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.008226:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4f:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:3.0:1786002510.008231:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.008240:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.008247:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.008279:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002510.009469:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.009490:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.009538:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.009545:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.009555:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.009574:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560902784:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1786002510.009624:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.009669:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560902784 00000100:00100000:0.0:1786002510.009675:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560902784 00000100:00100000:0.0:1786002510.009709:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3637 00000100:00100000:0.0:1786002510.009716:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:6522:x1872758560902784:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1786002510.009731:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002510.009744:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578413d54 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413d4d expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.009765:0:20598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784139a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d8 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.009774:0:20598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578413d54 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413d4d expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.009796:0:20598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784139a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d8 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.009814:0:20598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784139a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d8 expref: 33 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.009824:0:20598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20598:1872758560902912:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002510.009903:0:20598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.010006:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.010136:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:2412:x1872758530851328:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 1979us (7842us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.010145:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1629 00000100:00080000:2.0:1786002510.015454:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786002510.022995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.023103:0:20598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20598:1872758560902912:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002510.023145:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578413d54 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d4d expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.023159:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:0.0:1786002510.023162:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002510.023166:0:20598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578413d54 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d4d expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.023176:0:20598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578413d54 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d4d expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.023183:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34200, rc 0) 00000100:00100000:0.0:1786002510.023237:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:6522:x1872758560902784:12345-0@lo:101:mdt00_002.0 Request processed in 13520us (13611us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.023244:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3637 00000100:00100000:2.0:1786002510.023473:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560902784:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002510.023500:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.023512:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.023573:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530851456 00000100:00100000:1.0:1786002510.023579:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530851456 00010000:00010000:1.0:1786002510.023620:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784139a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d8 expref: 34 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.023654:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1630 00000100:00100000:1.0:1786002510.023664:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34656b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+34:2412:x1872758530851456:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002510.023679:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002510.023686:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784139a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d8 expref: 34 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.023698:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784139a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d8 expref: 34 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.023723:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af5784139a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6d8 expref: 34 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.023737:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:1.0:1786002510.023741:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578413d54 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d4d expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.023750:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578413d54 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413d4d expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.023757:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578413d54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413d4d expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.023783:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578413d54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d4d expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.023794:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560903040:0@lo:105: 00000100:00100000:1.0:1786002510.023826:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786002510.023941:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786002510.023996:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.028370:0:17237:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786002510.028398:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560903040 00000100:00100000:0.0:1786002510.028406:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560903040 00000100:00100000:0.0:1786002510.028465:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1786002510.028569:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243666c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560903040:12345-0@lo:105: 00010000:00010000:0.0:1786002510.028585:0:17237:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 5/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.028596:0:17237:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 5/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.028606:0:17237:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 5/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.028615:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.028623:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.028631:0:17237:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.028659:0:17237:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f35400) 00000100:00100000:0.0:1786002510.028727:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243666c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560903040:12345-0@lo:105: Request processed in 162us (4899us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.028735:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1786002510.028835:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560903040:0@lo:105: 00010000:00010000:2.0:1786002510.028875:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.028886:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002510.028889:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.028930:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34656b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:2412:x1872758530851456:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 5265us (5941us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.028939:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1630 00000100:00100000:2.0:1786002510.029616:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245510380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560903168:0@lo:403:mdt00_002.0 00000100:00100000:2.0:1786002510.029669:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.029695:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.029746:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560903168 00000100:00100000:1.0:1786002510.029751:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560903168 00000100:00100000:1.0:1786002510.029784:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3638 00000100:00100000:1.0:1786002510.029791:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6522:x1872758560903168:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1786002510.033006:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6522:x1872758560903168:12345-0@lo:403:mdt00_002.0 Request processed in 3208us (3340us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.033019:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3638 00000100:00100000:2.0:1786002510.033272:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245510380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560903168:0@lo:403:mdt00_002.0 00000040:00080000:2.0:1786002510.035524:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].404, 952 off608792 00000040:00080000:2.0:1786002510.035687:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].404, 1032 off657240 00000004:00080000:2.0:1786002510.035695:0:6522:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245e3dcc0 with version 767 00000004:00080000:1.0:1786002510.036048:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 767 rpc_version 767 00000020:00100000:1.0:1786002510.036086:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002510.036095:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed24351f800 x1872758560903424/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2608/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002510.036116:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560903424:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002510.036261:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.036293:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8000 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.036395:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560903424 00000100:00100000:0.0:1786002510.036401:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560903424 00000100:00100000:0.0:1786002510.036450:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3639 00000100:00100000:0.0:1786002510.036458:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:7466:x1872758560903424:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002510.036740:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:7466:x1872758560903424:12345-0@lo:1000:osp_up0-1.0 Request processed in 281us (479us total) trans 4294983503 rc 0/0 00000100:00100000:0.0:1786002510.036747:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3639 00000100:00100000:2.0:1786002510.037565:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560903424:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1786002510.037667:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x95:0x0]: returning size 4096 00010000:00010000:3.0:1786002510.037692:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037702:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037710:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037716:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002510.037724:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037730:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037743:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4f:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:3.0:1786002510.037746:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002510.037750:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037755:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578413d46 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037776:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037784:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037790:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037815:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002510.037823:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x4f:0x0] 00010000:00010000:3.0:1786002510.037832:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413d3f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037866:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413d3f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037873:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413d3f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037878:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002510.037881:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413d3f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037889:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413d3f lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037898:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x95:0x0].0x0 (ffff9ed24556e900) 00010000:00010000:3.0:1786002510.037900:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002510.037904:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413d3f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037909:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229200/0x7cee4af578413d3f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x95:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037923:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037930:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413d38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.037936:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413d38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.038004:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786002510.038012:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000004:00080000:0.0:1786002510.038016:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1786002510.038020:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.038024:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.038035:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002510.038042:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.038043:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002510.038057:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.038084:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.038090:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002510.038121:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 1/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.038130:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578413d4d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d54 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.038131:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002510.038149:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.038152:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.038153:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002510.038161:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786002510.038171:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560903552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.038193:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413d38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.038202:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002510.038206:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413d38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002510.038213:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413d38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.038233:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.038238:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1786002510.038245:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1786002510.038247:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.038256:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed2423b4400/0x7cee4af578413d31 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d38 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.038258:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560903680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.038275:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002510.038278:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002510.038280:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002510.038305:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.038428:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786002510.038537:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.038559:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786002510.038565:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1786002510.038570:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578413d23 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413d2a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.038578:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578413d23 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413d2a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.038641:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:17798:x1872758530851072:12345-192.168.203.49@tcp:36:rm.0 Request processed in 69441us (69616us total) trans 4294968487 rc 0/0 00000100:00100000:0.0:1786002510.038650:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23771 00010000:00010000:1.0:1786002510.038886:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002510.038892:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.038899:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35a00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002510.038903:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002510.038910:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.038930:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.038937:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002510.038957:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.038964:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35a00/0x7cee4af578413d15 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d1c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.038979:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.038981:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.038982:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002510.038988:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786002510.038997:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560903808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002510.039025:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.048205:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002510.052013:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560903680 00000100:00100000:3.0:1786002510.052026:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560903680 00000100:00100000:3.0:1786002510.052085:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560903552 00000100:00100000:3.0:1786002510.052088:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560903552 00000100:00100000:3.0:1786002510.052100:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560903808 00000100:00100000:3.0:1786002510.052102:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560903808 00000100:00100000:3.0:1786002510.052119:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1786002510.052127:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+16:3644:x1872758560903680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002510.052141:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.052163:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413d38 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x95:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413d31 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052191:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x95:0x0].0x0 (ffff9ed35363dd00) 00010000:00010000:3.0:1786002510.052202:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002510.052267:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+15:3644:x1872758560903680:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (13961us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.052275:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1786002510.052294:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1786002510.052300:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+14:3645:x1872758560903552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002510.052308:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.052320:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578413d54 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413d4d expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052330:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:3.0:1786002510.052337:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002510.052374:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3645:x1872758560903552:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (13945us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.052380:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1786002510.052392:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1786002510.052399:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3647:x1872758560903808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002510.052406:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.052416:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578413d1c lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413d15 expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052428:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed243ce3d00) 00010000:00010000:3.0:1786002510.052434:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002510.052460:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3647:x1872758560903808:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (13435us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.052466:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1786002510.052504:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560903552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.052530:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560903808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.052548:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530851584 00000100:00100000:3.0:1786002510.052551:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530851584 00000100:00100000:3.0:1786002510.052578:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3640 00000100:00100000:3.0:1786002510.052585:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:2411:x1872758530851584:12345-192.168.203.49@tcp:63:ll_sa.0 00010000:00010000:3.0:1786002510.052610:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002510.052624:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413d5b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a859 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052673:0:15596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d62 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052686:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d62 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052695:0:15596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d62 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052707:0:15596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d69 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052714:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d69 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052721:0:15596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d69 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052768:0:15596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578413d70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x141d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052778:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578413d70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x141d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052789:0:15596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578413d70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x141d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002510.052889:0:15596:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x141d:0x0]: returning size 4096 00000004:00200000:3.0:1786002510.052894:0:15596:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1786002510.052926:0:15596:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578413d70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x141d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052937:0:15596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d62 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052943:0:15596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d62 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052950:0:15596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d62 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052956:0:15596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8de00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002510.052959:0:15596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d62 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052966:0:15596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d62 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052974:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed245fede00) 00010000:00010000:3.0:1786002510.052977:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002510.052980:0:15596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d62 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052986:0:15596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d62 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.052998:0:15596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d69 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.053004:0:15596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d69 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.053009:0:15596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d69 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.053013:0:15596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002510.053015:0:15596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d69 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.053020:0:15596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d69 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.053025:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xee075455 (ffff9ed245fedb00) 00010000:00010000:3.0:1786002510.053027:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002510.053030:0:15596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d69 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.053035:0:15596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d69 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.053055:0:15596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413d5b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a859 expref: 35 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.053067:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578413d70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x141d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a859 expref: 34 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.053079:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x141d:0x0].0x0 (ffff9ed2456efc00) 00010000:00010000:3.0:1786002510.053081:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786002510.053084:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d200, rc 0) 00000100:00100000:3.0:1786002510.055088:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+34:2411:x1872758530851584:12345-192.168.203.49@tcp:63:ll_sa.0 Request processed in 2495us (6883us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.055100:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3640 00000100:00100000:3.0:1786002510.055163:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560903680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002510.059928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.059963:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530851840 00000100:00100000:1.0:1786002510.059972:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530851840 00000100:00100000:1.0:1786002510.060018:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23772 00000100:00100000:1.0:1786002510.060027:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:17798:x1872758530851840:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:1.0:1786002510.060050:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002510.060068:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413d77 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a860 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002510.060300:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x16f:0x0]: returning size 4096 00010000:00010000:1.0:1786002510.060447:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413d77 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a860 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.060463:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16f:0x0].0x0 (ffff9ed366e56300) 00010000:00010000:1.0:1786002510.060466:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002510.060470:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413d77 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a860 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.060483:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e200, rc 0) 00000100:00100000:1.0:1786002510.060524:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530851840:12345-192.168.203.49@tcp:101:rm.0 Request processed in 498us (606us total) trans 4294968488 rc 301/301 00000100:00100000:1.0:1786002510.060532:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23772 00000100:00100000:0.0:1786002510.070860:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002510.070903:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530852096 00000100:00100000:3.0:1786002510.070913:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530852096 00000100:00100000:3.0:1786002510.070962:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5054 00000100:00100000:3.0:1786002510.070973:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530852096:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:3.0:1786002510.071317:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530852096:12345-192.168.203.49@tcp:35:rm.0 Request processed in 345us (485us total) trans 4294968489 rc 0/0 00000100:00100000:3.0:1786002510.071325:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5054 00000100:00100000:1.0:1786002510.086153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.086201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002510.086315:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530852224 00000100:00100000:3.0:1786002510.086323:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530852224 00000100:00100000:3.0:1786002510.086394:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1403 00000100:00100000:2.0:1786002510.086395:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530852480 00000100:00100000:2.0:1786002510.086401:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530852480 00000100:00100000:3.0:1786002510.086406:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+34:2412:x1872758530852224:12345-192.168.203.49@tcp:103:rm.0 00010000:00010000:3.0:1786002510.086423:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.086446:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578413bb7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7bf expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.086450:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23773 00000100:00100000:2.0:1786002510.086462:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530852480:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:3.0:1786002510.086473:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16f:0x0].0x0 (ffff9ed24556e400) 00010000:00010000:3.0:1786002510.086485:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002510.086536:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:2412:x1872758530852224:12345-192.168.203.49@tcp:103:rm.0 Request processed in 133us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.086545:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1403 00010000:00010000:2.0:1786002510.086614:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.086630:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413bd3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7cd expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.086650:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16f:0x0].0x0 (ffff9ed366e56300) 00010000:00010000:2.0:1786002510.086658:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002510.086699:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.086707:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.086716:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.086735:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560903936:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002510.086770:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.086795:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.086992:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560903936 00000100:00100000:3.0:1786002510.086996:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560903936 00000100:00100000:3.0:1786002510.087027:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3641 00000100:00100000:3.0:1786002510.087034:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560903936:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002510.087047:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002510.087061:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d8c lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413d85 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.087080:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d8c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413d85 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.087092:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d8c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d85 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.087099:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed245fede00) 00010000:00010000:3.0:1786002510.087102:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002510.087104:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c400, rc 0) 00000100:00100000:3.0:1786002510.087146:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:14496:x1872758560903936:12345-0@lo:101:mdt00_004.0 Request processed in 112us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.087151:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3641 00000100:00100000:2.0:1786002510.087217:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560903936:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002510.087237:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413d8c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.087247:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d8c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002510.087265:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002510.087283:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af578413d93 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.087289:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af578413d93 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.087296:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af578413d93 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.087307:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560904064:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002510.087387:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.087410:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.087427:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560904064 00000100:00100000:3.0:1786002510.087432:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560904064 00000100:00100000:3.0:1786002510.087463:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3642 00000100:00100000:3.0:1786002510.087470:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:14496:x1872758560904064:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002510.087479:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002510.087491:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d9a lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413d93 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.087506:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d9a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413d93 expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.087515:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d9a lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413d93 expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.087521:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xee50ff8a (ffff9ed245fedb00) 00010000:00010000:3.0:1786002510.087524:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002510.087526:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8de00, rc 0) 00000100:00100000:3.0:1786002510.087563:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:14496:x1872758560904064:12345-0@lo:101:mdt00_004.0 Request processed in 93us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.087569:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3642 00000100:00100000:2.0:1786002510.088238:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560904064:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002510.088251:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af578413d93 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413d9a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.088261:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af578413d93 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d9a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002510.088273:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:2.0:1786002510.088382:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560904192:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1786002510.088414:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.088437:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.088679:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560904192 00000100:00100000:3.0:1786002510.088685:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560904192 00000100:00100000:3.0:1786002510.088723:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3643 00000100:00100000:3.0:1786002510.088731:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:14496:x1872758560904192:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002510.088803:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:14496:x1872758560904192:12345-0@lo:1000:mdt00_004.0 Request processed in 72us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.088810:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3643 00000100:00100000:2.0:1786002510.088900:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560904192:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1786002510.088940:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560904320:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1786002510.088962:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.088985:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.089025:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560904320 00000100:00100000:3.0:1786002510.089029:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560904320 00000100:00100000:3.0:1786002510.089119:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3644 00000100:00100000:3.0:1786002510.089126:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:14496:x1872758560904320:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002510.091873:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:14496:x1872758560904320:12345-0@lo:1000:mdt00_004.0 Request processed in 2740us (2902us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002510.091889:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3644 00000100:00100000:2.0:1786002510.092133:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560904320:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1786002510.092284:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.092294:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.092303:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.093187:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560904448:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002510.093228:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.093251:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d180 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.093388:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560904448 00000100:00100000:3.0:1786002510.093395:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560904448 00000100:00100000:3.0:1786002510.093472:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3645 00000100:00100000:3.0:1786002510.093481:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:14496:x1872758560904448:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002510.093496:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002510.093511:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578413da8 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413da1 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.093534:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578413da8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413da1 expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.093547:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578413da8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413da1 expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.093555:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16f:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:3.0:1786002510.093559:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002510.093562:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8dc00, rc 0) 00000100:00100000:3.0:1786002510.093602:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:14496:x1872758560904448:12345-0@lo:101:mdt00_004.0 Request processed in 122us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.093608:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3645 00000100:00100000:2.0:1786002510.093662:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560904448:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002510.093676:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413da8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.093687:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413da8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.093712:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578413daf lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.093720:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578413daf lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.093727:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578413daf lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.093761:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.093772:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578413be1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7d4 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.093780:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.093800:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578413be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7d4 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.093813:0:14496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578413be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7d4 expref: 47 pid: 6520 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.093824:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560904576:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002510.093910:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d180 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.103594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.103674:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530852608 00000100:00100000:0.0:1786002510.103683:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530852608 00010000:00010000:0.0:1786002510.103719:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578413be1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7d4 expref: 48 pid: 6520 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.103759:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1631 00000100:00100000:0.0:1786002510.103769:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:2412:x1872758530852608:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002510.103783:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.103788:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578413be1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7d4 expref: 48 pid: 6520 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.103801:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578413be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7d4 expref: 48 pid: 6520 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.103820:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbe:0x0].0x0 (ffff9ed24556eb00) 00010000:00010000:0.0:1786002510.103825:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.103833:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.103869:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.103887:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002510.103939:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:2412:x1872758530852608:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 171us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.103947:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1631 00010000:00010000:2.0:1786002510.104811:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578413be1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7d4 expref: 47 pid: 6520 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.104828:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560904576:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002510.104879:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.104888:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.104893:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.104930:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.104936:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.104945:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.104962:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560904704:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002510.104998:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.105026:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d180 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.105268:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560904704 00000100:00100000:0.0:1786002510.105273:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560904704 00000100:00100000:0.0:1786002510.105395:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3646 00000100:00100000:0.0:1786002510.105405:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:14496:x1872758560904704:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1786002510.105419:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002510.105432:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578413dc4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413dbd expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.105453:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413bef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7db expref: 32 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.105461:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578413dc4 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413dbd expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.105481:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413bef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7db expref: 32 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.105493:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413bef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7db expref: 32 pid: 10360 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.105503:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ed80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6526:1872758560904832:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002510.105555:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.111994:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ed80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6526:1872758560904832:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002510.112029:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578413dc4 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413dbd expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.112041:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbe:0x0].0x0 (ffff9ed245fedd00) 00010000:00010000:0.0:1786002510.112043:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002510.112047:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578413dc4 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413dbd expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.112067:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578413dc4 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413dbd expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.112074:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35200, rc 0) 00000100:00100000:0.0:1786002510.112129:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:14496:x1872758560904704:12345-0@lo:101:mdt00_004.0 Request processed in 6726us (7130us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.112144:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3646 00000100:00100000:1.0:1786002510.112303:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560904704:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1786002510.112330:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.112340:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.122481:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002510.125823:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530852736 00000100:00100000:3.0:1786002510.125859:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530852736 00010000:00010000:3.0:1786002510.125901:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413bef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7db expref: 33 pid: 10360 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.125994:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1632 00000100:00100000:3.0:1786002510.126004:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:2411:x1872758530852736:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002510.126018:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.126024:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413bef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7db expref: 33 pid: 10360 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.126037:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413bef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7db expref: 33 pid: 10360 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.126065:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af578413bef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xbe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7db expref: 33 pid: 10360 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.126080:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbe:0x0].0x0 (ffff9ed245fedd00) 00010000:00010000:3.0:1786002510.126086:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578413dc4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413dbd expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.126096:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578413dc4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413dbd expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.126105:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578413dc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413dbd expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.126133:0:10399:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578413dc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413dbd expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.126155:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:10399:1872758560904960:0@lo:105: 00000100:00100000:3.0:1786002510.126207:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.126249:0:10399:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf900 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.127878:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560904960 00000100:00100000:2.0:1786002510.127885:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560904960 00000100:00100000:2.0:1786002510.127916:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1786002510.127923:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10399:x1872758560904960:12345-0@lo:105: 00010000:00010000:2.0:1786002510.127935:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.127945:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.127953:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.127960:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.127967:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.127975:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.127998:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed243d2b200) 00000100:00100000:2.0:1786002510.128043:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10399:x1872758560904960:12345-0@lo:105: Request processed in 120us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.128061:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1786002510.128095:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:10399:1872758560904960:0@lo:105: 00010000:00010000:2.0:1786002510.128111:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002510.128158:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:2411:x1872758530852736:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 2154us (5684us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.128165:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1632 00010000:00010000:3.0:1786002510.128218:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.128228:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.128878:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560905088:0@lo:403:mdt00_004.0 00000100:00100000:3.0:1786002510.128917:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.128934:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf900 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.129227:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560905088 00000100:00100000:0.0:1786002510.129233:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560905088 00000100:00100000:0.0:1786002510.129267:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3647 00000100:00100000:0.0:1786002510.129274:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:14496:x1872758560905088:12345-0@lo:403:mdt00_004.0 00000100:00100000:0.0:1786002510.130823:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:14496:x1872758560905088:12345-0@lo:403:mdt00_004.0 Request processed in 1546us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.130833:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3647 00000100:00100000:3.0:1786002510.131210:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560905088:0@lo:403:mdt00_004.0 00000040:00080000:3.0:1786002510.136195:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].405, 952 off609744 00000040:00080000:3.0:1786002510.136452:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].405, 1032 off658272 00000004:00080000:3.0:1786002510.136459:0:14496:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed36faaf900 with version 768 00000004:00080000:2.0:1786002510.136754:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 768 rpc_version 768 00000020:00100000:2.0:1786002510.136786:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002510.136796:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed37bc50e00 x1872758560905344/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002510.136817:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560905344:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002510.136901:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.136932:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d240 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.137082:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560905344 00000100:00100000:0.0:1786002510.137089:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560905344 00000100:00100000:0.0:1786002510.137134:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3648 00000100:00100000:0.0:1786002510.137150:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:7466:x1872758560905344:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002510.137452:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:7466:x1872758560905344:12345-0@lo:1000:osp_up0-1.0 Request processed in 302us (549us total) trans 4294983504 rc 0/0 00000100:00100000:0.0:1786002510.137459:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3648 00000100:00100000:1.0:1786002510.137668:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560905344:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1786002510.138232:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x16f:0x0]: returning size 4096 00010000:00010000:3.0:1786002510.138251:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138261:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138268:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138274:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002510.138279:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138286:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138300:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbe:0x0].0x0 (ffff9ed24556eb00) 00010000:00010000:3.0:1786002510.138303:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002510.138307:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138375:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578413db6 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138397:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138407:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138414:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138470:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002510.138478:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xbe:0x0] 00010000:00010000:3.0:1786002510.138488:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578413daf lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138494:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578413daf lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138500:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578413daf lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138505:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002510.138508:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578413daf lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138513:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578413daf lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138522:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16f:0x0].0x0 (ffff9ed366e56300) 00010000:00010000:3.0:1786002510.138524:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002510.138527:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578413daf lrc: 2/0,0 mode: --/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138532:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578413daf lrc: 0/0,0 mode: --/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138543:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413da8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138550:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413da8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.138556:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413da8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.138583:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002510.138589:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.138595:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002510.138599:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002510.138606:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.138634:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.138645:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002510.138672:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 1/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.138680:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578413dbd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413dc4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.138693:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002510.138696:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413da8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.138702:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228e00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002510.138705:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413da8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002510.138712:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413da8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.138726:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 4/0,0 mode: --/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413da8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.138732:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002510.138746:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 3/0,0 mode: --/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413da8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.138754:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.138756:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.138758:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002510.138766:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786002510.138776:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560905600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002510.138811:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.138868:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560905600 00000100:00100000:1.0:1786002510.138873:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560905600 00000100:00100000:1.0:1786002510.138904:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:1.0:1786002510.138910:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34656b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+16:3645:x1872758560905600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002510.138920:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002510.138934:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578413da8 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413da1 expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.138945:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16f:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:1.0:1786002510.138951:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002510.138975:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34656b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+15:3645:x1872758560905600:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.138982:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:1.0:1786002510.139028:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560905600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002510.139213:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560905472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002510.139238:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.139453:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560905472 00000100:00100000:1.0:1786002510.139457:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560905472 00000100:00100000:1.0:1786002510.139488:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1786002510.139494:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+15:3647:x1872758560905472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002510.139501:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002510.139511:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578413dc4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413dbd expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.139522:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbe:0x0].0x0 (ffff9ed245fedd00) 00010000:00010000:1.0:1786002510.139528:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002510.139590:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+14:3647:x1872758560905472:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.139596:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00010000:00010000:3.0:1786002510.142343:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786002510.142357:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228e00/0x7cee4af578413da1 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x16f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413da8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002510.143164:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1786002510.143171:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413d8c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.143186:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413d8c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.143194:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413d8c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.143913:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002510.143921:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413d8c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.143929:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002510.143934:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413d8c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002510.143942:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413d8c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.143980:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 4/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d8c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.143991:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1786002510.144042:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560905728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002510.144106:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.144211:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560905472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.144472:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d8c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.144482:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002510.144484:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002510.144486:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002510.146904:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560905728 00000100:00100000:0.0:1786002510.146913:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560905728 00000100:00100000:0.0:1786002510.146978:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1786002510.146988:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+14:3645:x1872758560905728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002510.147001:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.147021:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578413d8c lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413d85 expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.147037:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed245fede00) 00010000:00010000:0.0:1786002510.147049:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002510.147331:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786002510.147339:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a228200/0x7cee4af578413d85 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d8c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002510.147369:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1786002510.147377:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af578413d93 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413d9a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.147386:0:14496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af578413d93 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413d9a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.147451:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530852480:12345-192.168.203.49@tcp:36:rm.0 Request processed in 60989us (61245us total) trans 4294968490 rc 0/0 00000100:00100000:3.0:1786002510.147459:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23773 00010000:00010000:2.0:1786002510.148165:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002510.150962:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+13:3645:x1872758560905728:12345-0@lo:103:ldlm_bl.0 Request processed in 3970us (6849us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.150975:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1786002510.151450:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560905728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002510.159772:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.159829:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530852992 00000100:00100000:0.0:1786002510.159870:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530852992 00000100:00100000:0.0:1786002510.159917:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23774 00000100:00100000:0.0:1786002510.159926:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530852992:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:0.0:1786002510.159948:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002510.159966:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578413dcb lrc: 2/0,0 mode: --/CR res: [0x240000402:0x72:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a867 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002510.160242:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x72:0x0]: returning size 4096 00010000:00010000:0.0:1786002510.160426:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578413dcb lrc: 1/0,0 mode: --/CR res: [0x240000402:0x72:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a867 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.160441:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x72:0x0].0x0 (ffff9ed245fed800) 00010000:00010000:0.0:1786002510.160444:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002510.160449:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578413dcb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x72:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a867 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.160462:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35c00, rc 0) 00000100:00100000:0.0:1786002510.160560:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530852992:12345-192.168.203.49@tcp:101:rm.0 Request processed in 634us (796us total) trans 4294968491 rc 301/301 00000100:00100000:0.0:1786002510.160567:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23774 00000100:00100000:0.0:1786002510.185194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.188231:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530853248 00000100:00100000:2.0:1786002510.188244:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530853248 00000100:00100000:2.0:1786002510.188403:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5055 00000100:00100000:2.0:1786002510.188416:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530853248:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:2.0:1786002510.188618:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:17798:x1872758530853248:12345-192.168.203.49@tcp:35:rm.0 Request processed in 204us (3484us total) trans 4294968492 rc 0/0 00000100:00100000:2.0:1786002510.192789:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5055 00000100:00100000:2.0:1786002510.194207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.194278:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530853504 00000100:00100000:1.0:1786002510.194287:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530853504 00000100:00100000:1.0:1786002510.194393:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23775 00000100:00100000:1.0:1786002510.194403:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:17798:x1872758530853504:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:1.0:1786002510.194454:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786002510.194477:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af578413cf2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x72:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a844 expref: 49 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194496:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5b200/0x7cee4af5784138a7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x72:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a66f expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194507:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x72:0x0].0x0 (ffff9ed245fed800) 00010000:00010000:1.0:1786002510.194521:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413829 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a63e expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194530:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed243ce3300) 00010000:00010000:1.0:1786002510.194535:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002510.194557:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af578413dd9 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194574:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af578413dd9 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194583:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af578413dd9 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194595:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413de0 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x94df4dce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194602:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413de0 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194609:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413de0 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194664:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413de7 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194672:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413de7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194678:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413de7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194692:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 3/0,1 mode: --/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194700:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784138b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a676 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194708:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 4/0,1 mode: --/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194735:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784138b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a676 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.194747:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784138b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a676 expref: 46 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.194761:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:10360:1872758560905856:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002510.194845:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.223527:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.223614:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530853632 00000100:00100000:0.0:1786002510.223623:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530853632 00010000:00010000:0.0:1786002510.223659:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784138b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a676 expref: 47 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.223699:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1633 00000100:00100000:0.0:1786002510.223708:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:2412:x1872758530853632:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002510.223723:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.223729:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784138b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a676 expref: 47 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.223744:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784138b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a676 expref: 47 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.223766:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x3e:0x0].0x0 (ffff9ed245fed100) 00010000:00010000:0.0:1786002510.223771:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 3/0,1 mode: --/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.223781:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.223789:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.223805:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002510.223889:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:2412:x1872758530853632:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 181us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.223897:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1633 00010000:00010000:1.0:1786002510.224085:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784138b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a676 expref: 46 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.224102:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:10360:1872758560905856:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002510.224122:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.224139:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.224146:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.224307:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.224371:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.224382:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.224403:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560905984:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1786002510.224439:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.224467:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8000 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.224879:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560905984 00000100:00100000:0.0:1786002510.224885:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560905984 00000100:00100000:0.0:1786002510.224919:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3649 00000100:00100000:0.0:1786002510.224926:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:10360:x1872758560905984:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786002510.224942:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002510.224955:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578413dfc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413df5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.224975:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784138c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a67d expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.224983:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578413dfc lrc: 4/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413df5 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.225004:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784138c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a67d expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.225016:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784138c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a67d expref: 31 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.225027:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6525:1872758560906112:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002510.225284:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.236733:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6525:1872758560906112:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002510.236768:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578413dfc lrc: 3/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413df5 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.236781:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9ed245fed600) 00010000:00010000:0.0:1786002510.236785:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002510.236789:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578413dfc lrc: 3/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413df5 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.236799:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578413dfc lrc: 3/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413df5 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.236806:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35c00, rc 0) 00000100:00100000:0.0:1786002510.236997:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:10360:x1872758560905984:12345-0@lo:101:mdt00_003.0 Request processed in 12070us (12556us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.237006:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3649 00000100:00100000:1.0:1786002510.238965:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560905984:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786002510.238989:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.239001:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.242748:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.242931:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530853760 00000100:00100000:2.0:1786002510.242939:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530853760 00010000:00010000:2.0:1786002510.242973:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784138c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a67d expref: 32 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.243011:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1634 00000100:00100000:2.0:1786002510.243019:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:2412:x1872758530853760:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.243033:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.243039:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784138c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a67d expref: 32 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.243067:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784138c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a67d expref: 32 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.243087:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784138c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a67d expref: 32 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.243102:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9ed245fed600) 00010000:00010000:2.0:1786002510.243108:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578413dfc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413df5 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.243118:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578413dfc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413df5 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.243126:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578413dfc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413df5 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.243162:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578413dfc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413df5 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.243181:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6507:1872758560906240:0@lo:105: 00000100:00100000:2.0:1786002510.243220:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.243251:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.243553:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560906240 00000100:00100000:3.0:1786002510.243558:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560906240 00000100:00100000:3.0:1786002510.243591:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1786002510.243598:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6507:x1872758560906240:12345-0@lo:105: 00010000:00010000:3.0:1786002510.243608:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.243617:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.243631:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.243638:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.243645:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.243652:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.243676:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245e7f200) 00000100:00100000:3.0:1786002510.243721:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6507:x1872758560906240:12345-0@lo:105: Request processed in 123us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.243727:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1786002510.243794:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6507:1872758560906240:0@lo:105: 00010000:00010000:0.0:1786002510.243810:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002510.243885:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:2412:x1872758530853760:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 866us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.243893:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1634 00010000:00010000:1.0:1786002510.244782:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.244794:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.245813:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560906368:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1786002510.245889:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.245958:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8000 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.254166:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560906368 00000100:00100000:0.0:1786002510.254187:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560906368 00000100:00100000:0.0:1786002510.254255:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3650 00000100:00100000:0.0:1786002510.254265:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:10360:x1872758560906368:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1786002510.258370:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:10360:x1872758560906368:12345-0@lo:403:mdt00_003.0 Request processed in 4091us (12465us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.258384:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3650 00000100:00100000:1.0:1786002510.262022:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560906368:0@lo:403:mdt00_003.0 00000040:00080000:1.0:1786002510.264579:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].406, 952 off610696 00000040:00080000:1.0:1786002510.264730:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].406, 1032 off659304 00000004:00080000:1.0:1786002510.264736:0:10360:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed2456d8000 with version 769 00000004:00080000:2.0:1786002510.267964:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 769 rpc_version 769 00000020:00100000:3.0:1786002510.270965:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002510.270981:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2454e2300 x1872758560906624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1992/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002510.271004:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560906624:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002510.271234:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.271303:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.275408:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560906624 00000100:00100000:0.0:1786002510.275422:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560906624 00000100:00100000:1.0:1786002510.278020:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3651 00000100:00100000:1.0:1786002510.278032:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:7466:x1872758560906624:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002510.278498:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:7466:x1872758560906624:12345-0@lo:1000:osp_up0-1.0 Request processed in 467us (7263us total) trans 4294983505 rc 0/0 00000100:00100000:1.0:1786002510.278506:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3651 00000100:00100000:3.0:1786002510.282286:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560906624:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1786002510.284276:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x72:0x0]: returning size 4096 00010000:00010000:2.0:1786002510.284304:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285156:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285164:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285171:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002510.285232:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285242:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285259:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x3e:0x0].0x0 (ffff9ed245fed100) 00010000:00010000:2.0:1786002510.285262:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002510.285267:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 2/0,0 mode: --/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285274:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578413dee lrc: 0/0,0 mode: --/EX res: [0x240000400:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285300:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285413:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285424:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285516:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002510.285526:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x3e:0x0] 00010000:00010000:2.0:1786002510.285536:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413de7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285543:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413de7 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285549:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413de7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285554:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002510.285557:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413de7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285563:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413de7 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285571:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x72:0x0].0x0 (ffff9ed351207e00) 00010000:00010000:2.0:1786002510.285573:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002510.285576:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413de7 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285582:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578413de7 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285600:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af578413dd9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285606:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af578413dd9 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285612:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af578413dd9 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285618:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af578413dd9 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285622:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002510.285624:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af578413dd9 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285629:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af578413dd9 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285635:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed35363dd00) 00010000:00010000:2.0:1786002510.285637:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002510.285640:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af578413dd9 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285646:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f600/0x7cee4af578413dd9 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002510.285658:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cab4c0c2 reply state 000000006aedaf27 transno 4294968493 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413de0 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285669:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413de0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.285676:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x94df4dce (ffff9ed351207500) 00010000:00010000:2.0:1786002510.285679:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002510.285682:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002510.285768:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530853504:12345-192.168.203.49@tcp:36:rm.0 Request processed in 91363us (91561us total) trans 4294968493 rc 0/0 00000100:00100000:2.0:1786002510.285777:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23775 00010000:00010000:1.0:1786002510.290374:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002510.290388:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.290400:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002510.290407:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002510.290417:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.290459:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.290465:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1786002510.290524:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560906752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002510.290586:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786002510.290653:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.290661:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f200/0x7cee4af578413df5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413dfc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.290680:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.290682:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.290684:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002510.290727:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560906752 00000100:00100000:2.0:1786002510.290734:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560906752 00000100:00100000:2.0:1786002510.290787:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1786002510.290796:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+15:3646:x1872758560906752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.290807:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.290824:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578413dfc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413df5 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.290865:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9ed245fed600) 00010000:00010000:2.0:1786002510.290877:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002510.303977:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+14:3646:x1872758560906752:12345-0@lo:103:ldlm_bl.0 Request processed in 13172us (13380us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.303991:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1786002510.306747:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002510.306808:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530854016 00000100:00100000:3.0:1786002510.306817:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530854016 00000100:00100000:3.0:1786002510.306954:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23776 00000100:00100000:3.0:1786002510.306964:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:17798:x1872758530854016:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:3.0:1786002510.306983:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002510.307001:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a86e expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002510.307170:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14f6:0x0]: returning size 4096 00010000:00010000:3.0:1786002510.307471:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e03 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a86e expref: 33 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.307486:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff9ed2456efd00) 00010000:00010000:3.0:1786002510.307489:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002510.307493:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a86e expref: 33 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.307506:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c000, rc 0) 00000100:00100000:3.0:1786002510.307591:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530854016:12345-192.168.203.49@tcp:101:rm.0 Request processed in 628us (850us total) trans 4294983506 rc 301/301 00000100:00100000:3.0:1786002510.307598:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23776 00000100:00100000:0.0:1786002510.309958:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560906752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.319789:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.319885:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530854272 00000100:00100000:0.0:1786002510.319894:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530854272 00000100:00100000:0.0:1786002510.319937:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5056 00000100:00100000:0.0:1786002510.319945:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530854272:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:0.0:1786002510.320160:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:17798:x1872758530854272:12345-192.168.203.49@tcp:35:rm.0 Request processed in 214us (378us total) trans 4294983507 rc 0/0 00000100:00100000:0.0:1786002510.320168:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5056 00000100:00100000:3.0:1786002510.325934:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.326027:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530854656 00000100:00100000:0.0:1786002510.326037:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530854656 00000100:00100000:0.0:1786002510.326097:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23777 00000100:00100000:0.0:1786002510.326106:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:17798:x1872758530854656:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002510.326167:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.326280:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578413b2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a787 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.326298:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff9ed2456efd00) 00010000:00010000:0.0:1786002510.326308:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002510.326376:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.326385:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.326395:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.326417:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560906880:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1786002510.326460:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.326496:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.327097:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560906880 00000100:00100000:2.0:1786002510.327103:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560906880 00000100:00100000:2.0:1786002510.327139:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3652 00000100:00100000:2.0:1786002510.327147:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6522:x1872758560906880:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002510.327157:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.327171:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af578413e18 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413e11 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.327394:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af578413e18 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413e11 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.327407:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af578413e18 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413e11 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.327415:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed24559f300) 00010000:00010000:2.0:1786002510.327418:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002510.327420:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2bc00, rc 0) 00000100:00100000:2.0:1786002510.327469:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6522:x1872758560906880:12345-0@lo:101:mdt00_002.0 Request processed in 323us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.327475:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3652 00000100:00100000:0.0:1786002510.327580:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560906880:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1786002510.327594:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413e18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.327604:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413e18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002510.327623:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1786002510.327646:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578413e1f lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.327653:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578413e1f lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.327666:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578413e1f lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.327678:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560907008:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1786002510.327702:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.327733:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.327771:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560907008 00000100:00100000:2.0:1786002510.327775:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560907008 00000100:00100000:2.0:1786002510.327831:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3653 00000100:00100000:2.0:1786002510.327874:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6522:x1872758560907008:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002510.327883:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.327894:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af578413e26 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413e1f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.327907:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af578413e26 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413e1f expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.327917:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af578413e26 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413e1f expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.327923:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x2153044 (ffff9ed24559f600) 00010000:00010000:2.0:1786002510.327926:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002510.327928:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b400, rc 0) 00000100:00100000:2.0:1786002510.327951:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6522:x1872758560907008:12345-0@lo:101:mdt00_002.0 Request processed in 114us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.327957:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3653 00000100:00100000:0.0:1786002510.328018:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560907008:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1786002510.328028:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578413e1f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413e26 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.328036:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578413e1f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413e26 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002510.328047:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1786002510.328103:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560907136:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786002510.328127:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.330674:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002510.330700:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530854400 00000100:00100000:3.0:1786002510.330707:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530854400 00000100:00100000:3.0:1786002510.330749:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1408 00000100:00100000:3.0:1786002510.330758:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:2413:x1872758530854400:12345-192.168.203.49@tcp:103:rm.0 00010000:00010000:3.0:1786002510.330769:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.330789:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46200/0x7cee4af578413b0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a779 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.330805:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff9ed2456efa00) 00010000:00010000:3.0:1786002510.330815:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002510.330885:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:2413:x1872758530854400:12345-192.168.203.49@tcp:103:rm.0 Request processed in 127us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.330892:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1408 00000100:00100000:0.0:1786002510.335506:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.339127:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560907136 00000100:00100000:1.0:1786002510.339148:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560907136 00000100:00100000:1.0:1786002510.339219:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3654 00000100:00100000:1.0:1786002510.339229:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6522:x1872758560907136:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002510.339515:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6522:x1872758560907136:12345-0@lo:1000:mdt00_002.0 Request processed in 287us (11386us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.339523:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3654 00000100:00100000:1.0:1786002510.339572:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560907136:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002510.339638:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560907264:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002510.339675:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.339696:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560907264 00000100:00100000:1.0:1786002510.339699:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560907264 00000100:00100000:1.0:1786002510.339714:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3655 00000100:00100000:1.0:1786002510.339719:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b581850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6522:x1872758560907264:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002510.339780:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b581850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6522:x1872758560907264:12345-0@lo:1000:mdt00_002.0 Request processed in 60us (104us total) trans 0 rc 1/1 00000100:00100000:1.0:1786002510.339787:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3655 00000100:00100000:1.0:1786002510.339922:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.339935:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560907264:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1786002510.339980:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.339991:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340000:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.340011:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560907392:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1786002510.340415:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.340437:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560907392 00000100:00100000:1.0:1786002510.340440:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560907392 00000100:00100000:1.0:1786002510.340456:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3656 00000100:00100000:1.0:1786002510.340461:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6522:x1872758560907392:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002510.340470:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002510.340483:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413e34 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413e2d expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340504:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413e34 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413e2d expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340515:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413e34 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413e2d expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340523:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff9ed351207400) 00010000:00010000:1.0:1786002510.340526:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002510.340530:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f000, rc 0) 00000100:00100000:1.0:1786002510.340550:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6522:x1872758560907392:12345-0@lo:101:mdt00_002.0 Request processed in 88us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.340556:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3656 00000100:00100000:1.0:1786002510.340569:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.340580:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560907392:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002510.340590:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413e34 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340600:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413e34 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340621:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413e3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340629:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413e3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340637:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413e3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340653:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340664:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af578413b39 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a78e expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340671:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 4/0,1 mode: --/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340689:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af578413b39 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a78e expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.340701:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af578413b39 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a78e expref: 32 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.340712:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1872758560907520:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002510.341448:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7abcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.346980:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1872758560907520:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002510.347008:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.353523:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.353664:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530854784 00000100:00100000:1.0:1786002510.353674:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530854784 00010000:00010000:1.0:1786002510.353710:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af578413b39 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a78e expref: 33 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.353792:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1635 00000100:00100000:1.0:1786002510.353802:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34656a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:2413:x1872758530854784:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002510.353817:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002510.353823:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af578413b39 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a78e expref: 33 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.353879:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af578413b39 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a78e expref: 33 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.353902:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af578413b39 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a78e expref: 33 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.353918:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xb7:0x0].0x0 (ffff9ed2456ef200) 00010000:00010000:1.0:1786002510.353923:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.353932:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.353938:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.353958:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002510.354010:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34656a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:2413:x1872758530854784:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 208us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.354017:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1635 00010000:00010000:0.0:1786002510.355285:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.355296:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.355351:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.355367:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.355378:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 3/0,1 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.355398:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560907648:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1786002510.355439:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.355467:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faafd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.357326:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560907648 00000100:00100000:3.0:1786002510.357337:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560907648 00000100:00100000:3.0:1786002510.357400:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3657 00000100:00100000:3.0:1786002510.357409:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6522:x1872758560907648:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1786002510.357426:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002510.357442:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af578413e50 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413e49 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.357467:0:20598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413b47 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a795 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.357478:0:20598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af578413e50 lrc: 4/0,0 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413e49 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.357504:0:20598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413b47 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a795 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.357517:0:20598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413b47 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a795 expref: 45 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.357536:0:20598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20598:1872758560907776:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002510.357595:0:20598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f480 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.361493:0:20598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:20598:1872758560907776:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002510.361527:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af578413e50 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413e49 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.361541:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb7:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:1.0:1786002510.361544:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002510.361548:0:20598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af578413e50 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413e49 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.361559:0:20598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af578413e50 lrc: 3/0,0 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413e49 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.361566:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ce00, rc 0) 00000100:00100000:1.0:1786002510.361614:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:6522:x1872758560907648:12345-0@lo:101:mdt00_002.0 Request processed in 4206us (6175us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.361623:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3657 00000100:00100000:2.0:1786002510.361710:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560907648:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002510.361727:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.361736:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 4/0,1 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.362533:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.362595:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530854912 00000100:00100000:1.0:1786002510.362601:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530854912 00010000:00010000:1.0:1786002510.362628:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413b47 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a795 expref: 46 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.362659:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1636 00000100:00100000:1.0:1786002510.362668:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:2412:x1872758530854912:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002510.362682:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002510.362689:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413b47 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a795 expref: 46 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.362700:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413b47 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a795 expref: 46 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.362719:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5a000/0x7cee4af578413b47 lrc: 0/0,0 mode: --/PR res: [0x240000401:0xb7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a795 expref: 46 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.362731:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb7:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:1.0:1786002510.362736:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af578413e50 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413e49 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.362745:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af578413e50 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413e49 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.362753:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af578413e50 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413e49 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.362778:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af578413e50 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413e49 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.362790:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6505:1872758560907904:0@lo:105: 00000100:00100000:1.0:1786002510.362820:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.362885:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.362963:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560907904 00000100:00100000:2.0:1786002510.362967:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560907904 00000100:00100000:2.0:1786002510.362999:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:2.0:1786002510.363005:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6505:x1872758560907904:12345-0@lo:105: 00010000:00010000:2.0:1786002510.363014:0:17237:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.363022:0:17237:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.363030:0:17237:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 5/0,1 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.363038:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.363044:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.363060:0:17237:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.363087:0:17237:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f35800) 00000100:00100000:2.0:1786002510.363116:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6505:x1872758560907904:12345-0@lo:105: Request processed in 111us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.363122:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1786002510.363302:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6505:1872758560907904:0@lo:105: 00010000:00010000:1.0:1786002510.363323:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002510.363370:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+45:2412:x1872758530854912:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 695us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.363379:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1636 00010000:00010000:1.0:1786002510.363398:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.363407:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.364004:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560908032:0@lo:403:mdt00_002.0 00000100:00100000:1.0:1786002510.364039:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.364061:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.364663:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560908032 00000100:00100000:2.0:1786002510.364669:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560908032 00000100:00100000:2.0:1786002510.364705:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3658 00000100:00100000:2.0:1786002510.364713:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6522:x1872758560908032:12345-0@lo:403:mdt00_002.0 00000100:00100000:3.0:1786002510.384922:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6522:x1872758560908032:12345-0@lo:403:mdt00_002.0 Request processed in 20202us (20874us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.384936:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3658 00000100:00100000:1.0:1786002510.393428:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1872758560908032:0@lo:403:mdt00_002.0 00000040:00080000:2.0:1786002510.399630:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].395, 952 off595008 00000040:00080000:2.0:1786002510.399792:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].394, 1032 off644144 00000004:00080000:2.0:1786002510.399799:0:6522:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed366d7d180 with version 753 00000004:00080000:3.0:1786002510.401521:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 753 rpc_version 753 00000020:00100000:3.0:1786002510.401558:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002510.401568:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244be6d80 x1872758560908288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2608/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002510.401590:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560908288:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002510.401650:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.401683:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.401768:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560908288 00000100:00100000:2.0:1786002510.401775:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560908288 00000100:00100000:2.0:1786002510.401817:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3659 00000100:00100000:2.0:1786002510.401826:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:7805:x1872758560908288:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002510.402515:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:7805:x1872758560908288:12345-0@lo:1000:osp_up1-0.0 Request processed in 368us (542us total) trans 4294968494 rc 0/0 00000100:00100000:2.0:1786002510.402524:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3659 00000100:00100000:3.0:1786002510.402615:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560908288:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1786002510.403143:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14f6:0x0]: returning size 4096 00010000:00010000:2.0:1786002510.403165:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403174:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403182:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403201:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002510.403206:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403213:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403227:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xb7:0x0].0x0 (ffff9ed2456ef200) 00010000:00010000:2.0:1786002510.403230:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002510.403235:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403240:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413e42 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403258:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403265:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403272:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403288:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002510.403295:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xb7:0x0] 00010000:00010000:2.0:1786002510.403304:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413e3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.403469:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002510.403477:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.403484:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002510.403488:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002510.403496:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.403524:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 2/0,0 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.403531:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002510.403564:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 1/0,0 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.403573:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413e49 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.403587:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.403589:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.403591:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002510.403636:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560908416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.403673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786002510.403742:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413e3b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403749:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413e3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403755:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002510.403758:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413e3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403764:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413e3b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403772:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff9ed351207000) 00010000:00010000:2.0:1786002510.403775:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002510.403778:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413e3b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403783:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413e3b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403797:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413e34 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403803:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413e34 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403810:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413e34 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403830:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002510.403868:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1786002510.403874:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413e18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403882:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413e18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403888:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413e18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403900:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1786002510.403904:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1786002510.403909:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578413e1f lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413e26 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.403917:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578413e1f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413e26 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.403975:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530854656:12345-192.168.203.49@tcp:36:rm.0 Request processed in 77868us (78046us total) trans 4294983508 rc 0/0 00000100:00100000:2.0:1786002510.403983:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23777 00010000:00010000:3.0:1786002510.404036:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786002510.404041:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413e34 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.404048:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002510.404060:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413e34 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002510.404072:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413e34 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.404091:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413e34 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.404096:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002510.404116:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 1/0,0 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413e34 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.404123:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f200/0x7cee4af578413e2d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413e34 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.404135:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002510.404138:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413e18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.404144:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002510.404147:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413e18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002510.404154:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413e18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.404168:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413e18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.404174:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002510.404180:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413e18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.404187:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578413e11 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413e18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.404207:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002510.404208:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002510.404210:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.404513:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002510.404524:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560908672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002510.404552:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.404580:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786002510.404585:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560908544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002510.404603:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.404624:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560908416 00000100:00100000:1.0:1786002510.404630:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560908416 00000100:00100000:1.0:1786002510.404660:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560908672 00000100:00100000:1.0:1786002510.404663:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560908672 00000100:00100000:1.0:1786002510.404675:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560908544 00000100:00100000:1.0:1786002510.404677:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560908544 00000100:00100000:1.0:1786002510.404689:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1786002510.404697:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+15:3647:x1872758560908416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002510.404709:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002510.404724:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af578413e50 lrc: 0/0,0 mode: --/EX res: [0x240000401:0xb7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413e49 expref: 15 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.404735:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xb7:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:1.0:1786002510.404742:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002510.404766:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+14:3647:x1872758560908416:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.404772:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1786002510.404783:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1786002510.404788:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+13:3645:x1872758560908672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002510.404795:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002510.404804:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af578413e18 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413e11 expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.404814:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed24559f300) 00010000:00010000:1.0:1786002510.404819:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002510.404868:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+12:3645:x1872758560908672:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.404875:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1786002510.404885:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:1.0:1786002510.404891:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+11:3645:x1872758560908544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002510.404898:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002510.404907:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413e34 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14f6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413e2d expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.404915:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14f6:0x0].0x0 (ffff9ed351207400) 00010000:00010000:1.0:1786002510.404921:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002510.404938:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3645:x1872758560908544:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.404943:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:1.0:1786002510.404972:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560908544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002510.404980:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560908672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.405471:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560908416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.412820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.416386:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530855040 00000100:00100000:2.0:1786002510.416400:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530855040 00000100:00100000:3.0:1786002510.419428:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23778 00000100:00100000:3.0:1786002510.419442:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530855040:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:3.0:1786002510.419465:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002510.419485:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578413e57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a875 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419590:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419604:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419615:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419625:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419631:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419638:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419645:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002510.419649:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419657:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419668:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:3.0:1786002510.419671:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002510.419675:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419682:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578413e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419711:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578413e57 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a875 expref: 33 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419721:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:3.0:1786002510.419724:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002510.419728:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578413e57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a875 expref: 33 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.419736:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c600, rc 0) 00000100:00100000:3.0:1786002510.419877:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530855040:12345-192.168.203.49@tcp:101:rm.0 Request processed in 437us (7066us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002510.419888:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23778 00000100:00100000:3.0:1786002510.429510:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.429670:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530855168 00000100:00100000:0.0:1786002510.429679:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530855168 00000100:00100000:0.0:1786002510.429732:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23779 00000100:00100000:0.0:1786002510.429741:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530855168:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:0.0:1786002510.429760:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002510.429778:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578413e65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a87c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.429916:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.429930:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.429942:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.429951:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.429957:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.429964:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.429969:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002510.429974:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.429980:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.429991:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002510.429994:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002510.429998:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.430004:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.430031:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578413e65 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a87c expref: 33 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.430041:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002510.430044:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002510.430047:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578413e65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a87c expref: 33 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.430069:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35800, rc 0) 00000100:00100000:0.0:1786002510.430130:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530855168:12345-192.168.203.49@tcp:101:rm.0 Request processed in 390us (629us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002510.430137:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23779 00000100:00100000:3.0:1786002510.436692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.436780:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530855424 00000100:00100000:2.0:1786002510.436790:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530855424 00000100:00100000:2.0:1786002510.436876:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23780 00000100:00100000:2.0:1786002510.436886:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+45:17798:x1872758530855424:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:2.0:1786002510.436910:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.436928:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578413e73 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x104:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a883 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002510.437071:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x104:0x0]: returning size 4096 00010000:00010000:2.0:1786002510.437155:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578413e73 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a883 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.437168:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x104:0x0].0x0 (ffff9ed24556ef00) 00010000:00010000:2.0:1786002510.437171:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002510.437185:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578413e73 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a883 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.437289:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a600, rc 0) 00000100:00100000:2.0:1786002510.437494:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:17798:x1872758530855424:12345-192.168.203.49@tcp:101:rm.0 Request processed in 607us (808us total) trans 4294968495 rc 301/301 00000100:00100000:2.0:1786002510.437501:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23780 00000100:00100000:1.0:1786002510.443938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.444022:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530855552 00000100:00100000:2.0:1786002510.444031:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530855552 00000100:00100000:2.0:1786002510.444131:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23781 00000100:00100000:2.0:1786002510.444142:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530855552:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:2.0:1786002510.444161:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.444187:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578413e81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a88a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444296:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578413e88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444318:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578413e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444332:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578413e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444342:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578413e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444348:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578413e88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444354:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578413e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444368:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ac00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002510.444373:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578413e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444380:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578413e88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444391:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:2.0:1786002510.444394:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002510.444399:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578413e88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444406:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578413e88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444434:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578413e81 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a88a expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444443:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:2.0:1786002510.444446:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002510.444449:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578413e81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a88a expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.444457:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a000, rc 0) 00000100:00100000:2.0:1786002510.444510:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530855552:12345-192.168.203.49@tcp:101:rm.0 Request processed in 369us (579us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002510.444516:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23781 00000100:00100000:3.0:1786002510.455092:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.455162:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530855680 00000100:00100000:0.0:1786002510.455173:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530855680 00000100:00100000:0.0:1786002510.455238:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23782 00000100:00100000:0.0:1786002510.455248:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530855680:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:0.0:1786002510.455265:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002510.455284:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578413e8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a891 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455566:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455581:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455592:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455602:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455609:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455615:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455621:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002510.455625:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455632:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455642:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002510.455646:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002510.455651:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455656:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413e96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455687:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578413e8f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a891 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455697:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002510.455699:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002510.455703:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578413e8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a891 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.455714:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35800, rc 0) 00000100:00100000:0.0:1786002510.455775:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530855680:12345-192.168.203.49@tcp:101:rm.0 Request processed in 528us (691us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002510.455783:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23782 00000100:00100000:3.0:1786002510.469831:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.469915:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530855808 00000100:00100000:2.0:1786002510.469925:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530855808 00000100:00100000:1.0:1786002510.470029:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5057 00000100:00100000:1.0:1786002510.470052:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530855808:12345-192.168.203.49@tcp:37:rm.0 00000100:00100000:1.0:1786002510.470201:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:17798:x1872758530855808:12345-192.168.203.49@tcp:37:rm.0 Request processed in 152us (379us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002510.470218:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5057 00000100:00100000:1.0:1786002510.482701:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.483023:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530856064 00000100:00100000:0.0:1786002510.483043:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530856064 00000100:00100000:0.0:1786002510.483090:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5058 00000100:00100000:0.0:1786002510.483100:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:17798:x1872758530856064:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:0.0:1786002510.483328:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530856064:12345-192.168.203.49@tcp:35:rm.0 Request processed in 229us (635us total) trans 4294968496 rc 0/0 00000100:00100000:0.0:1786002510.483337:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5058 00000100:00100000:2.0:1786002510.495203:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.495302:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530856192 00000100:00100000:1.0:1786002510.495321:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530856192 00000100:00100000:1.0:1786002510.495401:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1412 00000100:00100000:1.0:1786002510.495411:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:2413:x1872758530856192:12345-192.168.203.49@tcp:103:rm.0 00010000:00010000:1.0:1786002510.495427:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002510.495451:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af578413a44 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a71e expref: 32 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.495469:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x104:0x0].0x0 (ffff9ed245fed700) 00010000:00010000:1.0:1786002510.495480:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002510.495540:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:2413:x1872758530856192:12345-192.168.203.49@tcp:103:rm.0 Request processed in 130us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.495548:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1412 00000100:00100000:3.0:1786002510.503113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.503404:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530856448 00000100:00100000:2.0:1786002510.503414:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530856448 00000100:00100000:2.0:1786002510.503480:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23783 00000100:00100000:2.0:1786002510.503490:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530856448:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:2.0:1786002510.503539:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.503563:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578413a7c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x104:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a73a expref: 47 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.503581:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x104:0x0].0x0 (ffff9ed24556ef00) 00010000:00010000:2.0:1786002510.503590:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002510.503631:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.503640:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.503649:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.503672:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560908800:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1786002510.503715:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.503767:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.503970:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560908800 00000100:00100000:1.0:1786002510.503975:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560908800 00000100:00100000:1.0:1786002510.504014:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3660 00000100:00100000:1.0:1786002510.504022:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6522:x1872758560908800:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002510.504046:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002510.504062:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413ea4 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413e9d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.504084:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413ea4 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413e9d expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.504097:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413ea4 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413e9d expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.504104:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed351207400) 00010000:00010000:1.0:1786002510.504107:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002510.504109:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f600, rc 0) 00000100:00100000:1.0:1786002510.504148:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6522:x1872758560908800:12345-0@lo:101:mdt00_002.0 Request processed in 127us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.504154:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3660 00000100:00100000:2.0:1786002510.505147:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560908800:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002510.505163:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.505185:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002510.505208:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002510.505230:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af578413eab lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.505236:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af578413eab lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.505243:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af578413eab lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.505254:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560908928:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1786002510.505277:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.505305:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.505622:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560908928 00000100:00100000:1.0:1786002510.505628:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560908928 00000100:00100000:1.0:1786002510.505665:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3661 00000100:00100000:1.0:1786002510.505673:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:6522:x1872758560908928:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002510.505683:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002510.505696:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413eb2 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413eab expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.505714:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413eb2 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413eab expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.505725:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413eb2 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413eab expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.505737:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xf8280fc8 (ffff9ed351207700) 00010000:00010000:1.0:1786002510.505740:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002510.505742:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7ee00, rc 0) 00000100:00100000:1.0:1786002510.505904:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:6522:x1872758560908928:12345-0@lo:101:mdt00_002.0 Request processed in 230us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.505912:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3661 00000100:00100000:3.0:1786002510.506356:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560908928:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1786002510.506369:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af578413eab lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413eb2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.506388:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af578413eab lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413eb2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002510.506403:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:3.0:1786002510.506434:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560909056:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786002510.506464:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.506501:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f780 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.506642:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560909056 00000100:00100000:1.0:1786002510.506647:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560909056 00000100:00100000:1.0:1786002510.506678:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3662 00000100:00100000:1.0:1786002510.506686:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:6522:x1872758560909056:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002510.506753:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:6522:x1872758560909056:12345-0@lo:1000:mdt00_002.0 Request processed in 67us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.506760:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3662 00000100:00100000:2.0:1786002510.507908:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560909056:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786002510.507960:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560909184:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786002510.507990:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.508017:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.508089:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560909184 00000100:00100000:0.0:1786002510.508094:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560909184 00000100:00100000:0.0:1786002510.508121:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3663 00000100:00100000:0.0:1786002510.508128:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:6522:x1872758560909184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786002510.508483:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:6522:x1872758560909184:12345-0@lo:1000:mdt00_002.0 Request processed in 354us (491us total) trans 0 rc 1/1 00000100:00100000:0.0:1786002510.508490:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3663 00000100:00100000:2.0:1786002510.508541:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560909184:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1786002510.508584:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x104:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.508592:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.508601:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.508612:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560909312:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1786002510.508633:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.508692:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.511969:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560909312 00000100:00100000:1.0:1786002510.511981:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560909312 00000100:00100000:1.0:1786002510.512035:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3664 00000100:00100000:1.0:1786002510.512044:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:6522:x1872758560909312:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002510.512068:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002510.512090:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578413ec0 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x104:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413eb9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.512117:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578413ec0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413eb9 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.512131:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578413ec0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413eb9 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.512145:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x104:0x0].0x0 (ffff9ed351207100) 00010000:00010000:1.0:1786002510.512149:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002510.512153:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f200, rc 0) 00000100:00100000:1.0:1786002510.512471:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+17:6522:x1872758560909312:12345-0@lo:101:mdt00_002.0 Request processed in 427us (3835us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.512478:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3664 00000100:00100000:2.0:1786002510.512548:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560909312:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002510.512566:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413ec0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.512577:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413ec0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.512604:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578413ec7 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x104:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.512612:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578413ec7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.512619:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578413ec7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.512636:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 3/0,1 mode: --/EX res: [0x240000400:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.512648:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a60 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a72c expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.512656:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 4/0,1 mode: --/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.512682:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a72c expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.512695:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a72c expref: 46 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.512707:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758560909440:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002510.512770:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.524120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.524300:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530856576 00000100:00100000:0.0:1786002510.524316:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530856576 00000100:00100000:2.0:1786002510.524339:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758560909440:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002510.524353:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a72c expref: 47 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.524381:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 3/0,1 mode: --/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.524403:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1637 00000100:00100000:0.0:1786002510.524413:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:2413:x1872758530856576:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002510.524429:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.524435:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a72c expref: 47 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.524448:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a72c expref: 47 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.524591:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af578413a60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x86:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a72c expref: 47 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.524607:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x86:0x0].0x0 (ffff9ed245fedc00) 00010000:00010000:0.0:1786002510.524612:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 3/0,1 mode: --/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.524620:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.524627:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.524656:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002510.524704:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:2413:x1872758530856576:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 292us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.524712:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1637 00010000:00010000:2.0:1786002510.524775:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.524782:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.524823:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.524829:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.524880:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.524899:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560909568:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1786002510.524935:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.524964:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.525018:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560909568 00000100:00100000:1.0:1786002510.525022:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560909568 00000100:00100000:1.0:1786002510.525047:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3665 00000100:00100000:1.0:1786002510.525064:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:6522:x1872758560909568:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002510.525077:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002510.525090:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413edc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413ed5 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.525108:0:20598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413aad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a756 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.525116:0:20598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413edc lrc: 4/0,0 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413ed5 expref: 18 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.525137:0:20598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a756 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.525149:0:20598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413aad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a756 expref: 30 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.525164:0:20598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20598:1872758560909696:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002510.525294:0:20598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.536649:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.536901:0:20598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20598:1872758560909696:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002510.536932:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413edc lrc: 3/0,0 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413ed5 expref: 18 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.536945:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:1.0:1786002510.536948:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002510.536951:0:20598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413edc lrc: 3/0,0 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413ed5 expref: 18 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.536962:0:20598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413edc lrc: 3/0,0 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413ed5 expref: 18 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.536968:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e200, rc 0) 00000100:00100000:1.0:1786002510.537024:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6522:x1872758560909568:12345-0@lo:101:mdt00_002.0 Request processed in 11960us (12088us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.537032:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3665 00000100:00100000:3.0:1786002510.537206:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560909568:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1786002510.537223:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.537233:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.537753:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530856704 00000100:00100000:2.0:1786002510.537762:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530856704 00010000:00010000:2.0:1786002510.537789:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413aad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a756 expref: 31 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.537819:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1638 00000100:00100000:2.0:1786002510.537827:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed346568050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:2412:x1872758530856704:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.537908:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.537915:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413aad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a756 expref: 31 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.537927:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a756 expref: 31 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.537947:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578413aad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a756 expref: 31 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.537959:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:2.0:1786002510.537963:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413edc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413ed5 expref: 17 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.537977:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413edc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413ed5 expref: 17 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.537984:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413edc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413ed5 expref: 17 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.538009:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413edc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413ed5 expref: 17 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.538021:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6505:1872758560909824:0@lo:105: 00000100:00100000:2.0:1786002510.538111:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.538143:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.538414:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560909824 00000100:00100000:3.0:1786002510.538419:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560909824 00000100:00100000:3.0:1786002510.538450:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1786002510.538457:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6505:x1872758560909824:12345-0@lo:105: 00010000:00010000:3.0:1786002510.538514:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.538524:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.538532:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.538540:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.538547:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.538555:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.538611:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed243d2be00) 00000100:00100000:3.0:1786002510.538644:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6505:x1872758560909824:12345-0@lo:105: Request processed in 187us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.538651:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1786002510.539460:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6505:1872758560909824:0@lo:105: 00010000:00010000:2.0:1786002510.539482:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002510.539524:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed346568050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:2412:x1872758530856704:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 1696us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.539531:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1638 00010000:00010000:0.0:1786002510.546147:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.546166:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002510.546686:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].407, 888 off611584 00000040:00080000:0.0:1786002510.546844:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].407, 968 off660272 00000004:00080000:0.0:1786002510.547138:0:6522:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed36fb40840 with version 770 00000004:00080000:3.0:1786002510.550944:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 770 rpc_version 770 00000020:00100000:3.0:1786002510.550989:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002510.551000:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed37f535c00 x1872758560910080/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1952/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002510.551026:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560910080:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002510.551143:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.551281:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.554160:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560910080 00000100:00100000:2.0:1786002510.554181:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560910080 00000100:00100000:2.0:1786002510.554529:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3666 00000100:00100000:2.0:1786002510.554539:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:7466:x1872758560910080:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002510.555007:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:7466:x1872758560910080:12345-0@lo:1000:osp_up0-1.0 Request processed in 468us (3862us total) trans 4294983509 rc 0/0 00000100:00100000:2.0:1786002510.555015:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3666 00000100:00100000:0.0:1786002510.555134:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560910080:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1786002510.555419:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x104:0x0]: returning size 4096 00010000:00010000:2.0:1786002510.555439:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555449:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555456:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555462:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002510.555466:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555473:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555487:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x86:0x0].0x0 (ffff9ed245fedc00) 00010000:00010000:2.0:1786002510.555490:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002510.555494:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 2/0,0 mode: --/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555499:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578413ece lrc: 0/0,0 mode: --/EX res: [0x240000400:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555518:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555526:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555532:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555560:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002510.555568:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x86:0x0] 00010000:00010000:2.0:1786002510.555574:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578413ec7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555580:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578413ec7 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555585:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578413ec7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555590:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002510.555593:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578413ec7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555599:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578413ec7 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555605:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x104:0x0].0x0 (ffff9ed24559fe00) 00010000:00010000:2.0:1786002510.555608:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002510.555610:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578413ec7 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555616:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578413ec7 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x104:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555626:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413ec0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555634:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413ec0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555641:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413ec0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555652:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1786002510.555661:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002510.555665:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555672:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555677:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555693:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1786002510.555696:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002510.555700:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af578413eab lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413eb2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.555706:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af578413eab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413eb2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.555760:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:17798:x1872758530856448:12345-192.168.203.49@tcp:36:rm.0 Request processed in 52270us (52655us total) trans 4294968497 rc 0/0 00000100:00100000:2.0:1786002510.555768:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23783 00010000:00010000:0.0:1786002510.557668:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786002510.557679:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557689:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2be00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002510.557695:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002510.557703:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557740:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557746:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002510.557773:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557780:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af578413ed5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413edc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557797:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786002510.557801:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413ec0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557807:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002510.557810:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413ec0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002510.557817:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413ec0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557830:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413ec0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557860:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002510.557867:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413ec0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557873:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578413eb9 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413ec0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557884:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002510.557888:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557893:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ac00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002510.557897:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002510.557903:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557920:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557926:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002510.557940:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557946:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413e9d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.557958:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002510.557960:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002510.557961:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002510.557975:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560910336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002510.558025:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.558054:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002510.558059:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560910208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002510.558076:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.558097:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560910464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002510.558114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.558141:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560910336 00000100:00100000:0.0:1786002510.558147:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560910336 00000100:00100000:0.0:1786002510.558279:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560910208 00000100:00100000:0.0:1786002510.558284:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560910208 00000100:00100000:0.0:1786002510.558298:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560910464 00000100:00100000:0.0:1786002510.558301:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560910464 00000100:00100000:0.0:1786002510.558468:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:0.0:1786002510.558477:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+21:3647:x1872758560910336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002510.558488:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.558504:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578413ec0 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x104:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413eb9 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.558516:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x104:0x0].0x0 (ffff9ed351207100) 00010000:00010000:0.0:1786002510.558523:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002510.558553:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+20:3647:x1872758560910336:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.558559:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:0.0:1786002510.558574:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1786002510.558579:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+19:3647:x1872758560910208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002510.558585:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.558594:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413edc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413ed5 expref: 19 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.558603:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002510.558609:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002510.558626:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+18:3647:x1872758560910208:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.558632:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1786002510.558643:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1786002510.558649:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+17:3644:x1872758560910464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002510.558655:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.558664:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af578413ea4 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413e9d expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.558677:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed351207400) 00010000:00010000:0.0:1786002510.558682:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002510.558704:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+16:3644:x1872758560910464:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.558710:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1786002510.558742:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560910464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002510.558763:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560910208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002510.558770:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560910336:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002510.558866:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002510.563333:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002510.563877:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.563947:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530856960 00000100:00100000:2.0:1786002510.563955:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530856960 00000100:00100000:2.0:1786002510.564003:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23784 00000100:00100000:2.0:1786002510.564012:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:17798:x1872758530856960:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:2.0:1786002510.564034:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.564062:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af578413ee3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a898 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002510.564206:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x16c:0x0]: returning size 4096 00010000:00010000:2.0:1786002510.564286:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af578413ee3 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a898 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.564300:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff9ed2456ef300) 00010000:00010000:2.0:1786002510.564303:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002510.564317:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af578413ee3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a898 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.564330:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b600, rc 0) 00000100:00100000:2.0:1786002510.564393:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530856960:12345-192.168.203.49@tcp:101:rm.0 Request processed in 382us (545us total) trans 4294968498 rc 301/301 00000100:00100000:2.0:1786002510.564401:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23784 00000100:00100000:3.0:1786002510.579695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.579887:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530857216 00000100:00100000:1.0:1786002510.579896:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530857216 00000100:00100000:1.0:1786002510.579937:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5059 00000100:00100000:1.0:1786002510.579946:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530857216:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:1.0:1786002510.580347:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530857216:12345-192.168.203.49@tcp:35:rm.0 Request processed in 400us (658us total) trans 4294968499 rc 0/0 00000100:00100000:1.0:1786002510.580366:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5059 00000100:00100000:3.0:1786002510.588703:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002510.591532:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.591767:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530857344 00000100:00100000:1.0:1786002510.591776:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530857344 00000100:00100000:1.0:1786002510.591873:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1416 00000100:00100000:1.0:1786002510.591884:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:2412:x1872758530857344:12345-192.168.203.49@tcp:103:rm.0 00010000:00010000:1.0:1786002510.591899:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002510.591920:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578413b63 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a79c expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.591939:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:1.0:1786002510.591949:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002510.591990:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2412:x1872758530857344:12345-192.168.203.49@tcp:103:rm.0 Request processed in 109us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.591997:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1416 00000100:00100000:0.0:1786002510.595698:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530857600 00000100:00100000:0.0:1786002510.595713:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530857600 00000100:00100000:0.0:1786002510.595820:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23785 00000100:00100000:0.0:1786002510.595830:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530857600:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002510.595912:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.595936:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47800/0x7cee4af578413b7f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7aa expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.595954:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff9ed2456ef300) 00010000:00010000:0.0:1786002510.595965:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002510.596009:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.596016:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.596030:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.596059:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560910592:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1786002510.596114:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.596146:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40300 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.598589:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560910592 00000100:00100000:2.0:1786002510.598602:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560910592 00000100:00100000:2.0:1786002510.598659:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3667 00000100:00100000:2.0:1786002510.598669:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+16:10360:x1872758560910592:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002510.598691:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.598712:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578413ef8 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413ef1 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.598746:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578413ef8 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413ef1 expref: 17 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.598759:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578413ef8 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413ef1 expref: 17 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.598767:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24559fe00) 00010000:00010000:2.0:1786002510.598770:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002510.598773:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b600, rc 0) 00000100:00100000:2.0:1786002510.598864:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:10360:x1872758560910592:12345-0@lo:101:mdt00_003.0 Request processed in 179us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.598871:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3667 00000100:00100000:2.0:1786002510.598915:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560910592:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002510.598934:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413ef8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.598945:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413ef8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002510.598969:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002510.599000:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2aa00/0x7cee4af578413eff lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599008:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2aa00/0x7cee4af578413eff lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599017:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2aa00/0x7cee4af578413eff lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.599036:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560910720:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786002510.599065:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.599083:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.599096:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560910720 00000100:00100000:2.0:1786002510.599099:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560910720 00000100:00100000:2.0:1786002510.599123:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3668 00000100:00100000:2.0:1786002510.599128:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+17:10360:x1872758560910720:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002510.599136:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.599146:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578413f06 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413eff expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599161:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578413f06 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413eff expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599171:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578413f06 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413eff expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599185:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x83604406 (ffff9ed24559f700) 00010000:00010000:2.0:1786002510.599188:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002510.599194:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a800, rc 0) 00000100:00100000:2.0:1786002510.599219:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:10360:x1872758560910720:12345-0@lo:101:mdt00_003.0 Request processed in 90us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.599225:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3668 00000100:00100000:2.0:1786002510.599247:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560910720:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002510.599257:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2aa00/0x7cee4af578413eff lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f06 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599272:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2aa00/0x7cee4af578413eff lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f06 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002510.599283:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:2.0:1786002510.599318:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560910848:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002510.599343:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.599365:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560910848 00000100:00100000:2.0:1786002510.599369:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560910848 00000100:00100000:2.0:1786002510.599389:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3669 00000100:00100000:2.0:1786002510.599394:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:10360:x1872758560910848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002510.599445:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:10360:x1872758560910848:12345-0@lo:1000:mdt00_003.0 Request processed in 50us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.599451:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3669 00000100:00100000:2.0:1786002510.599465:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faafd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.599477:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560910848:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002510.599513:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560910976:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002510.599532:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.599548:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560910976 00000100:00100000:2.0:1786002510.599551:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560910976 00000100:00100000:2.0:1786002510.599565:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3670 00000100:00100000:2.0:1786002510.599570:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:10360:x1872758560910976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002510.599629:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:10360:x1872758560910976:12345-0@lo:1000:mdt00_003.0 Request processed in 59us (96us total) trans 0 rc 1/1 00000100:00100000:2.0:1786002510.599635:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3670 00000100:00100000:2.0:1786002510.599649:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790840 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.599660:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560910976:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1786002510.599693:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599700:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599707:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.599717:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560911104:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786002510.599735:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.599750:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560911104 00000100:00100000:2.0:1786002510.599753:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560911104 00000100:00100000:2.0:1786002510.599767:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3671 00000100:00100000:2.0:1786002510.599772:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:10360:x1872758560911104:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002510.599779:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.599788:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578413f14 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413f0d expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599803:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578413f14 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413f0d expref: 19 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599812:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578413f14 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f0d expref: 19 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599818:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff9ed24559fc00) 00010000:00010000:2.0:1786002510.599821:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002510.599823:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b800, rc 0) 00000100:00100000:2.0:1786002510.599872:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:10360:x1872758560911104:12345-0@lo:101:mdt00_003.0 Request processed in 99us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.599877:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3671 00000100:00100000:2.0:1786002510.599891:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790300 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.599901:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560911104:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002510.599910:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f14 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599918:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f14 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599937:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413f1b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599945:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413f1b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599952:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413f1b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599967:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599978:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578413b8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b1 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.599985:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.600004:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578413b8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b1 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.600017:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578413b8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b1 expref: 47 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.600027:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:10360:1872758560911232:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002510.600078:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790300 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.608397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.608426:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530857728 00000100:00100000:0.0:1786002510.608434:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530857728 00010000:00010000:0.0:1786002510.608479:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578413b8d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b1 expref: 48 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.608511:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1639 00000100:00100000:0.0:1786002510.608520:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:2412:x1872758530857728:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002510.608533:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.608540:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578413b8d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b1 expref: 48 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.608554:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578413b8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b1 expref: 48 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.608575:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbc:0x0].0x0 (ffff9ed24556e000) 00010000:00010000:0.0:1786002510.608580:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.608590:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.608602:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.608619:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002510.608662:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:2412:x1872758530857728:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 142us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.608669:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1639 00010000:00010000:1.0:1786002510.609029:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578413b8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b1 expref: 47 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.609046:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:10360:1872758560911232:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002510.609067:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.609076:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.609082:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.609127:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.609135:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.609144:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.609161:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560911360:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1786002510.609208:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.609242:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.609827:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560911360 00000100:00100000:0.0:1786002510.609843:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560911360 00000100:00100000:0.0:1786002510.609897:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3672 00000100:00100000:0.0:1786002510.609905:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:10360:x1872758560911360:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786002510.609920:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002510.609934:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413f30 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413f29 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.609959:0:15596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413b9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b8 expref: 28 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.609968:0:15596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413f30 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413f29 expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.609992:0:15596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413b9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b8 expref: 28 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.610005:0:15596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413b9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b8 expref: 28 pid: 14496 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.610024:0:15596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ca80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560911488:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002510.610083:0:15596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.621891:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.622164:0:15596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ca80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560911488:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002510.622213:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413f30 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f29 expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.622225:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbc:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:0.0:1786002510.622228:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002510.622232:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413f30 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f29 expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.622241:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413f30 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f29 expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.622248:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34e00, rc 0) 00000100:00100000:0.0:1786002510.622303:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:10360:x1872758560911360:12345-0@lo:101:mdt00_003.0 Request processed in 12398us (13094us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.622319:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3672 00000100:00100000:1.0:1786002510.622781:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560911360:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786002510.622797:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.622806:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.622877:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530857856 00000100:00100000:2.0:1786002510.622884:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530857856 00010000:00010000:2.0:1786002510.622914:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413b9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b8 expref: 29 pid: 14496 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.622942:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1640 00000100:00100000:2.0:1786002510.622951:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2413:x1872758530857856:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.622963:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.622968:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413b9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b8 expref: 29 pid: 14496 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.622980:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413b9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b8 expref: 29 pid: 14496 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.622997:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578413b9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xbc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7b8 expref: 29 pid: 14496 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.623009:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbc:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:2.0:1786002510.623014:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413f30 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f29 expref: 19 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.623028:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413f30 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413f29 expref: 19 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.623036:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413f30 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413f29 expref: 19 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.623071:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413f30 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f29 expref: 19 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.623083:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6507:1872758560911616:0@lo:105: 00000100:00100000:2.0:1786002510.623114:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.623146:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790840 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.623316:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560911616 00000100:00100000:3.0:1786002510.623320:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560911616 00000100:00100000:3.0:1786002510.623350:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1786002510.623366:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6507:x1872758560911616:12345-0@lo:105: 00010000:00010000:3.0:1786002510.623376:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.623385:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.623393:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 5/0,1 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.623401:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.623412:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.623419:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.623441:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245e7e200) 00000100:00100000:3.0:1786002510.623481:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6507:x1872758560911616:12345-0@lo:105: Request processed in 124us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.623487:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00010000:00010000:1.0:1786002510.623618:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.623627:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.624502:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560911744:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1786002510.624544:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.624561:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.624659:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6507:1872758560911616:0@lo:105: 00010000:00010000:2.0:1786002510.624673:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002510.624710:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:2413:x1872758530857856:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 1760us (2826us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.624718:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1640 00000100:00100000:3.0:1786002510.627274:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560911744 00000100:00100000:3.0:1786002510.627287:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560911744 00000100:00100000:3.0:1786002510.627345:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3673 00000100:00100000:3.0:1786002510.627354:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:10360:x1872758560911744:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1786002510.637875:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:10360:x1872758560911744:12345-0@lo:403:mdt00_003.0 Request processed in 10495us (13303us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.637888:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3673 00000100:00100000:1.0:1786002510.638268:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560911744:0@lo:403:mdt00_003.0 00000040:00080000:1.0:1786002510.639103:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].408, 952 off612536 00000040:00080000:1.0:1786002510.639231:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].408, 1032 off661304 00000004:00080000:1.0:1786002510.639237:0:10360:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed36e7ab300 with version 771 00000004:00080000:3.0:1786002510.639546:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 771 rpc_version 771 00000020:00100000:3.0:1786002510.639575:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002510.639583:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244d31880 x1872758560912000/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002510.639605:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560912000:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002510.639648:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.639677:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.639822:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560912000 00000100:00100000:2.0:1786002510.639829:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560912000 00000100:00100000:2.0:1786002510.639916:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3674 00000100:00100000:2.0:1786002510.639924:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:7466:x1872758560912000:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002510.640429:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:7466:x1872758560912000:12345-0@lo:1000:osp_up0-1.0 Request processed in 504us (779us total) trans 4294983510 rc 0/0 00000100:00100000:2.0:1786002510.640437:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3674 00000100:00100000:1.0:1786002510.640557:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560912000:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1786002510.640601:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x16c:0x0]: returning size 4096 00010000:00010000:2.0:1786002510.640619:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640628:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640635:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640641:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002510.640646:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640653:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640667:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xbc:0x0].0x0 (ffff9ed24556e000) 00010000:00010000:2.0:1786002510.640670:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002510.640674:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640679:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413f22 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640697:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640705:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640711:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640771:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002510.640778:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xbc:0x0] 00010000:00010000:2.0:1786002510.640788:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413f1b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640794:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413f1b lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640800:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413f1b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640805:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002510.640807:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413f1b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640813:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413f1b lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640822:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff9ed24559f200) 00010000:00010000:2.0:1786002510.640824:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002510.640827:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413f1b lrc: 2/0,0 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640843:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413f1b lrc: 0/0,0 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640883:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f14 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640891:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413f14 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.640900:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413f14 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.644325:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786002510.644337:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.644348:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002510.644361:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002510.644376:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.644412:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.644418:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1786002510.644467:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560912128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002510.644519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.644596:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560912128 00000100:00100000:3.0:1786002510.644603:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560912128 00000100:00100000:3.0:1786002510.644652:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1786002510.644661:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34656b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+21:3645:x1872758560912128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002510.644672:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.644690:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578413f30 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413f29 expref: 21 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.644702:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xbc:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:3.0:1786002510.644710:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002510.644754:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 1/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.644762:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af578413f29 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xbc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.644775:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002510.644778:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413f14 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.644784:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ac00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002510.644788:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413f14 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002510.644795:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413f14 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.644810:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 4/0,0 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f14 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.644816:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002510.644828:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 3/0,0 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f14 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.644865:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002510.644867:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002510.644869:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002510.644882:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560912256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002510.644907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786002510.645081:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1786002510.645088:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ac00/0x7cee4af578413f0d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f14 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002510.645110:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:2.0:1786002510.645120:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560912256 00000100:00100000:2.0:1786002510.645124:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560912256 00000100:00100000:2.0:1786002510.645146:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:2.0:1786002510.645152:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+21:3646:x1872758560912256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.645160:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.645170:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578413f14 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x16c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413f0d expref: 21 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.645594:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x16c:0x0].0x0 (ffff9ed24559fc00) 00010000:00010000:2.0:1786002510.645602:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002510.645632:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+20:3646:x1872758560912256:12345-0@lo:103:ldlm_bl.0 Request processed in 479us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.645640:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00010000:00010000:2.0:1786002510.645663:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413ef8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.645671:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413ef8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.645682:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413ef8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.645693:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002510.645698:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002510.645702:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2aa00/0x7cee4af578413eff lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f06 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.645709:0:10360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2aa00/0x7cee4af578413eff lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f06 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.645767:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530857600:12345-192.168.203.49@tcp:36:rm.0 Request processed in 49938us (57073us total) trans 4294968500 rc 0/0 00000100:00100000:2.0:1786002510.645774:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23785 00010000:00010000:0.0:1786002510.646691:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002510.646698:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413ef8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.646706:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002510.646710:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413ef8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002510.646718:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413ef8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.646743:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413ef8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.646749:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002510.646769:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413ef8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.646776:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35800/0x7cee4af578413ef1 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413ef8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.646789:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002510.646792:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002510.646794:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002510.646804:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002510.646831:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560912256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002510.646871:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786002510.646878:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560912384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002510.646904:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.646931:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560912384 00000100:00100000:0.0:1786002510.646935:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560912384 00000100:00100000:0.0:1786002510.646961:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1786002510.646967:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+20:3646:x1872758560912384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002510.646975:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.646988:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578413ef8 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413ef1 expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.646999:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24559fe00) 00010000:00010000:0.0:1786002510.647005:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002510.647029:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+19:3646:x1872758560912384:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.647036:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1786002510.647073:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560912384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.651586:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34656b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+18:3645:x1872758560912128:12345-0@lo:103:ldlm_bl.0 Request processed in 6917us (7057us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.651600:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1786002510.652625:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560912128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002510.664290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.664461:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530858112 00000100:00100000:2.0:1786002510.664478:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530858112 00000100:00100000:2.0:1786002510.664535:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23786 00000100:00100000:2.0:1786002510.664544:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:17798:x1872758530858112:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:2.0:1786002510.664561:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.664579:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578413f37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a89f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002510.664709:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14bf:0x0]: returning size 4096 00010000:00010000:2.0:1786002510.664793:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578413f37 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a89f expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.664813:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed35363dc00) 00010000:00010000:2.0:1786002510.664816:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002510.664820:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578413f37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a89f expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.664844:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b800, rc 0) 00000100:00100000:2.0:1786002510.664939:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:17798:x1872758530858112:12345-192.168.203.49@tcp:101:rm.0 Request processed in 396us (657us total) trans 4294983511 rc 301/301 00000100:00100000:2.0:1786002510.664947:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23786 00000100:00100000:2.0:1786002510.677609:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.677700:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530858368 00000100:00100000:1.0:1786002510.677708:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530858368 00000100:00100000:1.0:1786002510.677758:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5060 00000100:00100000:1.0:1786002510.677767:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:17798:x1872758530858368:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:1.0:1786002510.678008:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:17798:x1872758530858368:12345-192.168.203.49@tcp:35:rm.0 Request processed in 240us (406us total) trans 4294983512 rc 0/0 00000100:00100000:1.0:1786002510.678015:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5060 00000100:00100000:3.0:1786002510.693510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.693601:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530858496 00000100:00100000:0.0:1786002510.693610:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530858496 00000100:00100000:0.0:1786002510.693673:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1420 00000100:00100000:0.0:1786002510.693683:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:2413:x1872758530858496:12345-192.168.203.49@tcp:103:rm.0 00010000:00010000:0.0:1786002510.693697:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.693718:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47c00/0x7cee4af578413ac9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a75d expref: 47 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.693735:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed2456ef900) 00010000:00010000:0.0:1786002510.693745:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002510.693798:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:2413:x1872758530858496:12345-192.168.203.49@tcp:103:rm.0 Request processed in 117us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.693805:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1420 00000100:00100000:2.0:1786002510.695622:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.695686:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530858752 00000100:00100000:0.0:1786002510.695694:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530858752 00000100:00100000:0.0:1786002510.695741:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23787 00000100:00100000:0.0:1786002510.695750:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:17798:x1872758530858752:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002510.695799:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.695819:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af578413af3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14bf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a772 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.695868:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed35363dc00) 00010000:00010000:0.0:1786002510.695880:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002510.695918:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.695926:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.695935:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.695954:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560912512:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1786002510.695992:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.696010:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.696147:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560912512 00000100:00100000:1.0:1786002510.696151:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560912512 00000100:00100000:1.0:1786002510.696195:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3675 00000100:00100000:1.0:1786002510.696202:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6520:x1872758560912512:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786002510.696214:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002510.696228:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413f4c lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413f45 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.696253:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413f4c lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413f45 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.696265:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413f4c lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f45 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.696272:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed351207900) 00010000:00010000:1.0:1786002510.696275:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002510.696277:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f200, rc 0) 00000100:00100000:1.0:1786002510.696321:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6520:x1872758560912512:12345-0@lo:101:mdt00_000.0 Request processed in 119us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.696327:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3675 00000100:00100000:0.0:1786002510.696535:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560912512:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786002510.696551:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.696560:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002510.696579:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1786002510.696596:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35c00/0x7cee4af578413f53 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.696602:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35c00/0x7cee4af578413f53 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.696609:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35c00/0x7cee4af578413f53 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.696619:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560912640:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1786002510.696641:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.696662:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40540 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.696706:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560912640 00000100:00100000:2.0:1786002510.696710:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560912640 00000100:00100000:2.0:1786002510.696741:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3676 00000100:00100000:2.0:1786002510.696748:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6520:x1872758560912640:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786002510.696755:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.696766:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ac00/0x7cee4af578413f5a lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413f53 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.696779:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ac00/0x7cee4af578413f5a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413f53 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.696789:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ac00/0x7cee4af578413f5a lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f53 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.696795:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x44749f58 (ffff9ed24559fc00) 00010000:00010000:2.0:1786002510.696798:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002510.696800:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2ac00, rc 0) 00000100:00100000:2.0:1786002510.696843:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6520:x1872758560912640:12345-0@lo:101:mdt00_000.0 Request processed in 86us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.696872:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3676 00000100:00100000:0.0:1786002510.696969:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560912640:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786002510.696980:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35c00/0x7cee4af578413f53 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.696988:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35c00/0x7cee4af578413f53 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002510.696999:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:0.0:1786002510.697026:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560912768:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786002510.697064:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.697074:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.698498:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002510.698513:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560912896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002510.698552:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.698713:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560912768 00000100:00100000:3.0:1786002510.698719:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560912768 00000100:00100000:3.0:1786002510.698755:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560912896 00000100:00100000:3.0:1786002510.698758:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560912896 00000100:00100000:3.0:1786002510.698780:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3677 00000100:00100000:3.0:1786002510.698787:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6520:x1872758560912768:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002510.698884:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6520:x1872758560912768:12345-0@lo:1000:mdt00_000.0 Request processed in 96us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.698891:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3677 00000100:00100000:3.0:1786002510.698907:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3678 00000100:00100000:3.0:1786002510.698913:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:3645:x1872758560912896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002510.698933:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445015552 avail 1298776064 00000100:00100000:3.0:1786002510.698959:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:3645:x1872758560912896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.698968:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3678 00000100:00100000:2.0:1786002510.699042:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560912896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786002510.699542:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560912768:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786002510.699589:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560913024:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786002510.699613:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.699629:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.699642:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560913024 00000100:00100000:0.0:1786002510.699645:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560913024 00000100:00100000:0.0:1786002510.699667:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3679 00000100:00100000:0.0:1786002510.699673:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:6520:x1872758560913024:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786002510.699741:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:6520:x1872758560913024:12345-0@lo:1000:mdt00_000.0 Request processed in 67us (127us total) trans 0 rc 1/1 00000100:00100000:0.0:1786002510.699747:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3679 00000100:00100000:0.0:1786002510.699769:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560913024:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1786002510.699814:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.699823:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.699842:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.699871:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560913152:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1786002510.699891:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.699905:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40540 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.699916:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560913152 00000100:00100000:0.0:1786002510.699919:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560913152 00000100:00100000:0.0:1786002510.699937:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3680 00000100:00100000:0.0:1786002510.699942:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6520:x1872758560913152:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786002510.699951:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002510.699965:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578413f68 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413f61 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.699985:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578413f68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413f61 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.699997:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578413f68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f61 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.700004:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed36e785c00) 00010000:00010000:0.0:1786002510.700007:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002510.700011:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35200, rc 0) 00000100:00100000:0.0:1786002510.700035:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6520:x1872758560913152:12345-0@lo:101:mdt00_000.0 Request processed in 92us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.700041:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3680 00000100:00100000:0.0:1786002510.701169:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560913152:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786002510.702139:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f68 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.702155:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f68 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.702443:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413f6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.702458:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413f6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.702754:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413f6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.702793:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.702800:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.702809:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.702825:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560913280:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1786002510.702901:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.702936:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40540 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.702954:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560913280 00000100:00100000:0.0:1786002510.702959:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560913280 00000100:00100000:0.0:1786002510.702991:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3681 00000100:00100000:0.0:1786002510.702999:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6520:x1872758560913280:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786002510.703011:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002510.703023:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413f7d lrc: 2/0,0 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413f76 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.703042:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af578413ae5 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x9d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a76b expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.704003:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413f7d lrc: 4/0,0 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413f76 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.704030:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af578413ae5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x9d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a76b expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.704044:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af578413ae5 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x9d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a76b expref: 45 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.704065:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6525:1872758560913408:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002510.704114:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.715733:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6525:1872758560913408:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002510.715769:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413f7d lrc: 3/0,0 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f76 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.715782:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9d:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:0.0:1786002510.715785:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002510.715788:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413f7d lrc: 3/0,0 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f76 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.715798:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413f7d lrc: 3/0,0 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f76 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.715805:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35a00, rc 0) 00000100:00100000:0.0:1786002510.715899:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:6520:x1872758560913280:12345-0@lo:101:mdt00_000.0 Request processed in 12899us (12997us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.715908:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3681 00000100:00100000:1.0:1786002510.716005:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560913280:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786002510.716021:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.716032:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.721638:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.721701:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530858880 00000100:00100000:0.0:1786002510.721710:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530858880 00010000:00010000:0.0:1786002510.721745:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af578413ae5 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x9d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a76b expref: 46 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.721779:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1641 00000100:00100000:0.0:1786002510.721788:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:2413:x1872758530858880:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002510.721801:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002510.721808:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af578413ae5 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x9d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a76b expref: 46 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.721822:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af578413ae5 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x9d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a76b expref: 46 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.721883:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af578413ae5 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x9d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a76b expref: 46 pid: 6521 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.721899:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9d:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:0.0:1786002510.721905:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413f7d lrc: 2/0,0 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f76 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.721917:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413f7d lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413f76 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.721925:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413f7d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413f76 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.721961:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413f7d lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f76 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.721975:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6507:1872758560913536:0@lo:105: 00000100:00100000:0.0:1786002510.722017:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.722056:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.722121:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560913536 00000100:00100000:1.0:1786002510.722126:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560913536 00000100:00100000:1.0:1786002510.722160:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1786002510.722167:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6507:x1872758560913536:12345-0@lo:105: 00010000:00010000:1.0:1786002510.722185:0:17237:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.722200:0:17237:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.722208:0:17237:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.722215:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.722222:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.722230:0:17237:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.722253:0:17237:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f34200) 00010000:00010000:0.0:1786002510.722281:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.722294:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.722299:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6507:x1872758560913536:12345-0@lo:105: Request processed in 130us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.722318:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1786002510.722874:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560913664:0@lo:403:mdt00_000.0 00000100:00100000:0.0:1786002510.722906:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.722928:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36fb40300 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.723038:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6507:1872758560913536:0@lo:105: 00010000:00010000:2.0:1786002510.723049:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002510.723087:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+45:2413:x1872758530858880:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 1299us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.723094:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1641 00000100:00100000:1.0:1786002510.723770:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560913664 00000100:00100000:1.0:1786002510.723775:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560913664 00000100:00100000:1.0:1786002510.723815:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3682 00000100:00100000:1.0:1786002510.723822:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6520:x1872758560913664:12345-0@lo:403:mdt00_000.0 00000100:00100000:0.0:1786002510.727907:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6520:x1872758560913664:12345-0@lo:403:mdt00_000.0 Request processed in 4077us (4991us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.727919:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3682 00000100:00100000:0.0:1786002510.727974:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758560913664:0@lo:403:mdt00_000.0 00000040:00080000:0.0:1786002510.738229:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].396, 808 off595816 00000040:00080000:0.0:1786002510.738569:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].395, 888 off645032 00000004:00080000:0.0:1786002510.738577:0:6520:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed36fb40300 with version 754 00000004:00080000:3.0:1786002510.738639:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 754 rpc_version 754 00000020:00100000:3.0:1786002510.738670:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002510.738680:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244d31180 x1872758560913920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2208/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002510.738700:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560913920:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002510.738758:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.738787:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f780 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.738840:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560913920 00000100:00100000:0.0:1786002510.738865:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560913920 00000100:00100000:0.0:1786002510.738910:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3683 00000100:00100000:0.0:1786002510.738917:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:7805:x1872758560913920:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002510.739193:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:7805:x1872758560913920:12345-0@lo:1000:osp_up1-0.0 Request processed in 275us (433us total) trans 4294968501 rc 0/0 00000100:00100000:0.0:1786002510.739200:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3683 00000100:00100000:3.0:1786002510.739480:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560913920:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1786002510.739680:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x14bf:0x0]: returning size 4096 00010000:00010000:0.0:1786002510.739699:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739710:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739718:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739738:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786002510.739746:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x9d:0x0] 00010000:00010000:0.0:1786002510.739752:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413f6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739758:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413f6f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739764:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413f6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739769:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002510.739772:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413f6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739779:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413f6f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739796:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed36e785700) 00010000:00010000:0.0:1786002510.739799:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002510.739802:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413f6f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739808:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413f6f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739822:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f68 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739828:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413f68 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739844:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413f68 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739875:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1786002510.739882:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1786002510.739887:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739894:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413f4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739900:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413f4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739914:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1786002510.739918:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1786002510.739922:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35c00/0x7cee4af578413f53 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.739928:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35c00/0x7cee4af578413f53 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.739980:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:17798:x1872758530858752:12345-192.168.203.49@tcp:36:rm.0 Request processed in 44230us (44363us total) trans 4294983513 rc 0/0 00000100:00100000:0.0:1786002510.739986:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23787 00010000:00010000:3.0:1786002510.740035:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786002510.740040:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740055:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002510.740059:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002510.740067:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740089:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740095:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002510.740116:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740128:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578413f76 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740140:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786002510.740143:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413f68 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740149:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002510.740152:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413f68 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002510.740159:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413f68 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740179:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f68 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740184:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002510.740195:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 1/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f68 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740202:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578413f61 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f68 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740212:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002510.740215:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413f4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740224:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002510.740228:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413f4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002510.740234:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413f4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740245:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740249:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002510.740254:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740259:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35800/0x7cee4af578413f45 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740267:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002510.740269:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002510.740270:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002510.740276:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786002510.740284:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560914048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.740322:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.740350:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560914304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.740382:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.740399:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786002510.740404:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560914176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.740425:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.740446:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560914048 00000100:00100000:3.0:1786002510.740450:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560914048 00000100:00100000:3.0:1786002510.740474:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560914304 00000100:00100000:3.0:1786002510.740476:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560914304 00000100:00100000:3.0:1786002510.740485:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560914176 00000100:00100000:3.0:1786002510.740487:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560914176 00000100:00100000:3.0:1786002510.740497:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1786002510.740503:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+17:3644:x1872758560914048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002510.740512:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.740525:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578413f7d lrc: 0/0,0 mode: --/EX res: [0x240000401:0x9d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413f76 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740535:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9d:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:3.0:1786002510.740542:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002510.740563:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+16:3644:x1872758560914048:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.740569:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1786002510.740581:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1786002510.740586:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+15:3647:x1872758560914304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002510.740591:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.740600:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af578413f4c lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413f45 expref: 15 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740609:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed351207900) 00010000:00010000:3.0:1786002510.740614:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002510.740632:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+14:3647:x1872758560914304:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.740640:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1786002510.740650:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1786002510.740654:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed346568c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+13:3647:x1872758560914176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002510.740660:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.740667:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578413f68 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14bf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413f61 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.740676:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14bf:0x0].0x0 (ffff9ed36e785c00) 00010000:00010000:3.0:1786002510.740680:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002510.740695:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed346568c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+12:3647:x1872758560914176:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.740700:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1786002510.740742:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560914048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.740759:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560914176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.740767:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560914304:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.742071:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.745554:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002510.746342:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.746505:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530859136 00000100:00100000:1.0:1786002510.746514:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530859136 00000100:00100000:1.0:1786002510.746571:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23788 00000100:00100000:1.0:1786002510.746581:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+45:17798:x1872758530859136:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:1.0:1786002510.746603:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002510.746623:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413f84 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8a6 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002510.746760:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6d:0x0]: returning size 4096 00010000:00010000:1.0:1786002510.746878:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413f84 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8a6 expref: 47 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.746894:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6d:0x0].0x0 (ffff9ed24556e800) 00010000:00010000:1.0:1786002510.746898:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002510.746903:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af578413f84 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8a6 expref: 47 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.746916:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f000, rc 0) 00000100:00100000:1.0:1786002510.746969:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:17798:x1872758530859136:12345-192.168.203.49@tcp:101:rm.0 Request processed in 390us (634us total) trans 4294968502 rc 301/301 00000100:00100000:1.0:1786002510.746976:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23788 00010000:00010000:3.0:1786002510.763133:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002510.764824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.764937:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530859392 00000100:00100000:1.0:1786002510.764947:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530859392 00000100:00100000:1.0:1786002510.765000:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5061 00000100:00100000:1.0:1786002510.765010:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:17798:x1872758530859392:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:1.0:1786002510.765228:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530859392:12345-192.168.203.49@tcp:35:rm.0 Request processed in 219us (410us total) trans 4294968503 rc 0/0 00000100:00100000:1.0:1786002510.765236:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5061 00000100:00100000:0.0:1786002510.780964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.781000:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002510.781078:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530859520 00000100:00100000:3.0:1786002510.781087:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530859520 00000100:00100000:3.0:1786002510.781147:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1424 00000100:00100000:3.0:1786002510.781157:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:2410:x1872758530859520:12345-192.168.203.49@tcp:103:rm.0 00010000:00010000:3.0:1786002510.781171:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.781203:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578413845 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a645 expref: 30 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.781228:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6d:0x0].0x0 (ffff9ed35363d900) 00010000:00010000:3.0:1786002510.781239:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002510.781290:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2410:x1872758530859520:12345-192.168.203.49@tcp:103:rm.0 Request processed in 135us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.781298:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1424 00000100:00100000:1.0:1786002510.781494:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530859776 00000100:00100000:1.0:1786002510.781499:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530859776 00000100:00100000:1.0:1786002510.781536:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23789 00000100:00100000:1.0:1786002510.781543:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530859776:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:1.0:1786002510.781591:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002510.781604:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578413861 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a653 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.781617:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6d:0x0].0x0 (ffff9ed24556e800) 00010000:00010000:1.0:1786002510.781625:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002510.781670:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.781679:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.781688:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.781707:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560914432:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1786002510.781741:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.781768:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.781783:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560914432 00000100:00100000:1.0:1786002510.781786:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560914432 00000100:00100000:1.0:1786002510.781808:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3684 00000100:00100000:1.0:1786002510.781814:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6521:x1872758560914432:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1786002510.781825:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002510.781883:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413f99 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413f92 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.781909:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413f99 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413f92 expref: 19 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.781921:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413f99 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413f92 expref: 19 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.781929:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed351207c00) 00010000:00010000:1.0:1786002510.781932:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002510.781935:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e200, rc 0) 00000100:00100000:1.0:1786002510.781963:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:6521:x1872758560914432:12345-0@lo:101:mdt00_001.0 Request processed in 149us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.781969:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3684 00000100:00100000:1.0:1786002510.782000:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560914432:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1786002510.782014:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413f99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.782024:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002510.782041:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1786002510.782068:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f600/0x7cee4af578413fa0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.782075:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f600/0x7cee4af578413fa0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.782082:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f600/0x7cee4af578413fa0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.782093:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560914560:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1786002510.782112:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.782124:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8540 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.782253:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560914560 00000100:00100000:0.0:1786002510.782257:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560914560 00000100:00100000:0.0:1786002510.782288:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3685 00000100:00100000:0.0:1786002510.782295:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+19:6521:x1872758560914560:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1786002510.782303:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002510.782314:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413fa7 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413fa0 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.782328:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413fa0 expref: 20 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.782338:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413fa0 expref: 20 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.782345:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x3115f8b0 (ffff9ed36e785700) 00010000:00010000:0.0:1786002510.782347:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002510.782350:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34400, rc 0) 00000100:00100000:0.0:1786002510.782387:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+20:6521:x1872758560914560:12345-0@lo:101:mdt00_001.0 Request processed in 93us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.782393:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3685 00000100:00100000:1.0:1786002510.783272:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560914560:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1786002510.783286:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f600/0x7cee4af578413fa0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413fa7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.783296:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f600/0x7cee4af578413fa0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413fa7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002510.783319:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:1.0:1786002510.783352:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560914688:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786002510.783392:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.783406:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab780 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.783422:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560914688 00000100:00100000:1.0:1786002510.783425:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560914688 00000100:00100000:1.0:1786002510.783458:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3686 00000100:00100000:1.0:1786002510.783465:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:6521:x1872758560914688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786002510.783566:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:6521:x1872758560914688:12345-0@lo:1000:mdt00_001.0 Request processed in 101us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.783574:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3686 00000100:00100000:3.0:1786002510.788191:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560914688:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002510.788272:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560914816:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002510.788333:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.788409:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.793953:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560914816 00000100:00100000:1.0:1786002510.793966:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560914816 00000100:00100000:1.0:1786002510.794262:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3687 00000100:00100000:1.0:1786002510.794272:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:6521:x1872758560914816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786002510.794516:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:6521:x1872758560914816:12345-0@lo:1000:mdt00_001.0 Request processed in 245us (6182us total) trans 0 rc 1/1 00000100:00100000:1.0:1786002510.794525:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3687 00000100:00100000:0.0:1786002510.794597:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560914816:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1786002510.794667:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.794678:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.794688:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.794704:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560914944:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1786002510.794735:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.800185:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243311f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.801124:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560914944 00000100:00100000:2.0:1786002510.801133:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560914944 00000100:00100000:2.0:1786002510.801192:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3688 00000100:00100000:2.0:1786002510.801200:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:6521:x1872758560914944:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1786002510.801218:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.801239:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578413fb5 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413fae expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.801265:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578413fb5 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413fae expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.801283:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578413fb5 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413fae expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.801291:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6d:0x0].0x0 (ffff9ed24559fd00) 00010000:00010000:2.0:1786002510.801294:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002510.801297:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2be00, rc 0) 00000100:00100000:2.0:1786002510.801482:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:6521:x1872758560914944:12345-0@lo:101:mdt00_001.0 Request processed in 282us (6745us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.801489:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3688 00000100:00100000:2.0:1786002510.801533:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560914944:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1786002510.801548:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413fb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.801558:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413fb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.801586:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413fbc lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.801594:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413fbc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.801602:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413fbc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.801618:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.801633:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af57841386f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a65a expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.801641:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 4/0,1 mode: --/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.801668:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af57841386f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a65a expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.801681:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af57841386f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a65a expref: 46 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.801694:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560915072:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002510.801752:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3537909c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.806347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.806400:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530859904 00000100:00100000:2.0:1786002510.806407:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530859904 00010000:00010000:2.0:1786002510.806441:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af57841386f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a65a expref: 47 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.806484:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1642 00000100:00100000:2.0:1786002510.806493:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:2413:x1872758530859904:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.806505:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.806511:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af57841386f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a65a expref: 47 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.806528:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af57841386f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a65a expref: 47 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.806549:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x3c:0x0].0x0 (ffff9ed245fed300) 00010000:00010000:2.0:1786002510.806553:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.806562:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.806569:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.806584:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002510.806624:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:2413:x1872758530859904:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 132us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.806630:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1642 00010000:00010000:0.0:1786002510.807203:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5bc00/0x7cee4af57841386f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a65a expref: 46 pid: 6522 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.807218:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560915072:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002510.807237:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.807245:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.807251:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.807292:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.807299:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.807434:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.807453:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560915200:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1786002510.807500:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.807527:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243311f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.807599:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560915200 00000100:00100000:2.0:1786002510.807605:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560915200 00000100:00100000:2.0:1786002510.807637:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3689 00000100:00100000:2.0:1786002510.807645:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:6521:x1872758560915200:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1786002510.807660:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.807671:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578413fd1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578413fca expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.807691:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af57841387d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a661 expref: 28 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.807704:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578413fd1 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578413fca expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.807723:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af57841387d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a661 expref: 28 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.807734:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af57841387d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a661 expref: 28 pid: 10360 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.807744:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6525:1872758560915328:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002510.807794:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.819422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.819671:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6525:1872758560915328:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002510.819704:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578413fd1 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413fca expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.819716:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9ed2456ef600) 00010000:00010000:1.0:1786002510.819719:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002510.819723:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578413fd1 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413fca expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.819733:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578413fd1 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413fca expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.819739:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b200, rc 0) 00000100:00100000:1.0:1786002510.819798:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+22:6521:x1872758560915200:12345-0@lo:101:mdt00_001.0 Request processed in 12153us (12296us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.819806:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3689 00000100:00100000:0.0:1786002510.819909:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560915200:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1786002510.819925:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 4/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.819934:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 4/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.820094:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530860032 00000100:00100000:3.0:1786002510.820101:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530860032 00010000:00010000:3.0:1786002510.820127:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af57841387d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a661 expref: 29 pid: 10360 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.820157:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1643 00000100:00100000:3.0:1786002510.820165:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2412:x1872758530860032:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002510.820266:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002510.820273:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af57841387d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a661 expref: 29 pid: 10360 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.820285:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af57841387d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a661 expref: 29 pid: 10360 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.820405:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af57841387d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a661 expref: 29 pid: 10360 timeout: 970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.820424:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9ed2456ef600) 00010000:00010000:3.0:1786002510.820429:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578413fd1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413fca expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.820438:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578413fd1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413fca expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.820446:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578413fd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578413fca expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.820471:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578413fd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578413fca expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.820483:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560915456:0@lo:105: 00000100:00100000:3.0:1786002510.820517:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.821113:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f480 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.823266:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786002510.823283:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560915456 00000100:00100000:0.0:1786002510.823289:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560915456 00000100:00100000:0.0:1786002510.823480:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1786002510.823490:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f49a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560915456:12345-0@lo:105: 00010000:00010000:0.0:1786002510.823503:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 5/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.823514:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 5/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.823523:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 5/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.823531:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.823539:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.823547:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.823611:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f34a00) 00000100:00100000:0.0:1786002510.823671:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f49a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560915456:12345-0@lo:105: Request processed in 183us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002510.823678:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:3.0:1786002510.823752:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560915456:0@lo:105: 00010000:00010000:3.0:1786002510.823766:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002510.823804:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:2412:x1872758530860032:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 3638us (4390us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.823811:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1643 00010000:00010000:2.0:1786002510.828441:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.828457:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.830900:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560915584:0@lo:403:mdt00_001.0 00000100:00100000:2.0:1786002510.830973:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.831009:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790240 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.831125:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560915584 00000100:00100000:1.0:1786002510.831132:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560915584 00000100:00100000:1.0:1786002510.831233:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3690 00000100:00100000:1.0:1786002510.831243:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6521:x1872758560915584:12345-0@lo:403:mdt00_001.0 00000100:00100000:2.0:1786002510.836841:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6521:x1872758560915584:12345-0@lo:403:mdt00_001.0 Request processed in 5581us (5850us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.836870:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3690 00000100:00100000:0.0:1786002510.841230:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560915584:0@lo:403:mdt00_001.0 00000040:00080000:2.0:1786002510.845250:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].409, 952 off613488 00000040:00080000:2.0:1786002510.845517:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].409, 1032 off662336 00000004:00080000:2.0:1786002510.845524:0:6521:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed243311cc0 with version 772 00000004:00080000:1.0:1786002510.849022:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 772 rpc_version 772 00000020:00100000:1.0:1786002510.849122:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002510.849133:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2455f0700 x1872758560915840/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002510.849156:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560915840:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002510.849458:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002510.849543:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2419a2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.851212:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560915840 00000100:00100000:3.0:1786002510.851223:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560915840 00000100:00100000:3.0:1786002510.851322:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3691 00000100:00100000:3.0:1786002510.851332:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:7466:x1872758560915840:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002510.852352:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:7466:x1872758560915840:12345-0@lo:1000:osp_up0-1.0 Request processed in 1019us (2892us total) trans 4294983514 rc 0/0 00000100:00100000:2.0:1786002510.852530:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560915840:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1786002510.852642:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x6d:0x0]: returning size 4096 00010000:00010000:0.0:1786002510.852664:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852674:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852681:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852687:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002510.852692:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852699:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852715:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x3c:0x0].0x0 (ffff9ed245fed300) 00010000:00010000:0.0:1786002510.852717:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002510.852721:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852727:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578413fc3 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852747:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852755:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852762:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852784:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786002510.852792:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x3c:0x0] 00010000:00010000:0.0:1786002510.852800:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413fbc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852805:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413fbc lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852811:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413fbc lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852816:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002510.852819:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413fbc lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852824:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413fbc lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852840:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6d:0x0].0x0 (ffff9ed24559f200) 00010000:00010000:0.0:1786002510.852843:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002510.852867:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413fbc lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852874:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413fbc lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852886:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413fb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852892:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413fb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852899:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413fb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852916:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1786002510.852924:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1786002510.852928:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578413f99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852941:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413f99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852946:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578413f99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852960:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1786002510.852963:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1786002510.852968:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f600/0x7cee4af578413fa0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413fa7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.852974:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f600/0x7cee4af578413fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578413fa7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002510.853031:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:17798:x1872758530859776:12345-192.168.203.49@tcp:36:rm.0 Request processed in 71487us (72029us total) trans 4294968504 rc 0/0 00000100:00100000:0.0:1786002510.853039:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23789 00010000:00010000:2.0:1786002510.853151:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786002510.853158:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853165:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002510.853169:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002510.853177:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853205:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853211:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002510.853240:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 1/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853247:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34a00/0x7cee4af578413fca lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413fd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853261:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002510.853264:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413fb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853269:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002510.853272:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413fb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002510.853279:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413fb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853292:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413fb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853298:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002510.853303:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 1/0,0 mode: --/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413fb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853319:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af578413fae lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413fb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853329:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002510.853332:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578413f99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853338:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002510.853342:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413f99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002510.853348:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413f99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853371:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853378:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002510.853392:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853399:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f000/0x7cee4af578413f92 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853411:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002510.853413:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002510.853414:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002510.853426:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560916096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002510.853465:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.853490:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002510.853495:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560915968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002510.853513:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.853530:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002510.853536:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560916224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002510.853556:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.853576:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560916096 00000100:00100000:2.0:1786002510.853581:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560916096 00000100:00100000:2.0:1786002510.853610:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560915968 00000100:00100000:2.0:1786002510.853613:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560915968 00000100:00100000:2.0:1786002510.853622:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560916224 00000100:00100000:2.0:1786002510.853624:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560916224 00000100:00100000:2.0:1786002510.853637:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1786002510.853644:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+26:3645:x1872758560916096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.853654:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.853669:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578413fb5 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413fae expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853684:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6d:0x0].0x0 (ffff9ed24559fd00) 00010000:00010000:2.0:1786002510.853691:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002510.853714:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+25:3645:x1872758560916096:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.853720:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1786002510.853731:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1786002510.853737:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+24:3645:x1872758560915968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.853743:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.853752:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578413fd1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413fca expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853761:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9ed2456ef600) 00010000:00010000:2.0:1786002510.853767:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002510.853783:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+23:3645:x1872758560915968:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.853788:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1786002510.853798:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:2.0:1786002510.853804:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+22:3647:x1872758560916224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.853809:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.853818:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578413f99 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413f92 expref: 22 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.853827:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed351207c00) 00010000:00010000:2.0:1786002510.853844:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002510.853884:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+21:3647:x1872758560916224:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.853890:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:2.0:1786002510.853914:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560915968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002510.853922:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560916096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002510.853944:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560916224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.854131:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3691 00010000:00010000:3.0:1786002510.854150:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002510.858705:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002510.866940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.867018:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530860288 00000100:00100000:0.0:1786002510.867028:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530860288 00000100:00100000:0.0:1786002510.867085:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23790 00000100:00100000:0.0:1786002510.867094:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:17798:x1872758530860288:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:0.0:1786002510.867115:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002510.867133:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578413fd8 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x90:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002510.867277:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x90:0x0]: returning size 4096 00010000:00010000:0.0:1786002510.867377:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578413fd8 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x90:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8ad expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.867393:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x90:0x0].0x0 (ffff9ed35363d100) 00010000:00010000:0.0:1786002510.867396:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002510.867401:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578413fd8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x90:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8ad expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.867412:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34000, rc 0) 00000100:00100000:0.0:1786002510.867467:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530860288:12345-192.168.203.49@tcp:101:rm.0 Request processed in 374us (537us total) trans 4294968505 rc 301/301 00000100:00100000:0.0:1786002510.867474:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23790 00000100:00100000:1.0:1786002510.889711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002510.889789:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530860544 00000100:00100000:0.0:1786002510.889797:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530860544 00000100:00100000:0.0:1786002510.889885:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5062 00000100:00100000:0.0:1786002510.889895:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530860544:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:0.0:1786002510.890101:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530860544:12345-192.168.203.49@tcp:35:rm.0 Request processed in 207us (399us total) trans 4294968506 rc 0/0 00000100:00100000:0.0:1786002510.890109:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5062 00000100:00100000:3.0:1786002510.903546:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.903681:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530860800 00000100:00100000:2.0:1786002510.903689:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530860800 00000100:00100000:2.0:1786002510.903746:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23791 00000100:00100000:2.0:1786002510.903756:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530860800:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:2.0:1786002510.903810:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786002510.903880:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578413d0e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a84b expref: 48 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.903902:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578413933 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6a7 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.903912:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x90:0x0].0x0 (ffff9ed35363d100) 00010000:00010000:2.0:1786002510.903922:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002510.903944:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413fe6 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.903954:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413fe6 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.903963:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413fe6 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.903978:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578413fed lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.903984:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578413fed lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.903989:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578413fed lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.904042:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b200/0x7cee4af578413ff4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x90:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.904060:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b200/0x7cee4af578413ff4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.904067:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b200/0x7cee4af578413ff4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.904083:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 3/0,1 mode: --/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.904092:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af578413941 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ae expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.904100:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 4/0,1 mode: --/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.904128:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af578413941 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ae expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.904140:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af578413941 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ae expref: 46 pid: 6521 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.904153:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758560916352:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002510.904232:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790300 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.918156:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758560916352:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002510.918194:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 3/0,1 mode: --/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.921675:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.921763:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530860928 00000100:00100000:2.0:1786002510.921771:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530860928 00010000:00010000:2.0:1786002510.921806:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af578413941 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ae expref: 47 pid: 6521 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.921886:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1644 00000100:00100000:2.0:1786002510.921896:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed346569050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:2412:x1872758530860928:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.921910:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.921916:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af578413941 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ae expref: 47 pid: 6521 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.921929:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af578413941 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ae expref: 47 pid: 6521 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.921950:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af578413941 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ae expref: 47 pid: 6521 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.921965:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4d:0x0].0x0 (ffff9ed24556ec00) 00010000:00010000:2.0:1786002510.921970:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 3/0,1 mode: --/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.921979:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.921990:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.922017:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002510.922070:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed346569050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:2412:x1872758530860928:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 175us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.922077:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1644 00010000:00010000:3.0:1786002510.922563:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.922571:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.922611:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.922618:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.922627:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002510.922644:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560916480:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1786002510.922677:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002510.922707:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f480 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.922757:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560916480 00000100:00100000:1.0:1786002510.922762:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560916480 00000100:00100000:1.0:1786002510.922796:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3692 00000100:00100000:1.0:1786002510.922802:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:6522:x1872758560916480:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002510.922817:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002510.922829:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414009 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414002 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.922879:0:15596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841394f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6b5 expref: 27 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.922887:0:15596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414009 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414002 expref: 21 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.922907:0:15596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841394f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6b5 expref: 27 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.922919:0:15596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841394f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6b5 expref: 27 pid: 14496 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.922929:0:15596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560916608:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002510.922978:0:15596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2419a23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002510.933729:0:15596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560916608:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002510.933766:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414009 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414002 expref: 21 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.933779:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9ed35363d700) 00010000:00010000:1.0:1786002510.933782:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002510.933786:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414009 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414002 expref: 21 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.933796:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414009 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414002 expref: 21 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.933803:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f200, rc 0) 00000100:00100000:1.0:1786002510.933897:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+21:6522:x1872758560916480:12345-0@lo:101:mdt00_002.0 Request processed in 11094us (11217us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002510.933905:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3692 00000100:00100000:3.0:1786002510.934144:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560916480:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1786002510.934161:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.934181:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002510.939782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.940017:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530861056 00000100:00100000:2.0:1786002510.940026:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530861056 00010000:00010000:2.0:1786002510.940070:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841394f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6b5 expref: 28 pid: 14496 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.940112:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1645 00000100:00100000:2.0:1786002510.940121:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:2412:x1872758530861056:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.940134:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.940141:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841394f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6b5 expref: 28 pid: 14496 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.940154:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841394f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6b5 expref: 28 pid: 14496 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.940187:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841394f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6b5 expref: 28 pid: 14496 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.940202:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9ed35363d700) 00010000:00010000:2.0:1786002510.940209:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414009 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414002 expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.940220:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414009 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578414002 expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.940228:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414009 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578414002 expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.940255:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414009 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414002 expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.940268:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560916736:0@lo:105: 00000100:00100000:2.0:1786002510.940319:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.940396:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790540 going to sleep for 11 seconds 00000100:00100000:3.0:1786002510.942877:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560916736 00000100:00100000:3.0:1786002510.942888:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560916736 00000100:00100000:3.0:1786002510.942941:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:3.0:1786002510.942950:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560916736:12345-0@lo:105: 00010000:00010000:3.0:1786002510.942964:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.942975:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.942983:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.942991:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.942999:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.943007:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.943077:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245c8c600) 00000100:00100000:3.0:1786002510.943145:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560916736:12345-0@lo:105: Request processed in 195us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002510.943152:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1786002510.943464:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560916736:0@lo:105: 00010000:00010000:2.0:1786002510.943493:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002510.949337:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.950339:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002510.951154:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:2412:x1872758530861056:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 11027us (11374us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.951167:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1645 00000100:00100000:0.0:1786002510.951516:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560916864:0@lo:403:mdt00_002.0 00000100:00100000:0.0:1786002510.951580:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002510.951616:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed34bb3c240 going to sleep for 11 seconds 00000100:00100000:2.0:1786002510.952970:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560916864 00000100:00100000:2.0:1786002510.952981:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560916864 00000100:00100000:2.0:1786002510.953030:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3693 00000100:00100000:2.0:1786002510.953039:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:6522:x1872758560916864:12345-0@lo:403:mdt00_002.0 00000100:00100000:2.0:1786002510.957679:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:6522:x1872758560916864:12345-0@lo:403:mdt00_002.0 Request processed in 4632us (6090us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.957692:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3693 00000100:00100000:0.0:1786002510.957878:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560916864:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1786002510.959776:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].410, 952 off614440 00000040:00080000:0.0:1786002510.959963:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].410, 1032 off663368 00000004:00080000:0.0:1786002510.959969:0:6522:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed34bb3c240 with version 773 00000004:00080000:2.0:1786002510.960246:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 773 rpc_version 773 00000020:00100000:2.0:1786002510.960278:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002510.960286:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243dddc00 x1872758560917120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1992/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002510.960874:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dddc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560917120:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002510.960931:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.960959:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790540 going to sleep for 11 seconds 00000100:00100000:0.0:1786002510.961155:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560917120 00000100:00100000:0.0:1786002510.961162:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560917120 00000100:00100000:0.0:1786002510.961216:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3694 00000100:00100000:0.0:1786002510.961225:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b57ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:7466:x1872758560917120:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002510.961436:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b57ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:7466:x1872758560917120:12345-0@lo:1000:osp_up0-1.0 Request processed in 211us (503us total) trans 4294983515 rc 0/0 00000100:00100000:0.0:1786002510.961443:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3694 00000100:00100000:3.0:1786002510.961676:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dddc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560917120:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1786002510.963568:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x90:0x0]: returning size 4096 00010000:00010000:0.0:1786002510.963591:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963601:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963608:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963614:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002510.963619:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963630:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963644:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4d:0x0].0x0 (ffff9ed24556ec00) 00010000:00010000:0.0:1786002510.963647:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002510.963652:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 2/0,0 mode: --/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963658:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578413ffb lrc: 0/0,0 mode: --/EX res: [0x240000400:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963679:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963687:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963694:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963713:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786002510.963721:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x4d:0x0] 00010000:00010000:0.0:1786002510.963731:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b200/0x7cee4af578413ff4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963736:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b200/0x7cee4af578413ff4 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963741:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b200/0x7cee4af578413ff4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963750:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002510.963753:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b200/0x7cee4af578413ff4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963759:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b200/0x7cee4af578413ff4 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963766:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x90:0x0].0x0 (ffff9ed24559f400) 00010000:00010000:0.0:1786002510.963768:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002510.963770:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b200/0x7cee4af578413ff4 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963775:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b200/0x7cee4af578413ff4 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x90:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963791:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413fe6 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963796:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413fe6 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963801:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413fe6 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963806:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413fe6 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963811:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002510.963813:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413fe6 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963822:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413fe6 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963828:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed24559fd00) 00010000:00010000:0.0:1786002510.963841:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002510.963845:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413fe6 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963869:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578413fe6 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002510.963881:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043f49cef reply state 00000000987a77b0 transno 4294968507 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578413fed lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963891:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578413fed lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002510.963898:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xce6cbcc (ffff9ed24559f000) 00010000:00010000:0.0:1786002510.963900:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002510.963902:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002510.963964:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530860800:12345-192.168.203.49@tcp:36:rm.0 Request processed in 60207us (60424us total) trans 4294968507 rc 0/0 00000100:00100000:0.0:1786002510.963972:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23791 00010000:00010000:3.0:1786002510.964036:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002510.964043:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.964059:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c600 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002510.964063:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002510.964070:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.964098:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.964104:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002510.964132:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.964139:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c600/0x7cee4af578414002 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414009 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.964152:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002510.964154:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002510.964156:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002510.964163:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002510.964175:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560917248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002510.964213:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002510.965004:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560917248 00000100:00100000:2.0:1786002510.965012:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560917248 00000100:00100000:2.0:1786002510.965061:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1786002510.965070:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+22:3646:x1872758560917248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002510.965081:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002510.965098:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414009 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414002 expref: 22 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.965109:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9ed35363d700) 00010000:00010000:2.0:1786002510.965116:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002510.965144:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+21:3646:x1872758560917248:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002510.965150:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1786002510.965904:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560917248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002510.973043:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002510.973197:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530861184 00000100:00100000:2.0:1786002510.973206:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530861184 00000100:00100000:2.0:1786002510.973259:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23792 00000100:00100000:2.0:1786002510.973269:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17798:x1872758530861184:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:2.0:1786002510.973291:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002510.973319:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414010 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973449:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973463:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973474:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973484:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973490:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414017 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973496:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973501:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002510.973505:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973512:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414017 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973521:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:2.0:1786002510.973524:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002510.973528:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414017 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973534:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414017 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973562:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414010 lrc: 1/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8b4 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973571:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:2.0:1786002510.973574:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002510.973577:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414010 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8b4 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002510.973585:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2ba00, rc 0) 00000100:00100000:2.0:1786002510.973635:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17798:x1872758530861184:12345-192.168.203.49@tcp:101:rm.0 Request processed in 367us (601us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002510.973643:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23792 00000100:00100000:3.0:1786002510.983609:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002510.983698:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530861312 00000100:00100000:1.0:1786002510.983708:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530861312 00000100:00100000:1.0:1786002510.983764:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23793 00000100:00100000:1.0:1786002510.983773:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17798:x1872758530861312:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:1.0:1786002510.983792:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002510.983811:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af57841401e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8bb expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.983957:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414025 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.983973:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.983983:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.983993:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.983999:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414025 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.984005:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.984010:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002510.984014:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.984020:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414025 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.984029:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:1.0:1786002510.984033:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002510.984036:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414025 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.984042:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414025 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.984166:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af57841401e lrc: 1/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8bb expref: 28 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.984185:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:1.0:1786002510.984188:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002510.984191:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af57841401e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8bb expref: 28 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002510.984200:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fc00, rc 0) 00000100:00100000:1.0:1786002510.984298:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17798:x1872758530861312:12345-192.168.203.49@tcp:101:rm.0 Request processed in 525us (697us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002510.984306:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23793 00000100:00100000:0.0:1786002510.993109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002510.993327:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530861568 00000100:00100000:3.0:1786002510.993338:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530861568 00000100:00100000:3.0:1786002510.993399:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23794 00000100:00100000:3.0:1786002510.993410:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530861568:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:3.0:1786002510.993437:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002510.993457:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af57841402c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x186:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8c2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002510.993800:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x186:0x0]: returning size 4096 00010000:00010000:3.0:1786002510.993926:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af57841402c lrc: 1/0,0 mode: --/CR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8c2 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.993941:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff9ed36e785f00) 00010000:00010000:3.0:1786002510.993944:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002510.993949:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af57841402c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8c2 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002510.993962:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c600, rc 0) 00000100:00100000:3.0:1786002510.994071:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530861568:12345-192.168.203.49@tcp:101:rm.0 Request processed in 663us (970us total) trans 4294968508 rc 301/301 00000100:00100000:3.0:1786002510.994078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23794 00000100:00100000:2.0:1786002511.007285:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002511.009247:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530861696 00000100:00100000:0.0:1786002511.009258:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530861696 00000100:00100000:0.0:1786002511.009417:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23795 00000100:00100000:0.0:1786002511.009428:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17798:x1872758530861696:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:0.0:1786002511.009447:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002511.009479:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af57841403a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8c9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009602:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009615:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009625:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009634:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009641:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414041 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009647:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009653:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002511.009657:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009664:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009674:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:0.0:1786002511.009676:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002511.009681:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414041 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009690:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009718:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af57841403a lrc: 1/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8c9 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009727:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:0.0:1786002511.009729:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002511.009733:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af57841403a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8c9 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.009741:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34000, rc 0) 00000100:00100000:0.0:1786002511.009805:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17798:x1872758530861696:12345-192.168.203.49@tcp:101:rm.0 Request processed in 379us (2528us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002511.009812:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23795 00000100:00100000:3.0:1786002511.014122:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002511.024598:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530861824 00000100:00100000:1.0:1786002511.024612:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530861824 00000100:00100000:1.0:1786002511.024694:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23796 00000100:00100000:1.0:1786002511.024704:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17798:x1872758530861824:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:1.0:1786002511.024723:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002511.024742:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578414048 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8d0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.024894:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841404f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.024908:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841404f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.024917:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841404f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.024926:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841404f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.024933:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841404f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.024939:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841404f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.024944:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002511.024948:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841404f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.024955:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841404f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.024965:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:1.0:1786002511.024968:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002511.024972:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841404f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.024977:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841404f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.025003:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578414048 lrc: 1/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8d0 expref: 28 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.025012:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:1.0:1786002511.025015:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002511.025018:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af578414048 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8d0 expref: 28 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.025026:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fc00, rc 0) 00000100:00100000:1.0:1786002511.025623:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17798:x1872758530861824:12345-192.168.203.49@tcp:101:rm.0 Request processed in 918us (11508us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002511.025631:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23796 00000100:00100000:3.0:1786002511.032973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002511.033140:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530861952 00000100:00100000:1.0:1786002511.033149:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530861952 00000100:00100000:1.0:1786002511.033200:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5063 00000100:00100000:1.0:1786002511.033209:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17798:x1872758530861952:12345-192.168.203.49@tcp:37:rm.0 00000100:00100000:1.0:1786002511.040660:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17798:x1872758530861952:12345-192.168.203.49@tcp:37:rm.0 Request processed in 7439us (7682us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002511.040674:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5063 00000100:00100000:3.0:1786002511.064982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002511.065077:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530862208 00000100:00100000:1.0:1786002511.065087:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530862208 00000100:00100000:1.0:1786002511.065140:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5064 00000100:00100000:1.0:1786002511.065149:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530862208:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:1.0:1786002511.065502:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:17798:x1872758530862208:12345-192.168.203.49@tcp:35:rm.0 Request processed in 353us (527us total) trans 4294968509 rc 0/0 00000100:00100000:1.0:1786002511.065510:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5064 00000100:00100000:0.0:1786002511.080304:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002511.080394:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530862592 00000100:00100000:2.0:1786002511.080402:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530862592 00000100:00100000:2.0:1786002511.080458:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23797 00000100:00100000:2.0:1786002511.080467:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:17798:x1872758530862592:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:2.0:1786002511.080519:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002511.080542:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578413c97 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x186:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a821 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.080559:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff9ed36e785f00) 00010000:00010000:2.0:1786002511.080568:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002511.080609:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.080617:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.080626:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.080646:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560917376:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1786002511.080686:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.080739:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.080880:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560917376 00000100:00100000:0.0:1786002511.080884:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560917376 00000100:00100000:0.0:1786002511.080913:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3695 00000100:00100000:0.0:1786002511.080920:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:6521:x1872758560917376:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1786002511.080931:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002511.080944:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841405d lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414056 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.080963:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841405d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414056 expref: 22 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.080979:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841405d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414056 expref: 22 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.080986:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed36e785200) 00010000:00010000:0.0:1786002511.080988:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002511.080991:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34800, rc 0) 00000100:00100000:0.0:1786002511.081035:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:6521:x1872758560917376:12345-0@lo:101:mdt00_001.0 Request processed in 115us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002511.081041:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3695 00000100:00100000:1.0:1786002511.081166:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560917376:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1786002511.081189:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841405d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.081200:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841405d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002511.081216:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:1.0:1786002511.081236:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7fc00/0x7cee4af578414064 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.081243:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7fc00/0x7cee4af578414064 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.081250:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7fc00/0x7cee4af578414064 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002511.081261:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560917504:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1786002511.081284:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002511.081310:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2419a2780 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.081540:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560917504 00000100:00100000:0.0:1786002511.081545:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560917504 00000100:00100000:0.0:1786002511.081575:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3696 00000100:00100000:0.0:1786002511.081581:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+22:6521:x1872758560917504:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1786002511.081588:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002511.081599:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af57841406b lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414064 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.081613:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af57841406b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414064 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.081622:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af57841406b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414064 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.081629:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xb73071de (ffff9ed36e785400) 00010000:00010000:0.0:1786002511.081631:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002511.081633:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34a00, rc 0) 00000100:00100000:0.0:1786002511.081664:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+23:6521:x1872758560917504:12345-0@lo:101:mdt00_001.0 Request processed in 83us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002511.081670:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3696 00000100:00100000:0.0:1786002511.081702:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560917504:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1786002511.081711:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7fc00/0x7cee4af578414064 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841406b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.081719:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7fc00/0x7cee4af578414064 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841406b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002511.081731:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1786002511.081758:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560917632:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786002511.081780:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002511.081797:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560917632 00000100:00100000:0.0:1786002511.081800:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560917632 00000100:00100000:0.0:1786002511.081818:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3697 00000100:00100000:0.0:1786002511.081823:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:6521:x1872758560917632:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786002511.081897:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:6521:x1872758560917632:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002511.081903:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3697 00000100:00100000:0.0:1786002511.081918:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.081930:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560917632:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786002511.081962:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560917760:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786002511.081982:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002511.081997:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560917760 00000100:00100000:0.0:1786002511.082000:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560917760 00000100:00100000:0.0:1786002511.082017:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3698 00000100:00100000:0.0:1786002511.082022:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:6521:x1872758560917760:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786002511.082093:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:6521:x1872758560917760:12345-0@lo:1000:mdt00_001.0 Request processed in 69us (109us total) trans 0 rc 1/1 00000100:00100000:0.0:1786002511.082098:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3698 00000100:00100000:0.0:1786002511.082114:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.082125:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560917760:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1786002511.082156:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.082163:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.082181:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002511.082192:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560917888:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1786002511.082214:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002511.082231:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560917888 00000100:00100000:0.0:1786002511.082234:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560917888 00000100:00100000:0.0:1786002511.082252:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3699 00000100:00100000:0.0:1786002511.082258:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+23:6521:x1872758560917888:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1786002511.082265:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002511.082273:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414079 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414072 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.082289:0:20598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578413c5f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a805 expref: 26 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.082303:0:20598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414079 lrc: 4/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414072 expref: 24 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.082322:0:20598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578413c5f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a805 expref: 26 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.082336:0:20598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578413c5f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a805 expref: 26 pid: 14496 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002511.082348:0:20598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ed80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20598:1872758560918016:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002511.083022:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.084006:0:20598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002511.087805:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00010000:00010000:2.0:1786002511.091115:0:20598:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@00000000a9006f2a x1872758560918016) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578413c5f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a805 expref: 26 pid: 14496 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.091139:0:20598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578413c5f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a805 expref: 26 pid: 14496 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.091161:0:20598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578413c5f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a805 expref: 26 pid: 14496 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.091184:0:20598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ed80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20598:1872758560918016:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002511.091207:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff9ed366e56400) 00010000:00010000:2.0:1786002511.091214:0:20598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414079 lrc: 3/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414072 expref: 24 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.091224:0:20598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414079 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7cee4af578414072 expref: 24 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.091232:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414079 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7cee4af578414072 expref: 24 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.091269:0:20598:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414079 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414072 expref: 24 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.091282:0:20598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddce00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20598:1872758560918144:0@lo:105: 00000100:00100000:2.0:1786002511.091321:0:20598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.091352:0:20598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3537909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002511.091618:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560918144 00000100:00100000:3.0:1786002511.091625:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560918144 00000100:00100000:3.0:1786002511.091674:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:3.0:1786002511.091683:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:20598:x1872758560918144:12345-0@lo:105: 00010000:00010000:3.0:1786002511.091694:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.091704:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.091712:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.091719:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.091726:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 5/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.091733:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 5/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.091744:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f35600) 00000100:00100000:3.0:1786002511.091777:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:20598:x1872758560918144:12345-0@lo:105: Request processed in 96us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002511.091784:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:2.0:1786002511.096057:0:20598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddce00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:20598:1872758560918144:0@lo:105: 00010000:00010000:2.0:1786002511.096091:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414079 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414072 expref: 24 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.096103:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff9ed366e56400) 00010000:00010000:2.0:1786002511.096106:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002511.096109:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:2.0:1786002511.096185:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+24:6521:x1872758560917888:12345-0@lo:101:mdt00_001.0 Request processed in 13926us (13969us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.096193:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3699 00000100:00100000:3.0:1786002511.096374:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560917888:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1786002511.096391:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.096431:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af578414080 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.096442:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af578414080 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.096452:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af578414080 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.096469:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.096479:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a813 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.096487:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 4/0,1 mode: --/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.096516:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a813 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.096531:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a813 expref: 48 pid: 6521 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.096545:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560918272:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002511.096615:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.097162:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530862336 00000100:00100000:0.0:1786002511.097177:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530862336 00000100:00100000:0.0:1786002511.097224:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1429 00000100:00100000:0.0:1786002511.097232:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:2413:x1872758530862336:12345-192.168.203.49@tcp:103:rm.0 00010000:00010000:0.0:1786002511.097244:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002511.097247:0:6507:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 7cee4af578413c5f) 00010000:00010000:0.0:1786002511.097249:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002511.097280:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:2413:x1872758530862336:12345-192.168.203.49@tcp:103:rm.0 Request processed in 48us (9485us total) trans 0 rc 116/116 00000100:00100000:0.0:1786002511.097287:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1429 00000100:00100000:2.0:1786002511.101513:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560918272:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002511.101541:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.104918:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002511.105163:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530862720 00000100:00100000:0.0:1786002511.105179:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530862720 00010000:00010000:0.0:1786002511.105214:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a813 expref: 49 pid: 6521 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002511.105251:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1646 00000100:00100000:0.0:1786002511.105259:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:2412:x1872758530862720:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002511.105273:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002511.105279:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a813 expref: 49 pid: 6521 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.105291:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a813 expref: 49 pid: 6521 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.105312:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578413c7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a813 expref: 49 pid: 6521 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.105326:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcb:0x0].0x0 (ffff9ed24556ed00) 00010000:00010000:0.0:1786002511.105330:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.105340:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.105346:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.105416:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002511.105506:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:2412:x1872758530862720:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 246us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002511.105513:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1646 00010000:00010000:2.0:1786002511.111363:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.111381:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.114097:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.114117:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.114129:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.114153:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d30700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560918400:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1786002511.114220:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002511.114259:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002511.114322:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560918400 00000100:00100000:2.0:1786002511.114329:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560918400 00000100:00100000:2.0:1786002511.114390:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3700 00000100:00100000:2.0:1786002511.114399:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+24:6521:x1872758560918400:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1786002511.114415:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002511.114428:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414095 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841408e expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.114452:0:15596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a83d expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.114461:0:15596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414095 lrc: 4/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841408e expref: 25 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.114482:0:15596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a83d expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.114495:0:15596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a83d expref: 25 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.114506:0:15596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddc700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560918528:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002511.114552:0:15596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3537909c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002511.119145:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002511.119309:0:15596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddc700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560918528:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002511.119341:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414095 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841408e expref: 25 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.119367:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:2.0:1786002511.119370:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002511.119375:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414095 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841408e expref: 25 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.119386:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414095 lrc: 3/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841408e expref: 25 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.119394:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b800, rc 0) 00000100:00100000:2.0:1786002511.119451:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6521:x1872758560918400:12345-0@lo:101:mdt00_001.0 Request processed in 5053us (5231us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.119460:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3700 00000100:00100000:3.0:1786002511.119581:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d30700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560918400:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1786002511.119598:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.119607:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002511.119673:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530862848 00000100:00100000:1.0:1786002511.119680:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530862848 00010000:00010000:1.0:1786002511.119707:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a83d expref: 26 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002511.119737:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1647 00000100:00100000:1.0:1786002511.119745:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:2412:x1872758530862848:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002511.119758:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002511.119764:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a83d expref: 26 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.119775:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a83d expref: 26 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.119793:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578413cc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xcb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a83d expref: 26 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.119805:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:1.0:1786002511.119810:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414095 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841408e expref: 24 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.119819:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414095 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af57841408e expref: 24 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.119827:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414095 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af57841408e expref: 24 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.119896:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414095 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841408e expref: 24 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002511.119909:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6507:1872758560918656:0@lo:105: 00000100:00100000:1.0:1786002511.119938:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002511.119965:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2419a2780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002511.120009:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560918656 00000100:00100000:3.0:1786002511.120013:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560918656 00000100:00100000:3.0:1786002511.120053:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1786002511.120059:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6507:x1872758560918656:12345-0@lo:105: 00010000:00010000:3.0:1786002511.120069:0:17237:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 5/0,1 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.120077:0:17237:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 5/0,1 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.120090:0:17237:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 5/0,1 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.120097:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 5/0,1 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.120103:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.120111:0:17237:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 6/0,1 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.120126:0:17237:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245c8c000) 00000100:00100000:3.0:1786002511.120154:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6507:x1872758560918656:12345-0@lo:105: Request processed in 95us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002511.120160:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1786002511.120195:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6507:1872758560918656:0@lo:105: 00010000:00010000:3.0:1786002511.120205:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002511.120235:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:2412:x1872758530862848:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 491us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002511.120241:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1647 00010000:00010000:3.0:1786002511.120258:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.120266:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002511.120607:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].411, 888 off615328 00000040:00080000:3.0:1786002511.120749:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].411, 968 off664336 00000004:00080000:3.0:1786002511.120757:0:6521:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245d3f0c0 with version 774 00000004:00080000:3.0:1786002511.120770:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 774 rpc_version 774 00000020:00100000:3.0:1786002511.120789:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002511.120796:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244d30700 x1872758560918912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2208/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002511.120812:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d30700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560918912:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002511.120877:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002511.120892:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002511.122388:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560918912 00000100:00100000:2.0:1786002511.122397:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560918912 00000100:00100000:2.0:1786002511.122436:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3701 00000100:00100000:2.0:1786002511.122444:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:7466:x1872758560918912:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002511.122795:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+26:7466:x1872758560918912:12345-0@lo:1000:osp_up0-1.0 Request processed in 350us (1916us total) trans 4294983516 rc 0/0 00000100:00100000:2.0:1786002511.122802:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3701 00000100:00100000:2.0:1786002511.122874:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d30700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560918912:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1786002511.123636:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x186:0x0]: returning size 4096 00010000:00010000:3.0:1786002511.123657:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123667:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123675:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123680:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002511.123684:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123691:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123706:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xcb:0x0].0x0 (ffff9ed24556ed00) 00010000:00010000:3.0:1786002511.123709:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002511.123713:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123719:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414087 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123736:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123743:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123750:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123771:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002511.123779:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0xcb:0x0] 00010000:00010000:3.0:1786002511.123785:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af578414080 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123791:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af578414080 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123796:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af578414080 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123800:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002511.123803:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af578414080 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123808:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af578414080 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123815:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff9ed245fed000) 00010000:00010000:3.0:1786002511.123818:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002511.123821:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af578414080 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123826:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af578414080 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123865:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123872:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123879:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123889:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1786002511.123898:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1786002511.123901:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841405d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123908:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af57841405d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123915:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af57841405d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123926:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:3.0:1786002511.123929:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:3.0:1786002511.123936:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786002511.123941:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123947:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002511.123950:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002511.123957:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123982:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.123988:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002511.124012:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 1/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.124019:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c000/0x7cee4af57841408e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414095 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.124031:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786002511.124034:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.124040:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002511.124043:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.124200:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002511.124206:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af57841405d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.124213:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002511.124216:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af57841405d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002511.124223:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af57841405d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.124241:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841405d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.124251:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002511.124258:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841405d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.124264:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af578414056 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841405d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.124276:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002511.124277:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002511.124278:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002511.124412:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002511.124425:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560919168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002511.124463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.124503:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002511.124509:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560919040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002511.124530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002511.125156:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560919168 00000100:00100000:1.0:1786002511.125162:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560919168 00000100:00100000:1.0:1786002511.125202:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560919040 00000100:00100000:1.0:1786002511.125205:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560919040 00000100:00100000:1.0:1786002511.125233:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1786002511.125243:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+27:3645:x1872758560919168:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002511.125251:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00010000:00010000:1.0:1786002511.125255:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1786002511.125264:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed346569c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+27:3645:x1872758560919040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002511.125274:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002511.125276:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841405d lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414056 expref: 27 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.125290:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414095 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xcb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841408e expref: 26 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.125292:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed36e785200) 00010000:00010000:1.0:1786002511.125304:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002511.125309:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xcb:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:2.0:1786002511.125320:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002511.125351:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+25:3645:x1872758560919168:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002511.125358:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000004:00010000:3.0:1786002511.125464:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.125483:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.125489:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002511.125515:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.125523:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414072 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414079 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.125535:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002511.125536:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002511.125538:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002511.125548:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786002511.125556:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560919296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002511.125582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002511.125604:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560919296 00000100:00100000:3.0:1786002511.125607:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560919296 00000100:00100000:3.0:1786002511.125627:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1786002511.125634:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+25:3647:x1872758560919296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002511.125641:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002511.125651:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414079 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x186:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414072 expref: 25 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.125666:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x186:0x0].0x0 (ffff9ed366e56400) 00010000:00010000:3.0:1786002511.125671:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002511.125695:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+24:3647:x1872758560919296:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002511.125701:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1786002511.125729:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560919296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002511.125748:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7fc00/0x7cee4af578414064 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841406b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.125757:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7fc00/0x7cee4af578414064 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841406b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.125813:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530862592:12345-192.168.203.49@tcp:36:rm.0 Request processed in 45345us (45516us total) trans 4294968510 rc 0/0 00000100:00100000:3.0:1786002511.125820:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23797 00000100:00100000:2.0:1786002511.127507:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed346569c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+23:3645:x1872758560919040:12345-0@lo:103:ldlm_bl.0 Request processed in 2243us (2971us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.127518:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:2.0:1786002511.127592:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560919040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002511.127601:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560919168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002511.138279:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002511.138386:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530863104 00000100:00100000:1.0:1786002511.138395:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530863104 00000100:00100000:1.0:1786002511.138454:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23798 00000100:00100000:1.0:1786002511.138465:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17798:x1872758530863104:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:1.0:1786002511.138483:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002511.138500:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841409c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x141d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8d7 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002511.138632:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x141d:0x0]: returning size 4096 00010000:00010000:1.0:1786002511.138713:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841409c lrc: 1/0,0 mode: --/CR res: [0x200000402:0x141d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8d7 expref: 27 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.138728:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x141d:0x0].0x0 (ffff9ed2456efc00) 00010000:00010000:1.0:1786002511.138731:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002511.138736:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841409c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x141d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8d7 expref: 27 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.138747:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fa00, rc 0) 00000100:00100000:1.0:1786002511.138801:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17798:x1872758530863104:12345-192.168.203.49@tcp:101:rm.0 Request processed in 337us (530us total) trans 4294983517 rc 301/301 00000100:00100000:1.0:1786002511.138808:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23798 00000100:00100000:3.0:1786002511.147146:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002511.147268:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530863360 00000100:00100000:1.0:1786002511.147277:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530863360 00000100:00100000:1.0:1786002511.147331:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5065 00000100:00100000:1.0:1786002511.147340:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17798:x1872758530863360:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:1.0:1786002511.147554:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17798:x1872758530863360:12345-192.168.203.49@tcp:35:rm.0 Request processed in 214us (415us total) trans 4294983518 rc 0/0 00000100:00100000:1.0:1786002511.147561:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5065 00000100:00100000:2.0:1786002511.154825:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002511.154969:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530863616 00000100:00100000:3.0:1786002511.154978:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530863616 00000100:00100000:3.0:1786002511.155031:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23799 00000100:00100000:3.0:1786002511.155041:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:17798:x1872758530863616:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:3.0:1786002511.155118:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786002511.155142:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578413d70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x141d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a859 expref: 27 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155168:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af5784138ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x141d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a68b expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155188:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x141d:0x0].0x0 (ffff9ed2456efc00) 00010000:00010000:3.0:1786002511.155198:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002511.155220:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784140aa lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155231:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784140aa lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155240:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784140aa lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155250:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784140b1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xee075455 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155256:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784140b1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155262:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784140b1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155316:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784140b8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x141d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155323:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784140b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x141d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155330:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784140b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x141d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155346:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 3/0,1 mode: --/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155367:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784138fb lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a692 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155375:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 4/0,1 mode: --/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155405:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784138fb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a692 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.155418:0:14496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784138fb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a692 expref: 25 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.155431:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d33100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560919424:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002511.155666:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002511.169312:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d33100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560919424:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002511.169340:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 3/0,1 mode: --/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.181371:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002511.181682:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530863744 00000100:00100000:3.0:1786002511.181691:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530863744 00010000:00010000:3.0:1786002511.181727:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784138fb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a692 expref: 26 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.181769:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1648 00000100:00100000:3.0:1786002511.181778:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:2412:x1872758530863744:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002511.181791:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002511.181797:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784138fb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a692 expref: 26 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.181810:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784138fb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a692 expref: 26 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.181839:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784138fb lrc: 0/0,0 mode: --/PR res: [0x200000400:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a692 expref: 26 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.181889:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x4b:0x0].0x0 (ffff9ed35363db00) 00010000:00010000:3.0:1786002511.181894:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 3/0,1 mode: --/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.181903:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.181910:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.181939:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002511.181983:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:2412:x1872758530863744:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 205us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002511.181989:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1648 00010000:00010000:2.0:1786002511.182051:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.182060:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.182100:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.182106:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.182119:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.182136:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dde300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560919552:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002511.182182:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.182208:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790540 going to sleep for 11 seconds 00000100:00100000:3.0:1786002511.182683:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560919552 00000100:00100000:3.0:1786002511.182687:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560919552 00000100:00100000:3.0:1786002511.182720:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3702 00000100:00100000:3.0:1786002511.182727:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:14496:x1872758560919552:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002511.182744:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002511.182756:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784140cd lrc: 2/0,0 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784140c6 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.182777:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af578413909 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a699 expref: 47 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.182785:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784140cd lrc: 4/0,0 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784140c6 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.182804:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af578413909 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a699 expref: 47 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.182816:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af578413909 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a699 expref: 47 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.182826:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d33100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6525:1872758560919680:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002511.182968:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002511.188292:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d33100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6525:1872758560919680:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002511.188324:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784140cd lrc: 3/0,0 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784140c6 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.188337:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x4b:0x0].0x0 (ffff9ed2456ef500) 00010000:00010000:3.0:1786002511.188340:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002511.188344:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784140cd lrc: 3/0,0 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784140c6 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.188370:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784140cd lrc: 3/0,0 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784140c6 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.188377:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d200, rc 0) 00000100:00100000:3.0:1786002511.188432:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:14496:x1872758560919552:12345-0@lo:101:mdt00_004.0 Request processed in 5705us (6250us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002511.188440:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702 00000100:00100000:2.0:1786002511.188559:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dde300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560919552:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002511.188576:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.188584:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002511.193378:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002511.193498:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530863872 00000100:00100000:2.0:1786002511.193506:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530863872 00010000:00010000:2.0:1786002511.193540:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af578413909 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a699 expref: 48 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.193581:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1649 00000100:00100000:2.0:1786002511.193590:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:2412:x1872758530863872:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002511.193603:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002511.193609:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af578413909 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a699 expref: 48 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.193622:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af578413909 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a699 expref: 48 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.193648:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46e00/0x7cee4af578413909 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x4b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a699 expref: 48 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.193664:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x4b:0x0].0x0 (ffff9ed2456ef500) 00010000:00010000:2.0:1786002511.193671:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784140cd lrc: 2/0,0 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784140c6 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.193681:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784140cd lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784140c6 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.193689:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784140cd lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784140c6 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.193717:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784140cd lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784140c6 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.193729:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6507:1872758560919808:0@lo:105: 00000100:00100000:2.0:1786002511.193768:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.193807:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790540 going to sleep for 11 seconds 00000100:00100000:3.0:1786002511.193869:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560919808 00000100:00100000:3.0:1786002511.193873:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560919808 00000100:00100000:3.0:1786002511.193905:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1786002511.193912:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6507:x1872758560919808:12345-0@lo:105: 00010000:00010000:3.0:1786002511.193922:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.193932:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.193940:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.193946:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.193952:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.193960:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.193979:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed243d2a400) 00000100:00100000:3.0:1786002511.194014:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6507:x1872758560919808:12345-0@lo:105: Request processed in 102us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002511.194020:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1786002511.194241:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6507:1872758560919808:0@lo:105: 00010000:00010000:2.0:1786002511.194255:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002511.194292:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:2412:x1872758530863872:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 702us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.194298:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1649 00010000:00010000:2.0:1786002511.194318:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.194332:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.194954:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dde300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560919936:0@lo:403:mdt00_004.0 00000100:00100000:2.0:1786002511.194992:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.195007:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790540 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.195233:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560919936 00000100:00100000:0.0:1786002511.195238:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560919936 00000100:00100000:0.0:1786002511.195270:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3703 00000100:00100000:0.0:1786002511.195277:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:14496:x1872758560919936:12345-0@lo:403:mdt00_004.0 00000100:00100000:0.0:1786002511.199376:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:14496:x1872758560919936:12345-0@lo:403:mdt00_004.0 Request processed in 4092us (4376us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002511.199389:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3703 00000100:00100000:3.0:1786002511.202957:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dde300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560919936:0@lo:403:mdt00_004.0 00000040:00080000:3.0:1786002511.204784:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].397, 952 off596768 00000040:00080000:3.0:1786002511.205660:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].396, 1032 off646064 00000004:00080000:3.0:1786002511.205668:0:14496:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed2456d86c0 with version 755 00000004:00080000:1.0:1786002511.208240:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 755 rpc_version 755 00000020:00100000:1.0:1786002511.208278:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002511.208288:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2455f1180 x1872758560920192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2248/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002511.208310:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560920192:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002511.208422:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002511.208492:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2419a2000 going to sleep for 11 seconds 00000100:00100000:2.0:1786002511.211462:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560920192 00000100:00100000:2.0:1786002511.211473:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560920192 00000100:00100000:2.0:1786002511.211531:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3704 00000100:00100000:2.0:1786002511.211540:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:7805:x1872758560920192:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002511.211780:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+14:7805:x1872758560920192:12345-0@lo:1000:osp_up1-0.0 Request processed in 240us (3358us total) trans 4294968511 rc 0/0 00000100:00100000:2.0:1786002511.211788:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3704 00000100:00100000:1.0:1786002511.213191:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560920192:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1786002511.213299:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x141d:0x0]: returning size 4096 00010000:00010000:2.0:1786002511.213320:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213329:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213337:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213343:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002511.213348:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213365:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213381:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x4b:0x0].0x0 (ffff9ed35363db00) 00010000:00010000:2.0:1786002511.213384:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002511.213389:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 2/0,0 mode: --/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213395:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784140bf lrc: 0/0,0 mode: --/EX res: [0x200000400:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213415:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213423:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213429:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213452:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002511.213461:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x4b:0x0] 00010000:00010000:2.0:1786002511.213471:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784140b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x141d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213477:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784140b8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x141d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213483:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784140b8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x141d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213487:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002511.213490:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784140b8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x141d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213496:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784140b8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x141d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213503:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x141d:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:2.0:1786002511.213505:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002511.213507:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784140b8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x141d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213512:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784140b8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x141d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213530:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784140aa lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213536:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784140aa lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213541:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784140aa lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213546:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784140aa lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213550:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002511.213552:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784140aa lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213558:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784140aa lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213563:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed245fed200) 00010000:00010000:2.0:1786002511.213566:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002511.213568:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784140aa lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213574:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784140aa lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002511.213584:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbc8543b reply state 0000000084bee4fb transno 4294983519 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784140b1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213595:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784140b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.213601:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xee075455 (ffff9ed245fed000) 00010000:00010000:2.0:1786002511.213603:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002511.213606:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002511.213669:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17798:x1872758530863616:12345-192.168.203.49@tcp:36:rm.0 Request processed in 58627us (58850us total) trans 4294983519 rc 0/0 00000100:00100000:2.0:1786002511.213677:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23799 00010000:00010000:1.0:1786002511.213990:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002511.213996:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.214005:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002511.214009:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002511.214016:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.214053:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.214060:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002511.214081:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.214088:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af5784140c6 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784140cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.214106:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002511.214108:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002511.214110:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002511.214122:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560920320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002511.214163:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002511.215070:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560920320 00000100:00100000:0.0:1786002511.215077:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560920320 00000100:00100000:0.0:1786002511.215116:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1786002511.215124:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+14:3647:x1872758560920320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002511.215134:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002511.215149:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784140cd lrc: 0/0,0 mode: --/EX res: [0x240000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784140c6 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.215162:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x4b:0x0].0x0 (ffff9ed2456ef500) 00010000:00010000:0.0:1786002511.215254:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002511.215292:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+13:3647:x1872758560920320:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002511.215299:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1786002511.215941:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560920320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002511.224941:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002511.225158:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530864128 00000100:00100000:3.0:1786002511.225167:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530864128 00000100:00100000:3.0:1786002511.225226:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23800 00000100:00100000:3.0:1786002511.225235:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed35a45f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:17798:x1872758530864128:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:3.0:1786002511.225255:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002511.225273:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784140d4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002511.225412:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x27:0x0]: returning size 4096 00010000:00010000:3.0:1786002511.225493:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784140d4 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8de expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.225507:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x27:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:3.0:1786002511.225510:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002511.225515:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784140d4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8de expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.225528:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ca00, rc 0) 00000100:00100000:3.0:1786002511.225586:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed35a45f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530864128:12345-192.168.203.49@tcp:101:rm.0 Request processed in 352us (653us total) trans 4294968512 rc 301/301 00000100:00100000:3.0:1786002511.225593:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23800 00000100:00100000:2.0:1786002511.249984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002511.250063:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530864384 00000100:00100000:0.0:1786002511.250072:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530864384 00000100:00100000:0.0:1786002511.250125:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5066 00000100:00100000:0.0:1786002511.250135:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530864384:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:0.0:1786002511.250364:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:17798:x1872758530864384:12345-192.168.203.49@tcp:35:rm.0 Request processed in 223us (380us total) trans 4294968513 rc 0/0 00000100:00100000:0.0:1786002511.250372:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5066 00000100:00100000:0.0:1786002511.253893:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002511.253921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002511.253989:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530864512 00000100:00100000:2.0:1786002511.253997:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530864512 00000100:00100000:2.0:1786002511.254057:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1434 00000100:00100000:2.0:1786002511.254066:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:2412:x1872758530864512:12345-192.168.203.49@tcp:103:rm.0 00010000:00010000:2.0:1786002511.254079:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002511.254100:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578413c0b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7e2 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.254122:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x27:0x0].0x0 (ffff9ed366e56700) 00010000:00010000:2.0:1786002511.254132:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002511.254189:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:2412:x1872758530864512:12345-192.168.203.49@tcp:103:rm.0 Request processed in 124us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.254196:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1434 00000100:00100000:1.0:1786002511.255295:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530864768 00000100:00100000:1.0:1786002511.255301:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530864768 00000100:00100000:1.0:1786002511.255343:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23801 00000100:00100000:1.0:1786002511.255360:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:17798:x1872758530864768:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:1.0:1786002511.255405:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002511.255420:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c46600/0x7cee4af578413c27 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x27:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7f0 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.255433:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x27:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:1.0:1786002511.255440:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002511.255492:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.255500:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.255510:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002511.255528:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560920448:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786002511.255565:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002511.255588:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2419a2000 going to sleep for 11 seconds 00000100:00100000:2.0:1786002511.255731:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560920448 00000100:00100000:2.0:1786002511.255736:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560920448 00000100:00100000:2.0:1786002511.255760:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705 00000100:00100000:2.0:1786002511.255766:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+23:6520:x1872758560920448:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786002511.255777:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002511.255791:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af5784140e9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784140e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.255811:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af5784140e9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784140e2 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.255821:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af5784140e9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784140e2 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.255838:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24559fd00) 00010000:00010000:2.0:1786002511.255841:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002511.255844:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a400, rc 0) 00000100:00100000:2.0:1786002511.255892:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+24:6520:x1872758560920448:12345-0@lo:101:mdt00_000.0 Request processed in 126us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.255898:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705 00000100:00100000:2.0:1786002511.255928:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560920448:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786002511.255941:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784140e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.255951:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784140e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002511.255967:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:2.0:1786002511.255984:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2bc00/0x7cee4af5784140f0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.255991:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2bc00/0x7cee4af5784140f0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.255998:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2bc00/0x7cee4af5784140f0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.256008:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560920576:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1786002511.256028:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.256041:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790240 going to sleep for 11 seconds 00000100:00100000:2.0:1786002511.256157:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560920576 00000100:00100000:2.0:1786002511.256161:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560920576 00000100:00100000:2.0:1786002511.257898:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3706 00000100:00100000:2.0:1786002511.257911:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+24:6520:x1872758560920576:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786002511.257923:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002511.257939:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af5784140f7 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784140f0 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.257957:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af5784140f7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784140f0 expref: 25 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.257972:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af5784140f7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784140f0 expref: 25 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.257980:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xfe89f9f8 (ffff9ed24559f200) 00010000:00010000:2.0:1786002511.257983:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002511.257985:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b800, rc 0) 00000100:00100000:2.0:1786002511.258026:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6520:x1872758560920576:12345-0@lo:101:mdt00_000.0 Request processed in 119us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.258033:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3706 00000100:00100000:0.0:1786002511.258104:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560920576:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786002511.258118:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2bc00/0x7cee4af5784140f0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784140f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.258128:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2bc00/0x7cee4af5784140f0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784140f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002511.258144:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00000100:00100000:0.0:1786002511.258185:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560920704:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786002511.258214:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002511.260897:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53300 going to sleep for 11 seconds 00000100:00100000:3.0:1786002511.264157:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560920704 00000100:00100000:3.0:1786002511.264217:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560920704 00000100:00100000:2.0:1786002511.264522:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3707 00000100:00100000:2.0:1786002511.264532:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6520:x1872758560920704:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786002511.264635:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6520:x1872758560920704:12345-0@lo:1000:mdt00_000.0 Request processed in 104us (6419us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.264642:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3707 00000100:00100000:2.0:1786002511.264684:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560920704:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786002511.264744:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560920832:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786002511.264777:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.264792:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790240 going to sleep for 11 seconds 00000100:00100000:2.0:1786002511.264803:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560920832 00000100:00100000:2.0:1786002511.264806:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560920832 00000100:00100000:2.0:1786002511.264820:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00100000:2.0:1786002511.264825:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6520:x1872758560920832:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1786002511.264919:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6520:x1872758560920832:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (140us total) trans 0 rc 1/1 00000100:00100000:2.0:1786002511.264928:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00000100:00100000:2.0:1786002511.264952:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560920832:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1786002511.264998:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 3/0,1 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265008:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 3/0,1 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265017:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 3/0,1 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.265027:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560920960:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1786002511.265105:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.265121:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002511.265130:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560920960 00000100:00100000:2.0:1786002511.265134:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560920960 00000100:00100000:2.0:1786002511.265149:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:2.0:1786002511.265154:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+25:6520:x1872758560920960:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786002511.265162:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002511.265230:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414105 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784140fe expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265252:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414105 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784140fe expref: 26 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265264:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414105 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784140fe expref: 26 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265276:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x27:0x0].0x0 (ffff9ed24559f900) 00010000:00010000:2.0:1786002511.265279:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002511.265283:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b600, rc 0) 00000100:00100000:2.0:1786002511.265308:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+26:6520:x1872758560920960:12345-0@lo:101:mdt00_000.0 Request processed in 154us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.265314:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00100000:2.0:1786002511.265336:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560920960:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786002511.265349:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414105 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265614:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414105 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265637:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af57841410c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265646:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af57841410c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265654:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af57841410c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265668:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265679:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413c35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7f7 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265691:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 4/0,1 mode: --/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265712:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413c35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7f7 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.265723:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413c35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7f7 expref: 48 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.265734:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758560921088:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002511.265794:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002511.274909:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758560921088:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002511.274937:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002511.279571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002511.279823:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530864896 00000100:00100000:3.0:1786002511.279843:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530864896 00010000:00010000:3.0:1786002511.279903:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413c35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7f7 expref: 49 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.279942:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1650 00000100:00100000:3.0:1786002511.279951:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:2412:x1872758530864896:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002511.279964:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002511.279970:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413c35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7f7 expref: 49 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.279983:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413c35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7f7 expref: 49 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.280004:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578413c35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7f7 expref: 49 pid: 6520 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.280017:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x17:0x0].0x0 (ffff9ed24556ea00) 00010000:00010000:3.0:1786002511.280022:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.280030:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.280041:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.280075:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002511.280119:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:2412:x1872758530864896:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 169us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002511.280126:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1650 00010000:00010000:2.0:1786002511.280226:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.280235:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.280274:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.280281:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.280290:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.280307:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560921216:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1786002511.280343:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.280375:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002511.280536:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560921216 00000100:00100000:3.0:1786002511.280540:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560921216 00000100:00100000:3.0:1786002511.280571:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000100:00100000:3.0:1786002511.280578:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+26:6520:x1872758560921216:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786002511.280591:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002511.280603:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414121 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841411a expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.280622:0:15596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413c43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7fe expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.280630:0:15596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414121 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841411a expref: 27 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.280652:0:15596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7fe expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.280663:0:15596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7fe expref: 24 pid: 6522 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.280679:0:15596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560921344:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002511.280714:0:15596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002511.290771:0:15596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560921344:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002511.290804:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414121 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841411a expref: 27 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.290818:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:3.0:1786002511.290821:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002511.290825:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414121 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841411a expref: 27 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.290874:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414121 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841411a expref: 27 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.290883:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ca00, rc 0) 00000100:00100000:3.0:1786002511.290939:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+27:6520:x1872758560921216:12345-0@lo:101:mdt00_000.0 Request processed in 10360us (10594us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002511.290947:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00000100:00100000:2.0:1786002511.291035:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560921216:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1786002511.291061:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.291071:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002511.298003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002511.298131:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530865024 00000100:00100000:2.0:1786002511.298140:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530865024 00010000:00010000:2.0:1786002511.298187:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7fe expref: 25 pid: 6522 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.298223:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1651 00000100:00100000:2.0:1786002511.298232:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed346568850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:2412:x1872758530865024:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002511.298246:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002511.298252:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7fe expref: 25 pid: 6522 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.298264:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7fe expref: 25 pid: 6522 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.298285:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578413c43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a7fe expref: 25 pid: 6522 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.298305:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002511.298311:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414121 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841411a expref: 26 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.298322:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414121 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af57841411a expref: 26 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.298330:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414121 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af57841411a expref: 26 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.298370:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414121 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841411a expref: 26 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.298385:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560921472:0@lo:105: 00000100:00100000:2.0:1786002511.298426:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.298465:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faaf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002511.298522:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560921472 00000100:00100000:1.0:1786002511.298527:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560921472 00000100:00100000:1.0:1786002511.298562:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1786002511.298569:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560921472:12345-0@lo:105: 00010000:00010000:1.0:1786002511.298580:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 5/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.298589:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 5/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.298597:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 5/0,1 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.298603:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.298610:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.298619:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.298643:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed243d2be00) 00000100:00100000:1.0:1786002511.298681:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560921472:12345-0@lo:105: Request processed in 112us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002511.298688:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1786002511.298718:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560921472:0@lo:105: 00010000:00010000:1.0:1786002511.298735:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002511.298766:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed346568850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:2412:x1872758530865024:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 535us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002511.298772:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1651 00010000:00010000:0.0:1786002511.300197:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.300210:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002511.300807:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560921600:0@lo:403:mdt00_000.0 00000100:00100000:0.0:1786002511.300891:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002511.301032:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002511.303940:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560921600 00000100:00100000:1.0:1786002511.303952:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560921600 00000100:00100000:1.0:1786002511.304007:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:1.0:1786002511.304016:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+27:6520:x1872758560921600:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1786002511.308192:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+27:6520:x1872758560921600:12345-0@lo:403:mdt00_000.0 Request processed in 4169us (7293us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002511.308205:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00000100:00100000:0.0:1786002511.313023:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560921600:0@lo:403:mdt00_000.0 00000040:00080000:0.0:1786002511.314029:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].412, 952 off616280 00000040:00080000:0.0:1786002511.315287:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].412, 1032 off665368 00000004:00080000:0.0:1786002511.315295:0:6520:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245e53f00 with version 775 00000004:00080000:2.0:1786002511.318480:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 775 rpc_version 775 00000020:00100000:2.0:1786002511.318526:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002511.318536:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243ddf480 x1872758560921856/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2352/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002511.318558:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddf480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560921856:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002511.318621:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.318692:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36faafd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.324342:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560921856 00000100:00100000:0.0:1786002511.325114:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560921856 00000100:00100000:2.0:1786002511.325243:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712 00000100:00100000:2.0:1786002511.325252:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+27:7466:x1872758560921856:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002511.325743:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+28:7466:x1872758560921856:12345-0@lo:1000:osp_up0-1.0 Request processed in 491us (7119us total) trans 4294983520 rc 0/0 00000100:00100000:2.0:1786002511.325750:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712 00000100:00100000:1.0:1786002511.325918:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddf480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560921856:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1786002511.325995:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x27:0x0]: returning size 4096 00010000:00010000:0.0:1786002511.326015:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326025:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326032:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326038:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002511.326042:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326058:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326073:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x17:0x0].0x0 (ffff9ed24556ea00) 00010000:00010000:0.0:1786002511.326076:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002511.326080:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326086:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414113 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326104:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326112:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326124:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326139:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786002511.326147:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x17:0x0] 00010000:00010000:0.0:1786002511.326154:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af57841410c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326159:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af57841410c lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326164:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af57841410c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326179:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002511.326183:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af57841410c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326189:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af57841410c lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326196:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x27:0x0].0x0 (ffff9ed24559ff00) 00010000:00010000:0.0:1786002511.326198:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002511.326201:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af57841410c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326206:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af57841410c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326218:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414105 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326225:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414105 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326232:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414105 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326243:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1786002511.326251:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1786002511.326255:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784140e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326261:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784140e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326268:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784140e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326276:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:0.0:1786002511.326279:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x5:0x0] 00010000:00010000:0.0:1786002511.326283:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2bc00/0x7cee4af5784140f0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784140f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.326289:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2bc00/0x7cee4af5784140f0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784140f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002511.326347:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530864768:12345-192.168.203.49@tcp:36:rm.0 Request processed in 70995us (72459us total) trans 4294968514 rc 0/0 00000100:00100000:0.0:1786002511.326518:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23801 00010000:00010000:1.0:1786002511.327341:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786002511.327348:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327364:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2be00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002511.327369:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002511.327378:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327409:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327416:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002511.327438:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 1/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327446:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2be00/0x7cee4af57841411a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414121 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327461:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002511.327464:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414105 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327469:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002511.327472:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414105 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002511.327478:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414105 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327491:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 2/0,0 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414105 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327496:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002511.327501:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 1/0,0 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414105 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327507:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af5784140fe lrc: 0/0,0 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414105 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327517:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002511.327520:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784140e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327531:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002511.327534:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784140e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002511.327540:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784140e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327551:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784140e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327556:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002511.327568:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784140e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327575:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e200/0x7cee4af5784140e2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784140e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.327584:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002511.327585:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002511.327587:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002511.327599:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560922240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002511.327636:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786002511.327676:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002511.327772:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560921984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002511.327799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002511.327813:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786002511.327818:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560922112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002511.327863:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786002511.327924:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002511.328900:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560922240 00000100:00100000:2.0:1786002511.328907:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560922240 00000100:00100000:2.0:1786002511.328944:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560921984 00000100:00100000:2.0:1786002511.328947:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560921984 00000100:00100000:2.0:1786002511.328957:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560922112 00000100:00100000:2.0:1786002511.328960:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560922112 00000100:00100000:2.0:1786002511.328972:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1786002511.328979:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+30:3646:x1872758560922240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002511.328989:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002511.329006:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af5784140e9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784140e2 expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.329020:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed24559fd00) 00010000:00010000:2.0:1786002511.329027:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002511.329116:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+29:3646:x1872758560922240:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.329123:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1786002511.329136:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1786002511.329142:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+28:3644:x1872758560921984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002511.329148:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002511.329158:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414121 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841411a expref: 28 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.329253:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002511.329262:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002511.329286:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+27:3644:x1872758560921984:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.329292:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1786002511.329304:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1786002511.329309:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+26:3644:x1872758560922112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002511.329315:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002511.329325:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414105 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784140fe expref: 26 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.329334:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x27:0x0].0x0 (ffff9ed24559f900) 00010000:00010000:2.0:1786002511.329340:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002511.329414:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+25:3644:x1872758560922112:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.329420:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1786002511.329513:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560922240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002511.329680:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560922112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002511.329688:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560921984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002511.345754:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002511.346131:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530865152 00000100:00100000:2.0:1786002511.346140:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530865152 00000100:00100000:2.0:1786002511.346208:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23802 00000100:00100000:2.0:1786002511.346218:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530865152:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:2.0:1786002511.346239:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002511.346257:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af578414128 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8e5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346368:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841412f lrc: 3/1,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346381:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841412f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346397:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841412f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346407:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841412f lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346413:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841412f lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346421:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841412f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346427:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002511.346432:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841412f lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346440:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841412f lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346450:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:2.0:1786002511.346452:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002511.346457:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841412f lrc: 2/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346463:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841412f lrc: 0/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346716:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af578414128 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8e5 expref: 49 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346727:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:2.0:1786002511.346730:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002511.346734:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af578414128 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8e5 expref: 49 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.346743:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b600, rc 0) 00000100:00100000:2.0:1786002511.346836:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530865152:12345-192.168.203.49@tcp:101:rm.0 Request processed in 611us (1082us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002511.346844:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23802 00000100:00100000:0.0:1786002511.361495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002511.361751:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530865280 00000100:00100000:3.0:1786002511.361760:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530865280 00000100:00100000:3.0:1786002511.361816:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23803 00000100:00100000:3.0:1786002511.361824:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530865280:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:3.0:1786002511.361866:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002511.361886:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414136 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.361992:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841413d lrc: 3/1,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.362006:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841413d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.362017:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841413d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.362026:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841413d lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.362033:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841413d lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.362040:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841413d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.362060:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002511.362064:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841413d lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.362071:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841413d lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.362082:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:3.0:1786002511.362085:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002511.362090:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841413d lrc: 2/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.362096:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841413d lrc: 0/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.362123:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414136 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8ec expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.362133:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:3.0:1786002511.362136:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002511.362139:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414136 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8ec expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.362148:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ca00, rc 0) 00000100:00100000:3.0:1786002511.362211:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530865280:12345-192.168.203.49@tcp:101:rm.0 Request processed in 387us (723us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002511.362219:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23803 00000100:00100000:1.0:1786002511.367825:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002511.367976:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530865536 00000100:00100000:0.0:1786002511.367985:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530865536 00000100:00100000:0.0:1786002511.368039:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23804 00000100:00100000:0.0:1786002511.368055:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17798:x1872758530865536:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:0.0:1786002511.368076:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002511.368093:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414144 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x148b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8f3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002511.368234:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x148b:0x0]: returning size 4096 00010000:00010000:0.0:1786002511.368316:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414144 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8f3 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.368329:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x148b:0x0].0x0 (ffff9ed245fed500) 00010000:00010000:0.0:1786002511.368332:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002511.368337:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414144 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8f3 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.368360:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34e00, rc 0) 00000100:00100000:0.0:1786002511.368421:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17798:x1872758530865536:12345-192.168.203.49@tcp:101:rm.0 Request processed in 374us (603us total) trans 4294983521 rc 301/301 00000100:00100000:0.0:1786002511.368428:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23804 00000100:00100000:2.0:1786002511.373449:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002511.373591:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530865664 00000100:00100000:3.0:1786002511.373600:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530865664 00000100:00100000:3.0:1786002511.373647:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23805 00000100:00100000:3.0:1786002511.373657:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530865664:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:3.0:1786002511.373675:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002511.373693:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414152 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a8fa expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373791:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414159 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373804:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414159 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373814:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414159 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373824:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414159 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373842:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414159 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373881:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414159 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373887:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002511.373891:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414159 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373898:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414159 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373909:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:3.0:1786002511.373912:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002511.373917:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414159 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373922:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414159 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373948:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414152 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8fa expref: 49 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373956:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:3.0:1786002511.373959:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002511.373962:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af578414152 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a8fa expref: 49 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.373970:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d000, rc 0) 00000100:00100000:3.0:1786002511.374014:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530865664:12345-192.168.203.49@tcp:101:rm.0 Request processed in 359us (573us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002511.374021:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23805 00000100:00100000:2.0:1786002511.383340:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002511.383708:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530865792 00000100:00100000:0.0:1786002511.383718:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530865792 00000100:00100000:0.0:1786002511.383775:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23806 00000100:00100000:0.0:1786002511.383785:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530865792:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:0.0:1786002511.383803:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002511.383820:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414160 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a901 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.383966:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414167 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.383979:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414167 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.383989:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414167 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.383999:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414167 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.384005:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414167 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.384012:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414167 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.384018:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002511.384022:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414167 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.384028:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414167 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.384037:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:0.0:1786002511.384040:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002511.384262:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414167 lrc: 2/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.384269:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414167 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.384301:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414160 lrc: 1/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a901 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.384311:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:0.0:1786002511.384313:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002511.384317:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414160 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a901 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.384325:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34e00, rc 0) 00000100:00100000:0.0:1786002511.384391:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530865792:12345-192.168.203.49@tcp:101:rm.0 Request processed in 607us (1059us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002511.384398:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23806 00000100:00100000:1.0:1786002511.398428:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002511.398601:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530865920 00000100:00100000:3.0:1786002511.398610:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530865920 00000100:00100000:3.0:1786002511.398669:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5067 00000100:00100000:3.0:1786002511.398678:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530865920:12345-192.168.203.49@tcp:37:rm.0 00000100:00100000:3.0:1786002511.398806:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:17798:x1872758530865920:12345-192.168.203.49@tcp:37:rm.0 Request processed in 128us (387us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002511.398813:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5067 00000100:00100000:2.0:1786002511.405572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002511.405641:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530866176 00000100:00100000:1.0:1786002511.405650:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530866176 00000100:00100000:1.0:1786002511.405704:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5068 00000100:00100000:1.0:1786002511.405713:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17798:x1872758530866176:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:1.0:1786002511.406109:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17798:x1872758530866176:12345-192.168.203.49@tcp:35:rm.0 Request processed in 396us (544us total) trans 4294983522 rc 0/0 00000100:00100000:1.0:1786002511.406117:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5068 00000100:00100000:2.0:1786002511.414112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002511.414213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002511.415920:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530866304 00000100:00100000:3.0:1786002511.415930:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530866304 00000100:00100000:3.0:1786002511.415998:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1438 00000100:00100000:3.0:1786002511.416007:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:2412:x1872758530866304:12345-192.168.203.49@tcp:103:rm.0 00010000:00010000:3.0:1786002511.416021:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002511.416053:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f800/0x7cee4af5784139bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6df expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.416070:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x148b:0x0].0x0 (ffff9ed35363d400) 00010000:00010000:3.0:1786002511.416080:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002511.416134:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:2412:x1872758530866304:12345-192.168.203.49@tcp:103:rm.0 Request processed in 128us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002511.416141:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1438 00000100:00100000:1.0:1786002511.418523:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530866560 00000100:00100000:1.0:1786002511.418535:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530866560 00000100:00100000:1.0:1786002511.418626:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23807 00000100:00100000:1.0:1786002511.418636:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17798:x1872758530866560:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:1.0:1786002511.418692:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002511.418715:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784139f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x148b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6fb expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.418733:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x148b:0x0].0x0 (ffff9ed245fed500) 00010000:00010000:1.0:1786002511.418744:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002511.418789:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.418798:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.418807:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002511.418838:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560922368:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1786002511.418910:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002511.418966:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2419a29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.419646:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560922368 00000100:00100000:0.0:1786002511.419653:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560922368 00000100:00100000:0.0:1786002511.419697:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00100000:0.0:1786002511.419705:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:10360:x1872758560922368:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786002511.419720:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002511.419737:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414175 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841416e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.419759:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414175 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841416e expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.419770:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414175 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841416e expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.419777:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed36e785900) 00010000:00010000:0.0:1786002511.419780:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002511.419783:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34200, rc 0) 00000100:00100000:0.0:1786002511.419838:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:10360:x1872758560922368:12345-0@lo:101:mdt00_003.0 Request processed in 122us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002511.419865:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00000100:00100000:2.0:1786002511.422185:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560922368:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002511.422209:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414175 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.422222:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414175 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002511.422243:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:2.0:1786002511.422280:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841417c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.422286:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841417c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.422295:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841417c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.422316:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560922496:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786002511.422597:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.422644:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790540 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.423130:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560922496 00000100:00100000:0.0:1786002511.423137:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560922496 00000100:00100000:0.0:1786002511.423197:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:0.0:1786002511.423205:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:10360:x1872758560922496:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786002511.423220:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002511.423235:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578414183 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841417c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.423256:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578414183 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841417c expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.423268:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578414183 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841417c expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.423275:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x95dc2b73 (ffff9ed36e785c00) 00010000:00010000:0.0:1786002511.423278:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002511.423281:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34c00, rc 0) 00000100:00100000:0.0:1786002511.423325:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:10360:x1872758560922496:12345-0@lo:101:mdt00_003.0 Request processed in 121us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002511.423332:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00000100:00100000:2.0:1786002511.423524:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560922496:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002511.423537:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841417c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414183 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.423546:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841417c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414183 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002511.423562:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:2.0:1786002511.423596:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560922624:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002511.423622:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.423651:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.423746:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560922624 00000100:00100000:0.0:1786002511.423750:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560922624 00000100:00100000:0.0:1786002511.423779:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:0.0:1786002511.423785:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:10360:x1872758560922624:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786002511.423878:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:10360:x1872758560922624:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002511.423885:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000100:00100000:2.0:1786002511.423973:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560922624:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002511.424009:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560922752:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002511.424029:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.424060:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790540 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.424925:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560922752 00000100:00100000:0.0:1786002511.424932:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560922752 00000100:00100000:0.0:1786002511.424964:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:0.0:1786002511.424971:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:10360:x1872758560922752:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786002511.425177:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:10360:x1872758560922752:12345-0@lo:1000:mdt00_003.0 Request processed in 196us (1136us total) trans 0 rc 1/1 00000100:00100000:0.0:1786002511.425184:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:2.0:1786002511.429008:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560922752:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1786002511.429143:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.429153:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.429163:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.429411:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560922880:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786002511.429460:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.429539:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.433027:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560922880 00000100:00100000:0.0:1786002511.433038:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560922880 00000100:00100000:0.0:1786002511.433184:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717 00000100:00100000:0.0:1786002511.433195:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:10360:x1872758560922880:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786002511.433214:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002511.433235:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578414191 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841418a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.433262:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578414191 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841418a expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.433275:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578414191 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841418a expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.433283:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x148b:0x0].0x0 (ffff9ed36e785300) 00010000:00010000:0.0:1786002511.433286:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002511.433289:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35000, rc 0) 00000100:00100000:2.0:1786002511.436173:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560922880:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002511.436198:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414191 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.436213:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414191 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.436253:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414198 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.436262:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414198 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.436270:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414198 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.436288:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 3/0,1 mode: --/EX res: [0x200000400:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.436299:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af5784139db lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ed expref: 25 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.436307:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 4/0,1 mode: --/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.436335:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af5784139db lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ed expref: 25 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.436352:0:10360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af5784139db lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ed expref: 25 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.436365:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560923008:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002511.436449:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.436782:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:10360:x1872758560922880:12345-0@lo:101:mdt00_003.0 Request processed in 3585us (7316us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002511.436792:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717 00000100:00100000:2.0:1786002511.452032:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002511.452154:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560923008:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002511.452191:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 3/0,1 mode: --/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.456302:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530866688 00000100:00100000:3.0:1786002511.456314:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530866688 00010000:00010000:2.0:1786002511.462296:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af5784139db lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ed expref: 26 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.462347:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1652 00000100:00100000:2.0:1786002511.463124:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:2413:x1872758530866688:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002511.463140:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002511.463148:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af5784139db lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ed expref: 26 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.463162:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af5784139db lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ed expref: 26 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.465292:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af5784139db lrc: 0/0,0 mode: --/PR res: [0x200000400:0x82:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a6ed expref: 26 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.465312:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x82:0x0].0x0 (ffff9ed38214d400) 00010000:00010000:2.0:1786002511.465317:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 3/0,1 mode: --/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.465332:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.465339:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.465383:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002511.465441:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:2413:x1872758530866688:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 2323us (13417us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.465450:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1652 00010000:00010000:1.0:1786002511.465616:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.465625:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.465665:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.465673:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.465683:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002511.465701:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560923136:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1786002511.465744:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002511.465780:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2419a2000 going to sleep for 11 seconds 00000100:00100000:2.0:1786002511.466325:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560923136 00000100:00100000:2.0:1786002511.466332:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560923136 00000100:00100000:2.0:1786002511.466383:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:2.0:1786002511.466392:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:10360:x1872758560923136:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002511.466406:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002511.466418:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af5784141ad lrc: 2/0,0 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784141a6 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.466437:0:15596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a28 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a717 expref: 46 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.466446:0:15596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af5784141ad lrc: 4/0,0 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784141a6 expref: 17 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.466466:0:15596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a28 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a717 expref: 46 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.466478:0:15596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a28 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a717 expref: 46 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.466488:0:15596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245510a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:15596:1872758560923264:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002511.466539:0:15596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786002511.469380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002511.469442:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530866816 00000100:00100000:3.0:1786002511.469450:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530866816 00010000:00010000:3.0:1786002511.469479:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a28 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a717 expref: 47 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.469515:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1653 00000100:00100000:3.0:1786002511.469524:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:2413:x1872758530866816:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002511.469535:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002511.469542:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a28 lrc: 5/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a717 expref: 47 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.469555:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a28 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a717 expref: 47 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.469575:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:3.0:1786002511.469582:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af5784141ad lrc: 3/0,0 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784141a6 expref: 17 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.469593:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af5784141ad lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7cee4af5784141a6 expref: 17 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.469602:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af5784141ad lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7cee4af5784141a6 expref: 17 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.469628:0:10399:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af5784141ad lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784141a6 expref: 17 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.469645:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:10399:1872758560923392:0@lo:105: 00000100:00100000:3.0:1786002511.469682:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002511.469719:0:10399:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab780 going to sleep for 11 seconds 00010000:00010000:1.0:1786002511.469796:0:15596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c47a00/0x7cee4af578413a28 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x82:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a717 expref: 47 pid: 10360 timeout: 971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002511.469811:0:15596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245510a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:15596:1872758560923264:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002511.469841:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af5784141ad lrc: 4/0,0 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784141a6 expref: 17 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.469881:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:1.0:1786002511.469884:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002511.469887:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2ba00, rc 0) 00000100:00100000:1.0:1786002511.469922:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:10360:x1872758560923136:12345-0@lo:101:mdt00_003.0 Request processed in 3532us (4178us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002511.469929:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00000100:00100000:3.0:1786002511.469996:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560923136:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002511.470009:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.470019:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002511.470163:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560923392 00000100:00100000:2.0:1786002511.470167:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560923392 00000100:00100000:2.0:1786002511.470198:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1786002511.470204:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10399:x1872758560923392:12345-0@lo:105: 00010000:00010000:2.0:1786002511.470212:0:17237:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.470221:0:17237:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.470229:0:17237:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.470236:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.470243:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.470250:0:17237:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.470268:0:17237:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245e7f400) 00000100:00100000:2.0:1786002511.470297:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10399:x1872758560923392:12345-0@lo:105: Request processed in 94us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.470303:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00010000:00010000:3.0:1786002511.470349:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.470357:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002511.470686:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].398, 888 off597656 00000040:00080000:3.0:1786002511.470875:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].397, 968 off647032 00000004:00080000:3.0:1786002511.470881:0:10360:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed36e7ab0c0 with version 756 00000100:00100000:0.0:1786002511.470978:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:10399:1872758560923392:0@lo:105: 00010000:00010000:0.0:1786002511.470990:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002511.471031:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:2413:x1872758530866816:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 1507us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002511.471039:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1653 00000004:00080000:2.0:1786002511.471224:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 756 rpc_version 756 00000020:00100000:2.0:1786002511.471246:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002511.471253:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed245510000 x1872758560923648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1952/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002511.471268:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245510000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560923648:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002511.471298:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.471320:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002511.471358:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560923648 00000100:00100000:1.0:1786002511.471362:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560923648 00000100:00100000:1.0:1786002511.471397:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:1.0:1786002511.471404:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:7805:x1872758560923648:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002511.471614:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+18:7805:x1872758560923648:12345-0@lo:1000:osp_up1-0.0 Request processed in 209us (314us total) trans 4294968515 rc 0/0 00000100:00100000:1.0:1786002511.471621:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000100:00100000:2.0:1786002511.471986:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245510000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560923648:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1786002511.473413:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x148b:0x0]: returning size 4096 00010000:00010000:3.0:1786002511.473435:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473444:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473451:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473458:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002511.473462:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473469:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473482:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x82:0x0].0x0 (ffff9ed38214d400) 00010000:00010000:3.0:1786002511.473485:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002511.473488:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 2/0,0 mode: --/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473494:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841419f lrc: 0/0,0 mode: --/EX res: [0x200000400:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473512:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473520:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473527:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473551:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002511.473560:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x82:0x0] 00010000:00010000:3.0:1786002511.473567:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414198 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473574:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414198 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473580:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414198 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473585:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002511.473588:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414198 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473594:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414198 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473601:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x148b:0x0].0x0 (ffff9ed24559f300) 00010000:00010000:3.0:1786002511.473603:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002511.473606:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414198 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473611:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414198 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473623:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414191 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473630:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414191 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473636:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414191 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473658:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1786002511.473667:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1786002511.473671:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414175 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473678:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414175 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473684:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414175 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473694:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:3.0:1786002511.473697:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1786002511.473702:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841417c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414183 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.473709:0:10360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841417c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414183 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.473762:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17798:x1872758530866560:12345-192.168.203.49@tcp:36:rm.0 Request processed in 55127us (59715us total) trans 4294983523 rc 0/0 00000100:00100000:3.0:1786002511.473770:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23807 00010000:00010000:1.0:1786002511.473823:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786002511.473838:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.473867:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002511.473872:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002511.473880:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.473907:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.473914:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002511.473937:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.473949:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7f400/0x7cee4af5784141a6 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784141ad expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.473962:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002511.473966:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414191 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.473971:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b600 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002511.473974:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414191 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002511.473981:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414191 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.473995:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414191 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.474000:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002511.474012:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 1/0,0 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414191 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.474019:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841418a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414191 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.474029:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002511.474032:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414175 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.474041:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002511.474101:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414175 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002511.474108:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414175 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.474123:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414175 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.474129:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002511.474134:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 1/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414175 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.474140:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7e000/0x7cee4af57841416e lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414175 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.474151:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002511.474152:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002511.474154:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002511.474161:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786002511.474179:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560923776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002511.474216:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002511.474246:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560924032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002511.474265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002511.474278:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786002511.474282:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560923904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002511.474297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786002511.474689:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002511.474703:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560923776 00000100:00100000:2.0:1786002511.474709:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560923776 00000100:00100000:2.0:1786002511.474745:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560924032 00000100:00100000:2.0:1786002511.474748:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560924032 00000100:00100000:2.0:1786002511.474759:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560923904 00000100:00100000:2.0:1786002511.474761:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560923904 00000100:00100000:2.0:1786002511.474773:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1786002511.474780:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34656ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+20:3646:x1872758560923776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002511.474790:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002511.474806:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af5784141ad lrc: 0/0,0 mode: --/EX res: [0x240000401:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784141a6 expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.474817:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x82:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:2.0:1786002511.474823:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002511.474885:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34656ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+19:3646:x1872758560923776:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.474895:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1786002511.474928:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:2.0:1786002511.474934:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+18:3645:x1872758560924032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002511.474940:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002511.474949:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414175 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841416e expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.474958:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed36e785900) 00010000:00010000:2.0:1786002511.474963:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002511.474983:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+17:3645:x1872758560924032:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.474989:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:2.0:1786002511.474999:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1786002511.475004:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+16:3645:x1872758560923904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002511.475010:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002511.475018:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578414191 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x148b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841418a expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.475027:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x148b:0x0].0x0 (ffff9ed36e785300) 00010000:00010000:2.0:1786002511.475031:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002511.475213:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002511.478251:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560923776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002511.480158:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+15:3645:x1872758560923904:12345-0@lo:103:ldlm_bl.0 Request processed in 5147us (5852us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002511.480169:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1786002511.480571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002511.480918:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530867072 00000100:00100000:1.0:1786002511.480925:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530867072 00000100:00100000:1.0:1786002511.480967:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5069 00000100:00100000:1.0:1786002511.480975:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:17798:x1872758530867072:12345-192.168.203.49@tcp:35:rm.0 00000040:00080000:1.0:1786002511.481310:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].399, 344 off598000 00000040:00080000:1.0:1786002511.481356:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].398, 424 off647456 00000004:00080000:1.0:1786002511.481362:0:6524:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed2419a2780 with version 757 00000004:00080000:2.0:1786002511.481422:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 757 rpc_version 757 00000020:00100000:2.0:1786002511.481447:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002511.481455:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed245511500 x1872758560924288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1304/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002511.481475:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245511500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560924288:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002511.481516:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002511.481541:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e53b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002511.481581:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560924288 00000100:00100000:3.0:1786002511.481585:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560924288 00000100:00100000:3.0:1786002511.481618:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:3.0:1786002511.481624:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:7805:x1872758560924288:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002511.481881:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:7805:x1872758560924288:12345-0@lo:1000:osp_up1-0.0 Request processed in 256us (362us total) trans 4294968516 rc 0/0 00000100:00100000:3.0:1786002511.481889:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00000100:00100000:2.0:1786002511.481985:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560924288:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002511.482099:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17798:x1872758530867072:12345-192.168.203.49@tcp:35:rm.0 Request processed in 1124us (1529us total) trans 4294983524 rc 0/0 00000100:00100000:3.0:1786002511.482106:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5069 00000100:00100000:0.0:1786002511.484477:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560923904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002511.484491:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560924032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002511.486462:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002511.486551:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530867328 00000100:00100000:0.0:1786002511.486558:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530867328 00000100:00100000:0.0:1786002511.486636:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23808 00000100:00100000:0.0:1786002511.486646:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:17798:x1872758530867328:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002511.486693:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1786002511.486717:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a800/0x7cee4af5783feb0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x138e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3659a expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486735:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5783fe796 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x138e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b364cf expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486747:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5783fe757 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x138e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b364b3 expref: 24 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486756:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x138e:0x0].0x0 (ffff9ed24556e500) 00010000:00010000:0.0:1786002511.486771:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a400/0x7cee4af5783fe73b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b364ac expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486778:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002511.486782:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002511.486799:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af5784141b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486810:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af5784141b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486818:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af5784141b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486842:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784141bb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486877:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784141bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486884:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784141bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486948:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784141c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x138e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486956:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784141c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x138e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486962:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784141c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x138e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486978:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784141c9 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486985:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784141c9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.486991:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784141c9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.487017:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.487023:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002511.487032:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002511.487064:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1872758560924416:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1786002511.487102:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002511.487125:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed37b772c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002511.490354:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560924416 00000100:00100000:1.0:1786002511.490365:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560924416 00000100:00100000:1.0:1786002511.490417:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:1.0:1786002511.490426:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:6521:x1872758560924416:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1786002511.490446:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002511.490464:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af5784141d7 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784141d0 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.490488:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af5784141d7 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784141d0 expref: 17 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.490499:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af5784141d7 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784141d0 expref: 17 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002511.490507:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed351207000) 00010000:00010000:1.0:1786002511.490510:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002511.490513:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f200, rc 0) 00000100:00100000:1.0:1786002511.490566:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:6521:x1872758560924416:12345-0@lo:101:mdt00_001.0 Request processed in 142us (3463us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002511.490573:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00000100:00100000:3.0:1786002511.490672:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1872758560924416:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1786002511.490688:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784141d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.490698:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784141d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002511.491312:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1872758560924544:0@lo:403:mdt00_001.0 00000100:00100000:3.0:1786002511.491354:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002511.491377:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e5f4900 going to sleep for 11 seconds 00000100:00100000:0.0:1786002511.491516:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560924544 00000100:00100000:0.0:1786002511.491521:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560924544 00000100:00100000:0.0:1786002511.491551:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:0.0:1786002511.491557:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6521:x1872758560924544:12345-0@lo:403:mdt00_001.0 00000100:00100000:0.0:1786002511.493024:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6521:x1872758560924544:12345-0@lo:403:mdt00_001.0 Request processed in 1464us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002511.493033:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00000100:00100000:3.0:1786002511.493223:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1872758560924544:0@lo:403:mdt00_001.0 00000040:00080000:3.0:1786002511.494248:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].400, 936 off598936 00000040:00080000:3.0:1786002511.494406:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].399, 1016 off648472 00000004:00080000:3.0:1786002511.494412:0:6521:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed36e5f4900 with version 758 00000004:00080000:0.0:1786002511.494522:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 758 rpc_version 758 00000020:00100000:0.0:1786002511.494548:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002511.494556:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed366d6c380 x1872758560924800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002511.494574:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560924800:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002511.494609:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002511.494665:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed37b772c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002511.497120:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560924800 00000100:00100000:1.0:1786002511.497129:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560924800 00000100:00100000:1.0:1786002511.497247:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00000100:00100000:1.0:1786002511.497257:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:7805:x1872758560924800:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002511.497480:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+18:7805:x1872758560924800:12345-0@lo:1000:osp_up1-0.0 Request processed in 224us (2869us total) trans 4294968517 rc 0/0 00000100:00100000:1.0:1786002511.497487:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00100000:2.0:1786002511.497571:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560924800:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1786002511.498959:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x138e:0x0]: returning size 4096 00010000:00010000:3.0:1786002511.498981:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784141c9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.498991:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784141c9 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.498998:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784141c9 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499004:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002511.499008:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784141c9 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499016:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784141c9 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499030:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9ed36e785200) 00010000:00010000:3.0:1786002511.499032:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002511.499036:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784141c9 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499051:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784141c9 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499070:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784141d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499078:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784141d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499085:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784141d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499110:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002511.499117:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1786002511.499124:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784141c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x138e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499130:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784141c2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x138e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499136:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784141c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x138e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499145:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002511.499148:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784141c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x138e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499153:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784141c2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x138e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499160:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x138e:0x0].0x0 (ffff9ed36e785e00) 00010000:00010000:3.0:1786002511.499169:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002511.499172:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784141c2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x138e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499178:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784141c2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x138e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499193:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af5784141b4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499199:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af5784141b4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499204:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af5784141b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499209:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af5784141b4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499213:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002511.499215:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af5784141b4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499224:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af5784141b4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499230:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002511.499232:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002511.499235:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af5784141b4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499240:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af5784141b4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002511.499248:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000190451f1 reply state 00000000a16f1f96 transno 4294983525 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784141bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499258:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784141bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.499265:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xca5a1f93 (ffff9ed36e785b00) 00010000:00010000:3.0:1786002511.499267:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002511.499270:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002511.499324:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:17798:x1872758530867328:12345-192.168.203.49@tcp:36:rm.0 Request processed in 12678us (12864us total) trans 4294983525 rc 0/0 00000100:00100000:3.0:1786002511.499332:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23808 00010000:00010000:2.0:1786002511.499458:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002511.499464:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784141d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.499471:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002511.499476:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784141d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002511.499484:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784141d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.499511:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784141d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.499517:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002511.499543:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784141d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.499551:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af5784141d0 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784141d7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002511.499568:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002511.499570:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002511.499572:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002511.499579:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002511.499591:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560924928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002511.499627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002511.501989:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560924928 00000100:00100000:3.0:1786002511.501999:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560924928 00000100:00100000:3.0:1786002511.502153:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:3.0:1786002511.502162:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+18:3647:x1872758560924928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002511.502184:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002511.502203:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f200/0x7cee4af5784141d7 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784141d0 expref: 18 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002511.502219:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9ed351207000) 00010000:00010000:3.0:1786002511.502227:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002511.502283:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+17:3647:x1872758560924928:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (2655us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002511.502289:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:2.0:1786002511.502413:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560924928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002511.786708:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002512.747043:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560925056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786002512.747103:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002512.747166:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560925056 00000100:00100000:2.0:1786002512.747172:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560925056 00000100:00100000:2.0:1786002512.747268:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1786002512.747277:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560925056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786002512.747301:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002512.747341:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560925056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002512.747348:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00080000:2.0:1786002512.747366:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002512.747397:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560925056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002512.754166:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560925184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002512.754245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002512.754303:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560925184 00000100:00100000:1.0:1786002512.754310:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560925184 00000100:00100000:1.0:1786002512.754359:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1786002512.754368:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560925184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786002512.754390:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002512.754429:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560925184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002512.754435:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00080000:1.0:1786002512.754466:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002512.754496:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560925184:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786002512.819897:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002513.239491:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002513.239591:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002513.239627:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002513.239649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002513.239672:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002513.239836:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530867712 00000100:00100000:1.0:1786002513.239864:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530867712 00000100:00100000:1.0:1786002513.239921:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530867584 00000100:00100000:1.0:1786002513.239925:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530867584 00000100:00100000:1.0:1786002513.239952:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 848 00000100:00100000:1.0:1786002513.239962:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:2411:x1872758530867712:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002513.240031:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:2411:x1872758530867712:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 70us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002513.240039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 848 00000100:00100000:1.0:1786002513.240056:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 849 00000100:00100000:1.0:1786002513.240062:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:2411:x1872758530867584:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002513.240087:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:2411:x1872758530867584:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002513.240093:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 849 00000100:00080000:1.0:1786002513.240106:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786002513.240109:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002513.240217:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530867968 00000100:00100000:1.0:1786002513.240221:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530867968 00000100:00100000:1.0:1786002513.240245:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 457 00000100:00100000:1.0:1786002513.240251:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758530867968:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002513.240276:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758530867968:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002513.240282:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 457 00000100:00100000:1.0:1786002513.240290:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530867840 00000100:00100000:1.0:1786002513.240303:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530867840 00000100:00100000:1.0:1786002513.240323:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 458 00000100:00100000:1.0:1786002513.240329:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530867840:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002513.240356:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530867840:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002513.240365:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 458 00000100:00080000:1.0:1786002513.240382:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786002513.240384:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002513.268124:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560925312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002513.268189:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002513.268322:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560925312 00000100:00100000:3.0:1786002513.268331:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560925312 00000100:00100000:3.0:1786002513.268386:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:3.0:1786002513.268395:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:3645:x1872758560925312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786002513.268430:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1297850368 00000100:00100000:3.0:1786002513.268484:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+25:3645:x1872758560925312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002513.268492:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00000100:00100000:2.0:1786002513.268574:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560925312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002513.272940:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530867456 00000100:00100000:0.0:1786002513.272954:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530867456 00000100:00100000:1.0:1786002513.273047:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 507 00000100:00100000:1.0:1786002513.273058:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758530867456:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002513.273131:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758530867456:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 76us (33649us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002513.273139:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 507 00010000:00010000:2.0:1786002513.834828:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002514.282191:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560925440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002514.282266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002514.282514:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560925568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002514.282559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002514.282580:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560925952:0@lo:400:kworker.0 00000100:00100000:2.0:1786002514.282608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002514.282629:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786002514.282634:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758560926080:0@lo:400:kworker.0 00000100:00100000:2.0:1786002514.282658:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002514.282751:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758560925824:0@lo:400:kworker.0 00000100:00100000:2.0:1786002514.282777:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002514.282793:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002514.282798:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758560925696:0@lo:400:kworker.0 00000100:00100000:2.0:1786002514.282840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002514.282896:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560925696 00000100:00100000:2.0:1786002514.282903:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560925696 00000100:00100000:2.0:1786002514.282942:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1786002514.282950:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758560925696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002514.282988:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758560925696:12345-0@lo:400:kworker.0 Request processed in 39us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002514.282994:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1786002514.283020:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560926080 00000100:00100000:2.0:1786002514.283023:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560926080 00000100:00100000:2.0:1786002514.283045:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560925824 00000100:00100000:2.0:1786002514.283047:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560925824 00000100:00100000:2.0:1786002514.283063:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1786002514.283068:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758560926080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002514.283101:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758560926080:12345-0@lo:400:kworker.0 Request processed in 32us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002514.283118:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1786002514.283130:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1786002514.283135:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758560925824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002514.283160:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758560925824:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002514.283166:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1786002514.283201:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758560926080:0@lo:400:kworker.0 00000100:00100000:2.0:1786002514.283221:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758560925696:0@lo:400:kworker.0 00000100:00100000:2.0:1786002514.283229:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758560925824:0@lo:400:kworker.0 00000100:00100000:2.0:1786002514.283260:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560925440 00000100:00100000:2.0:1786002514.283263:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560925440 00000100:00100000:2.0:1786002514.283298:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560925568 00000100:00100000:2.0:1786002514.283301:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560925568 00000100:00100000:2.0:1786002514.283313:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1786002514.283319:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560925440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002514.283338:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1786002514.288098:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560925952 00000100:00100000:0.0:1786002514.288116:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560925952 00000100:00100000:0.0:1786002514.288282:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:0.0:1786002514.288293:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:3646:x1872758560925952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002514.288400:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+25:3646:x1872758560925952:12345-0@lo:400:kworker.0 Request processed in 109us (5790us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002514.288407:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00000100:00100000:0.0:1786002514.288464:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560925952:0@lo:400:kworker.0 00000100:00080000:0.0:1786002514.288516:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002514.288546:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1786002514.288554:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560925568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786002514.288573:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1786002514.288609:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560925568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (6049us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002514.288615:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1786002514.288647:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560925568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786002514.294188:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560926208:0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.294272:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002514.294308:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560926720:0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.294329:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002514.294354:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786002514.294358:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758560926336:0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.294380:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002514.294399:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758560926848:0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.294420:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002514.294545:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758560926464:0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.294670:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560926208 00000100:00100000:3.0:1786002514.294679:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560926208 00000100:00100000:3.0:1786002514.294737:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:3.0:1786002514.294746:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:3644:x1872758560926208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.294818:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:3644:x1872758560926208:12345-0@lo:400:kworker.0 Request processed in 63us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002514.294826:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:3.0:1786002514.294882:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560926336 00000100:00100000:3.0:1786002514.294886:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560926336 00000100:00100000:3.0:1786002514.294924:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560926848 00000100:00100000:3.0:1786002514.294927:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560926848 00000100:00100000:3.0:1786002514.294944:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:3.0:1786002514.294950:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758560926336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.294977:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758560926336:12345-0@lo:400:kworker.0 Request processed in 28us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002514.294993:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:3.0:1786002514.295005:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1786002514.295011:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758560926848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.295033:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758560926848:12345-0@lo:400:kworker.0 Request processed in 23us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002514.295038:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1786002514.295074:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758560926336:0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.295083:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758560926848:0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.295092:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560926208:0@lo:400:kworker.0 00000100:00080000:3.0:1786002514.295129:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786002514.295257:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560925440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002514.296981:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560926592:0@lo:400:kworker.0 00000100:00100000:1.0:1786002514.297053:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002514.297105:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560926720 00000100:00100000:1.0:1786002514.297165:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560926720 00000100:00100000:1.0:1786002514.297211:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560926592 00000100:00100000:1.0:1786002514.297214:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560926592 00000100:00100000:1.0:1786002514.297233:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1786002514.297240:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560926720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002514.297401:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560926720:12345-0@lo:400:kworker.0 Request processed in 160us (3069us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002514.297409:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1786002514.297424:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1786002514.297429:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560926592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002514.297475:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560926592:12345-0@lo:400:kworker.0 Request processed in 46us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002514.297481:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00080000:1.0:1786002514.297504:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002514.297530:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560926720:0@lo:400:kworker.0 00000100:00100000:1.0:1786002514.297551:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560926592:0@lo:400:kworker.0 00000100:00100000:2.0:1786002514.297960:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560925440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14638us (15691us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002514.297968:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1786002514.302964:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002514.303759:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758560926976:0@lo:400:kworker.0 00000100:00100000:0.0:1786002514.303807:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002514.306785:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560926464 00000100:00100000:3.0:1786002514.306804:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560926464 00000100:00080000:2.0:1786002514.307068:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786002514.307806:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560926976 00000100:00100000:3.0:1786002514.307821:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560926976 00000100:00100000:3.0:1786002514.307938:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1786002514.307951:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758560926464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.308343:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758560926464:12345-0@lo:400:kworker.0 Request processed in 395us (5387us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002514.308353:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1786002514.308378:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1786002514.308385:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758560926976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.308417:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758560926976:12345-0@lo:400:kworker.0 Request processed in 34us (4610us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002514.308423:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1786002514.308486:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758560926464:0@lo:400:kworker.0 00000100:00100000:3.0:1786002514.308502:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758560926976:0@lo:400:kworker.0 00000100:00080000:0.0:1786002514.312431:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1786002514.797134:0:7451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2bc00/0x7cee4af5784140f0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784140f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002514.797164:0:7451:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2bc00/0x7cee4af5784140f0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784140f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797207:0:7451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2bc00/0x7cee4af5784140f0 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784140f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797214:0:7451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002514.797247:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2bc00/0x7cee4af5784140f0 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784140f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797273:0:7451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7fc00/0x7cee4af578414064 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af57841406b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002514.797281:0:7451:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7fc00/0x7cee4af578414064 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af57841406b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797295:0:7451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7fc00/0x7cee4af578414064 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841406b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797301:0:7451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002514.797315:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7fc00/0x7cee4af578414064 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841406b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797327:0:7451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f600/0x7cee4af578413fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413fa7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002514.797334:0:7451:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f600/0x7cee4af578413fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413fa7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797350:0:7451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f600/0x7cee4af578413fa0 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413fa7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797356:0:7451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002514.797361:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f600/0x7cee4af578413fa0 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413fa7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797373:0:7451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2aa00/0x7cee4af578413eff lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413f06 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002514.797386:0:7451:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2aa00/0x7cee4af578413eff lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413f06 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797397:0:7451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2aa00/0x7cee4af578413eff lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f06 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797403:0:7451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002514.797407:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2aa00/0x7cee4af578413eff lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f06 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797417:0:7451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af578413eab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413eb2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002514.797424:0:7451:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af578413eab lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413eb2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797434:0:7451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af578413eab lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413eb2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797439:0:7451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002514.797442:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af578413eab lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413eb2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797452:0:7451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af578413d93 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413d9a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002514.797459:0:7451:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af578413d93 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413d9a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797475:0:7451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af578413d93 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d9a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797481:0:7451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002514.797485:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af578413d93 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d9a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797498:0:7451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578413d23 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413d2a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002514.797505:0:7451:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578413d23 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413d2a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797519:0:7451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578413d23 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d2a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.797525:0:7451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002514.797529:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578413d23 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413d2a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002514.797540:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968517 is committed 00000001:00080000:0.0:1786002514.797558:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968514 is committed 00000020:00080000:0.0:1786002514.797611:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 405 batchid updated 00000020:00080000:0.0:1786002514.797623:0:7451:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed245e3d480 refcount 2 committed 0 result 0 batchid 406 00000020:00080000:0.0:1786002514.797626:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2449ee100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245e3d240 00000020:00080000:0.0:1786002514.797630:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].403 00000020:00080000:0.0:1786002514.797632:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2449eed00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d01c00 00000020:00080000:0.0:1786002514.797636:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].403 00000100:00100000:0.0:1786002514.797668:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560927360:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1786002514.797738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002514.797781:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560927872:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1786002514.797801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002514.797834:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786002514.797841:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560927232:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1786002514.797881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002514.797905:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560927744:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1786002514.797926:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002514.797949:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560927360 00000100:00100000:0.0:1786002514.797956:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560927360 00000100:00100000:0.0:1786002514.797987:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560927872 00000100:00100000:0.0:1786002514.797990:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560927872 00000100:00100000:0.0:1786002514.797998:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560927232 00000100:00100000:0.0:1786002514.798000:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560927232 00000100:00100000:0.0:1786002514.798009:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560927744 00000100:00100000:0.0:1786002514.798011:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560927744 00000100:00100000:0.0:1786002514.798023:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1786002514.798031:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+28:3645:x1872758560927360:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1786002514.798041:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002514.798057:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578413fa7 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x3115f8b0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413fa0 expref: 28 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.798069:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x3115f8b0 (ffff9ed36e785700) 00010000:00010000:0.0:1786002514.798077:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002514.798105:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+27:3645:x1872758560927360:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 75us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002514.798112:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1786002514.798127:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:0.0:1786002514.798132:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+26:3645:x1872758560927872:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1786002514.798138:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002514.798148:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578413d2a lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb5c6597d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413d23 expref: 26 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.798157:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xb5c6597d (ffff9ed245fed400) 00010000:00010000:0.0:1786002514.798165:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002514.798182:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+25:3645:x1872758560927872:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 50us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002514.798187:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:0.0:1786002514.798197:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1786002514.798201:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+24:3645:x1872758560927232:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1786002514.798208:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002514.798216:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af57841406b lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xb73071de bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414064 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.798225:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xb73071de (ffff9ed36e785400) 00010000:00010000:0.0:1786002514.798231:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002514.798247:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+23:3645:x1872758560927232:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 46us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002514.798252:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1786002514.798262:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1786002514.798267:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34656a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+22:3645:x1872758560927744:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1786002514.798276:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002514.798284:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578413d9a lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xee50ff8a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413d93 expref: 22 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.798293:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xee50ff8a (ffff9ed245fedb00) 00010000:00010000:0.0:1786002514.798298:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002514.798315:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34656a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+21:3645:x1872758560927744:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 48us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002514.798320:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1786002514.798374:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560927232:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1786002514.798384:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560927744:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1786002514.798392:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560927360:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1786002514.798400:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560927872:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1786002514.798469:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560927104:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1786002514.798499:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002514.798522:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560927616:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1786002514.798541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002514.798556:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786002514.798561:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560927488:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1786002514.798580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786002514.798604:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413de0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798613:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413de0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798619:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413de0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798625:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002514.798629:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413de0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798641:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413de0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798651:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x94df4dce (ffff9ed351207500) 00010000:00010000:1.0:1786002514.798654:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002514.798657:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413de0 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798664:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e600/0x7cee4af578413de0 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0x94df4dce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798682:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578413fed lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798689:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578413fed lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798696:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578413fed lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798701:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ae00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002514.798704:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578413fed lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798710:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578413fed lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798718:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0xce6cbcc (ffff9ed24559f000) 00010000:00010000:1.0:1786002514.798720:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002514.798723:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578413fed lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002514.798730:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578413fed lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x5:0x0].0xce6cbcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002514.799828:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560927104 00000100:00100000:0.0:1786002514.799834:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560927104 00000100:00100000:0.0:1786002514.799959:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560927616 00000100:00100000:0.0:1786002514.799963:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560927616 00000100:00100000:0.0:1786002514.799974:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560927488 00000100:00100000:0.0:1786002514.799977:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560927488 00000100:00100000:0.0:1786002514.799989:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1786002514.799997:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+23:3647:x1872758560927104:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1786002514.800005:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002514.800019:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af5784140f7 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xfe89f9f8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784140f0 expref: 23 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.800031:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xfe89f9f8 (ffff9ed24559f200) 00010000:00010000:0.0:1786002514.800038:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002514.800169:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1786002514.800178:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+22:3647:x1872758560927616:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1786002514.800185:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002514.800196:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578413eb2 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0xf8280fc8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413eab expref: 22 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002514.800207:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xf8280fc8 (ffff9ed351207700) 00010000:00010000:3.0:1786002514.800212:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002514.800255:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+21:3647:x1872758560927104:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 257us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002514.800262:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1786002514.800275:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:0.0:1786002514.800281:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+20:3647:x1872758560927488:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1786002514.800288:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002514.800298:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578413f06 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x5:0x0].0x83604406 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413eff expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002514.800307:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x83604406 (ffff9ed24559f700) 00010000:00010000:0.0:1786002514.800312:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:2.0:1786002514.800394:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 406 committed batchid 405 00000004:00080000:2.0:1786002514.800498:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed243311840 with version 776 00000020:00080000:2.0:1786002514.800509:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 402 cancel update log [0x200000401:0x3:0x0].398: rc = 0 00000020:00080000:2.0:1786002514.800548:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 402 cancel update log [0x240000400:0x3:0x0].399: rc = 0 00000004:00080000:2.0:1786002514.800570:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed2433110c0 with version 777 00000020:00080000:2.0:1786002514.800573:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 403 cancel update log [0x200000401:0x3:0x0].399: rc = 0 00000020:00080000:2.0:1786002514.800588:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 403 cancel update log [0x240000400:0x3:0x0].400: rc = 0 00000004:00080000:2.0:1786002514.800607:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed2456d8d80 with version 778 00000020:00080000:2.0:1786002514.800610:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 404 cancel update log [0x200000401:0x3:0x0].400: rc = 0 00000020:00080000:2.0:1786002514.800627:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 404 cancel update log [0x240000400:0x3:0x0].401: rc = 0 00000004:00080000:2.0:1786002514.800645:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245d3fa80 with version 779 00000020:00080000:2.0:1786002514.800648:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 405 cancel update log [0x200000401:0x3:0x0].402: rc = 0 00000020:00080000:2.0:1786002514.800668:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 405 cancel update log [0x240000400:0x3:0x0].402: rc = 0 00000020:00080000:2.0:1786002514.800675:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 405 00000100:00100000:3.0:1786002514.804038:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+19:3647:x1872758560927616:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 3853us (5487us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002514.804052:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:1.0:1786002514.804306:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560927104:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1786002514.804320:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560927616:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1786002514.807484:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+18:3647:x1872758560927488:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 7195us (8894us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002514.807497:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000004:00080000:0.0:1786002514.808249:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 776 rpc_version 776 00000020:00100000:0.0:1786002514.808283:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002514.808292:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244be7b80 x1872758560928128/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002514.808314:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be7b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560928128:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002514.808370:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002514.808410:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed37b772e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002514.808814:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560927488:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1786002514.808978:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560928128 00000100:00100000:2.0:1786002514.808985:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560928128 00000100:00100000:2.0:1786002514.809033:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:2.0:1786002514.809043:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:7466:x1872758560928128:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002514.809271:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:7466:x1872758560928128:12345-0@lo:1000:osp_up0-1.0 Request processed in 229us (900us total) trans 4294983526 rc 0/0 00000100:00100000:2.0:1786002514.809278:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00100000:1.0:1786002514.809796:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be7b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560928128:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1786002514.809819:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 777 rpc_version 777 00000020:00100000:1.0:1786002514.809837:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002514.809843:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2423f8380 x1872758560928384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002514.809902:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560928384:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002514.809933:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002514.809963:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed34bb3c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002514.810064:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560928384 00000100:00100000:2.0:1786002514.810069:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560928384 00000100:00100000:2.0:1786002514.810093:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:2.0:1786002514.810099:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:7466:x1872758560928384:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002514.810295:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:7466:x1872758560928384:12345-0@lo:1000:osp_up0-1.0 Request processed in 194us (359us total) trans 4294983527 rc 0/0 00000100:00100000:2.0:1786002514.810301:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000100:00100000:1.0:1786002514.810362:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560928384:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1786002514.810369:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 778 rpc_version 778 00000020:00100000:1.0:1786002514.810380:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002514.810384:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2423f8a80 x1872758560928640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002514.810397:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560928640:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002514.810422:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002514.810450:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed34bb3c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002514.810776:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560928640 00000100:00100000:2.0:1786002514.810781:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560928640 00000100:00100000:2.0:1786002514.810866:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:2.0:1786002514.810874:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:7466:x1872758560928640:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002514.810960:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+21:7466:x1872758560928640:12345-0@lo:1000:osp_up0-1.0 Request processed in 86us (536us total) trans 4294983528 rc 0/0 00000100:00100000:2.0:1786002514.810967:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00000100:00100000:1.0:1786002514.811023:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560928640:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1786002514.811031:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 779 rpc_version 779 00000020:00100000:1.0:1786002514.811041:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002514.811046:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2423fb480 x1872758560928896/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002514.811058:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fb480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560928896:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002514.811081:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002514.821228:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed34bb3c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002514.825018:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560928896 00000100:00100000:0.0:1786002514.825031:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560928896 00000100:00100000:0.0:1786002514.825088:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:0.0:1786002514.825097:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+21:7466:x1872758560928896:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002514.825284:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+22:7466:x1872758560928896:12345-0@lo:1000:osp_up0-1.0 Request processed in 188us (14201us total) trans 4294983529 rc 0/0 00000100:00100000:0.0:1786002514.825293:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:1.0:1786002514.825517:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fb480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560928896:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1786002514.859871:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002515.819436:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002515.819458:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560929024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002515.819523:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002515.819656:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560929024 00000100:00100000:2.0:1786002515.819663:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560929024 00000100:00100000:2.0:1786002515.819759:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:2.0:1786002515.819769:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:3647:x1872758560929024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786002515.820428:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445105664 avail 1298866176 00000100:00100000:2.0:1786002515.820475:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:3647:x1872758560929024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 706us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002515.820482:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000100:00100000:2.0:1786002515.820522:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968517 gen 2 00000004:00080000:2.0:1786002515.820528:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968472 committed transno 4294968517 00000004:00080000:2.0:1786002515.820547:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968475 committed transno 4294968517 00000004:00080000:2.0:1786002515.820556:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968476 committed transno 4294968517 00000020:00080000:2.0:1786002515.820561:0:3647:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed245e3de40 refcount 2 committed 0 result 0 batchid 399 00000020:00080000:2.0:1786002515.820564:0:3647:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed243d19600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245e3d540 00000020:00080000:2.0:1786002515.820567:0:3647:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].393 00000020:00080000:2.0:1786002515.820570:0:3647:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed242352c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d00400 00000020:00080000:2.0:1786002515.820572:0:3647:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].394 00000004:00080000:2.0:1786002515.820588:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968494 committed transno 4294968517 00000020:00080000:3.0:1786002515.820796:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 399 committed batchid 398 00000020:00080000:3.0:1786002515.820875:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 398 00000004:00080000:2.0:1786002515.822290:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968501 committed transno 4294968517 00000004:00080000:2.0:1786002515.822309:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968511 committed transno 4294968517 00000004:00080000:2.0:1786002515.822319:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968515 committed transno 4294968517 00000004:00080000:2.0:1786002515.822765:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968516 committed transno 4294968517 00000004:00080000:2.0:1786002515.822775:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968517 committed transno 4294968517 00000100:00100000:2.0:1786002515.822822:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560929024:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786002515.834651:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841417c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414183 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002515.834672:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841417c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414183 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002515.834712:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841417c lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414183 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002515.834718:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002515.834755:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841417c lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414183 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002515.834776:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35c00/0x7cee4af578413f53 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413f5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002515.834783:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35c00/0x7cee4af578413f53 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413f5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002515.834810:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35c00/0x7cee4af578413f53 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002515.834818:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002515.834842:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35c00/0x7cee4af578413f53 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413f5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002515.834886:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578413e1f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578413e26 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002515.834893:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578413e1f lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578413e26 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002515.834909:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578413e1f lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413e26 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002515.834915:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002515.834920:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34600/0x7cee4af578413e1f lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578413e26 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002515.834932:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983529 is committed 00000001:00080000:1.0:1786002515.834950:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983525 is committed 00000020:00080000:1.0:1786002515.834956:0:6499:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed36e5f4000 refcount 2 committed 0 result 0 batchid 405 00000020:00080000:1.0:1786002515.834960:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36e5f4900 00000020:00080000:1.0:1786002515.834963:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].399 00000020:00080000:1.0:1786002515.834966:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed246630400 00000020:00080000:1.0:1786002515.834968:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].400 00000020:00080000:1.0:1786002515.834977:0:6499:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2419a23c0 refcount 2 committed 0 result 0 batchid 404 00000020:00080000:1.0:1786002515.834980:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24540f500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2419a2780 00000020:00080000:1.0:1786002515.834984:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].398 00000020:00080000:1.0:1786002515.834986:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24540f800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed243f79000 00000020:00080000:1.0:1786002515.834988:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].399 00000020:00080000:1.0:1786002515.834994:0:6499:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed24194e180 refcount 2 committed 0 result 0 batchid 403 00000020:00080000:1.0:1786002515.834996:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36e7ab0c0 00000020:00080000:1.0:1786002515.834999:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].397 00000020:00080000:1.0:1786002515.835000:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed341343400 00000020:00080000:1.0:1786002515.835003:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].398 00000020:00080000:1.0:1786002515.835011:0:6499:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2456d8540 refcount 2 committed 0 result 0 batchid 402 00000100:00100000:3.0:1786002515.835864:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002515.835886:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560929152:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1786002515.835948:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1786002515.837215:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 398 00000100:00100000:2.0:1786002515.837309:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560929152 00000100:00100000:2.0:1786002515.837317:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560929152 00000100:00100000:2.0:1786002515.837376:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:2.0:1786002515.837385:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3646:x1872758560929152:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1786002515.837397:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002515.837418:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578414183 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x95dc2b73 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841417c expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002515.837432:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x95dc2b73 (ffff9ed36e785c00) 00010000:00010000:2.0:1786002515.837441:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002515.837482:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1872758560929152:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 99us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002515.837489:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000020:00080000:1.0:1786002515.837552:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2456d86c0 00000020:00080000:1.0:1786002515.837556:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].396 00000020:00080000:1.0:1786002515.837559:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244874c00 00000020:00080000:1.0:1786002515.837562:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].397 00000020:00080000:1.0:1786002515.837590:0:6499:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed36fb409c0 refcount 2 committed 0 result 0 batchid 401 00000020:00080000:1.0:1786002515.837593:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed36b3b4d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36fb40300 00000020:00080000:1.0:1786002515.837596:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].395 00000020:00080000:1.0:1786002515.837598:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed35959d200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244a60000 00000020:00080000:1.0:1786002515.837600:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].396 00000020:00080000:1.0:1786002515.837611:0:6499:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed366d7d000 refcount 2 committed 0 result 0 batchid 400 00000020:00080000:1.0:1786002515.837614:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2449ee900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed366d7d180 00000020:00080000:1.0:1786002515.837616:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].394 00000020:00080000:1.0:1786002515.837618:0:6499:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2449ee600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2433eb800 00000020:00080000:1.0:1786002515.837621:0:6499:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].395 00000100:00100000:0.0:1786002515.837737:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560929280:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1786002515.837772:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002515.837822:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786002515.837829:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560929408:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1786002515.837875:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786002515.837904:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784140b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.837912:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784140b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.837918:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784140b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.837924:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002515.837928:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784140b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.837934:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784140b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.837943:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xee075455 (ffff9ed245fed000) 00010000:00010000:0.0:1786002515.837946:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002515.837949:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784140b1 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.837955:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784140b1 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xee075455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.837978:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784141bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.837984:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784141bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.837990:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784141bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.837994:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002515.837997:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784141bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.838002:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784141bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.838009:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xca5a1f93 (ffff9ed36e785b00) 00010000:00010000:0.0:1786002515.838011:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002515.838024:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784141bb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.838030:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784141bb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xca5a1f93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002515.838047:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560929280 00000100:00100000:0.0:1786002515.838051:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560929280 00000100:00100000:0.0:1786002515.838084:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560929408 00000100:00100000:0.0:1786002515.838087:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560929408 00000100:00100000:0.0:1786002515.838102:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:0.0:1786002515.838109:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3644:x1872758560929280:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1786002515.838118:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002515.838130:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ac00/0x7cee4af578413f5a lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x44749f58 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413f53 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.838150:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x44749f58 (ffff9ed24559fc00) 00010000:00010000:0.0:1786002515.838158:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002515.838186:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1872758560929280:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 78us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002515.838193:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:0.0:1786002515.838206:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:0.0:1786002515.838212:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1872758560929408:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1786002515.838219:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002515.838230:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af578413e26 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x2153044 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578413e1f expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002515.838238:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x2153044 (ffff9ed24559f600) 00010000:00010000:0.0:1786002515.838244:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002515.838264:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560929408:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 52us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002515.838269:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:0.0:1786002515.838302:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560929408:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1786002515.838312:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560929280:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1786002515.839157:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560929152:0@lo:103:jbd2/dm-0-8.0 00000020:00080000:2.0:1786002515.839366:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 405 committed batchid 398 00000020:00080000:2.0:1786002515.839414:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 398 00010000:00010000:2.0:1786002515.882102:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002516.931218:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002517.880673:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560929536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002517.880919:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002517.880990:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560929536 00000100:00100000:2.0:1786002517.880997:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560929536 00000100:00100000:2.0:1786002517.881040:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1786002517.881049:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560929536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786002517.881073:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002517.881110:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560929536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002517.881117:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00080000:2.0:1786002517.881134:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002517.881163:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560929536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002517.883151:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786002517.883165:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560929664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002517.883210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002517.883491:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560929664 00000100:00100000:1.0:1786002517.883497:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560929664 00000100:00100000:1.0:1786002517.883544:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1786002517.883552:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560929664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002517.883568:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002517.883869:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560929664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 317us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002517.883877:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00080000:1.0:1786002517.883895:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002517.883924:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560929664:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1786002517.930991:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002518.355260:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002518.355315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002518.355346:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002518.355408:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002518.355435:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530868352 00000100:00100000:3.0:1786002518.355443:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530868352 00000100:00100000:3.0:1786002518.355500:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530868224 00000100:00100000:3.0:1786002518.355504:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530868224 00000100:00100000:3.0:1786002518.355530:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 856 00000100:00100000:3.0:1786002518.355540:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758530868352:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002518.355613:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758530868352:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 74us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002518.355620:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 856 00000100:00100000:3.0:1786002518.355639:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 857 00000100:00100000:3.0:1786002518.355646:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758530868224:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002518.355671:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758530868224:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002518.355678:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 857 00000100:00100000:3.0:1786002518.355696:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530868608 00000100:00100000:3.0:1786002518.355699:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530868608 00000100:00100000:3.0:1786002518.355737:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 461 00000100:00100000:3.0:1786002518.355743:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758530868608:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002518.355766:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758530868608:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002518.355772:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 461 00000100:00080000:3.0:1786002518.355800:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786002518.355804:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786002518.355806:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786002518.356033:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530868096 00000100:00100000:2.0:1786002518.356038:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530868096 00000100:00100000:2.0:1786002518.356074:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 509 00000100:00100000:2.0:1786002518.356081:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758530868096:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002518.356109:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758530868096:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 30us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002518.356115:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 509 00000100:00100000:3.0:1786002518.360434:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002518.360525:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530868480 00000100:00100000:2.0:1786002518.360534:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530868480 00000100:00100000:2.0:1786002518.360606:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 462 00000100:00100000:2.0:1786002518.360617:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758530868480:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002518.360678:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758530868480:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 64us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002518.360685:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 462 00000100:00080000:3.0:1786002518.360925:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002518.378979:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560929792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002518.379042:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002518.379145:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560929792 00000100:00100000:3.0:1786002518.379152:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560929792 00000100:00100000:3.0:1786002518.379197:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:3.0:1786002518.379204:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758560929792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786002518.379235:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444089856 avail 1297850368 00000100:00100000:3.0:1786002518.379277:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758560929792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002518.379284:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000100:00100000:3.0:1786002518.379453:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983529 gen 2 00000004:00080000:3.0:1786002518.379459:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983503 committed transno 4294983529 00000020:00080000:3.0:1786002518.379464:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed245e3d600 refcount 2 committed 0 result 0 batchid 407 00000020:00080000:3.0:1786002518.379468:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2449ee000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245e3dcc0 00000020:00080000:3.0:1786002518.379472:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].404 00000020:00080000:3.0:1786002518.379494:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2449ee400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed37bc93200 00000020:00080000:3.0:1786002518.379497:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].404 00000004:00080000:3.0:1786002518.379523:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983504 committed transno 4294983529 00000020:00080000:3.0:1786002518.379526:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed245d3fcc0 refcount 2 committed 0 result 0 batchid 408 00000020:00080000:3.0:1786002518.379529:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36faaf900 00000020:00080000:3.0:1786002518.379532:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].405 00000020:00080000:3.0:1786002518.379554:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed24497ca00 00000020:00080000:3.0:1786002518.379556:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].405 00000004:00080000:3.0:1786002518.379579:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983505 committed transno 4294983529 00000020:00080000:3.0:1786002518.379582:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed2456d8600 refcount 2 committed 0 result 0 batchid 409 00000020:00080000:3.0:1786002518.379585:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24540fe00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2456d8000 00000020:00080000:3.0:1786002518.379588:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].406 00000020:00080000:3.0:1786002518.379590:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24540f100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245656000 00000020:00080000:3.0:1786002518.379592:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].406 00000004:00080000:3.0:1786002518.379603:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983509 committed transno 4294983529 00000020:00080000:3.0:1786002518.379606:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed36fb40c00 refcount 2 committed 0 result 0 batchid 410 00000020:00080000:3.0:1786002518.379608:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2465a7a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36fb40840 00000020:00080000:3.0:1786002518.379611:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].407 00000020:00080000:3.0:1786002518.379613:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2465a7700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244a61600 00000020:00080000:3.0:1786002518.379615:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].407 00000004:00080000:3.0:1786002518.379625:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983510 committed transno 4294983529 00000020:00080000:3.0:1786002518.379629:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed36e7abd80 refcount 2 committed 0 result 0 batchid 411 00000020:00080000:3.0:1786002518.379631:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24540fb00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36e7ab300 00000020:00080000:3.0:1786002518.379634:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].408 00000020:00080000:3.0:1786002518.379636:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24540fa00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245657600 00000020:00080000:3.0:1786002518.379639:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].408 00000004:00080000:3.0:1786002518.379659:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983514 committed transno 4294983529 00000020:00080000:3.0:1786002518.379663:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed2433119c0 refcount 2 committed 0 result 0 batchid 412 00000020:00080000:3.0:1786002518.379665:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed36b3b4500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed243311cc0 00000020:00080000:3.0:1786002518.379668:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].409 00000020:00080000:3.0:1786002518.379669:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed36b3b4900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244a61e00 00000020:00080000:3.0:1786002518.379672:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].409 00000004:00080000:3.0:1786002518.379688:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983515 committed transno 4294983529 00000020:00080000:3.0:1786002518.379692:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed34bb3cc00 refcount 2 committed 0 result 0 batchid 413 00000020:00080000:3.0:1786002518.379694:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed36b3b4200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed34bb3c240 00000020:00080000:3.0:1786002518.379697:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].410 00000020:00080000:3.0:1786002518.379699:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed36b3b4000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244a60200 00000020:00080000:3.0:1786002518.379702:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].410 00000020:00080000:1.0:1786002518.379792:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 413 committed batchid 405 00000020:00080000:1.0:1786002518.379868:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 405 00000004:00080000:3.0:1786002518.379914:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983516 committed transno 4294983529 00000020:00080000:3.0:1786002518.379918:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed245d3fb40 refcount 2 committed 0 result 0 batchid 414 00000020:00080000:3.0:1786002518.379921:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d3f0c0 00000020:00080000:3.0:1786002518.379923:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].411 00000020:00080000:3.0:1786002518.379925:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244875400 00000020:00080000:3.0:1786002518.379928:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].411 00000020:00080000:1.0:1786002518.379954:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 414 committed batchid 405 00000020:00080000:1.0:1786002518.379970:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 405 00000004:00080000:3.0:1786002518.380010:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983520 committed transno 4294983529 00000020:00080000:3.0:1786002518.380014:0:3644:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed245e53480 refcount 2 committed 0 result 0 batchid 415 00000020:00080000:3.0:1786002518.380016:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bacc000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245e53f00 00000020:00080000:3.0:1786002518.380019:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].412 00000020:00080000:3.0:1786002518.380021:0:3644:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed36b3b4f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d01000 00000020:00080000:3.0:1786002518.380023:0:3644:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].412 00000020:00080000:1.0:1786002518.380050:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 415 committed batchid 405 00000020:00080000:1.0:1786002518.380066:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 405 00000004:00080000:3.0:1786002518.380098:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983526 committed transno 4294983529 00000004:00080000:3.0:1786002518.380108:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983527 committed transno 4294983529 00000004:00080000:3.0:1786002518.380115:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983528 committed transno 4294983529 00000004:00080000:3.0:1786002518.380188:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983529 committed transno 4294983529 00000100:00100000:3.0:1786002518.380206:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560929792:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1786002518.954046:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002519.402083:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786002519.402171:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002519.402190:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758560930304:0@lo:400:kworker.0 00000100:00100000:2.0:1786002519.402251:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002519.402310:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560930176:0@lo:400:kworker.0 00000100:00100000:2.0:1786002519.402334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002519.402350:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002519.402356:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758560930048:0@lo:400:kworker.0 00000100:00100000:2.0:1786002519.402373:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002519.402403:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560930176 00000100:00100000:2.0:1786002519.402409:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560930176 00000100:00100000:2.0:1786002519.402448:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00000100:00100000:2.0:1786002519.402456:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758560930176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002519.402500:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758560930176:12345-0@lo:400:kworker.0 Request processed in 45us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002519.402506:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00000100:00100000:2.0:1786002519.402540:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560930176:0@lo:400:kworker.0 00000100:00100000:2.0:1786002519.402571:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560930304 00000100:00100000:2.0:1786002519.402574:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560930304 00000100:00100000:2.0:1786002519.402596:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560930048 00000100:00100000:2.0:1786002519.402598:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560930048 00000100:00100000:2.0:1786002519.402613:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:2.0:1786002519.402619:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758560930304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002519.402648:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758560930304:12345-0@lo:400:kworker.0 Request processed in 30us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002519.402654:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:2.0:1786002519.402664:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1786002519.402669:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758560930048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002519.402693:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758560930048:12345-0@lo:400:kworker.0 Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002519.402698:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1786002519.402718:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758560930048:0@lo:400:kworker.0 00000100:00100000:2.0:1786002519.402738:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758560930304:0@lo:400:kworker.0 00000100:00100000:2.0:1786002519.403023:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560930560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002519.403049:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002519.403081:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560930560 00000100:00100000:2.0:1786002519.403085:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560930560 00000100:00100000:2.0:1786002519.403115:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1786002519.403121:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560930560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002519.403141:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1786002519.403171:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560930560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002519.403177:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1786002519.403200:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560930560:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1786002519.403222:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002519.403248:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560930432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002519.403268:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002519.403299:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560930432 00000100:00100000:2.0:1786002519.403303:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560930432 00000100:00100000:2.0:1786002519.403325:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1786002519.403330:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758560930432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002519.403339:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17022400 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1786002519.403365:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758560930432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002519.403371:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00080000:2.0:1786002519.403382:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002519.403398:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560930432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002519.404904:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758560929920:0@lo:400:kworker.0 00000100:00100000:3.0:1786002519.404950:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002519.405039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560929920 00000100:00100000:2.0:1786002519.405057:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560929920 00000100:00100000:2.0:1786002519.405114:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1786002519.405123:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758560929920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405132:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560930688:0@lo:400:kworker.0 00000100:00100000:3.0:1786002519.405192:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758560930816:0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405230:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002519.405263:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560931200:0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405287:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002519.405305:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786002519.405310:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560931072:0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405345:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002519.405368:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560931200 00000100:00100000:1.0:1786002519.405371:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560931200 00000100:00100000:1.0:1786002519.405399:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560931072 00000100:00100000:1.0:1786002519.405402:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560931072 00000100:00100000:1.0:1786002519.405419:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1786002519.405424:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560931200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405457:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560931200:12345-0@lo:400:kworker.0 Request processed in 32us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002519.405462:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1786002519.405476:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1786002519.405481:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560931072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405502:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560931072:12345-0@lo:400:kworker.0 Request processed in 22us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002519.405507:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1786002519.405538:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560931072:0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405546:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560931200:0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405563:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758560930944:0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002519.405599:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758560931456:0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405615:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786002519.405719:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002519.405740:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560930944 00000100:00100000:1.0:1786002519.405744:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560930944 00000100:00100000:1.0:1786002519.405770:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560931456 00000100:00100000:1.0:1786002519.405772:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560931456 00000100:00100000:1.0:1786002519.405805:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:1.0:1786002519.405811:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758560930944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405843:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758560930944:12345-0@lo:400:kworker.0 Request processed in 33us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002519.405868:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:1.0:1786002519.405878:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:1.0:1786002519.405883:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758560931456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405905:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758560931456:12345-0@lo:400:kworker.0 Request processed in 22us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002519.405910:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:1.0:1786002519.405923:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560930688 00000100:00100000:1.0:1786002519.405926:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560930688 00000100:00100000:1.0:1786002519.405944:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:1.0:1786002519.405949:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560930688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.405975:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560930688:12345-0@lo:400:kworker.0 Request processed in 27us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002519.405980:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00000100:00080000:1.0:1786002519.405991:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002519.406004:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560930688:0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.406019:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758560930944:0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.406026:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758560931456:0@lo:400:kworker.0 00000100:00100000:2.0:1786002519.409873:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758560929920:12345-0@lo:400:kworker.0 Request processed in 4744us (4915us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002519.409887:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1786002519.410383:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002519.410421:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758560931328:0@lo:400:kworker.0 00000100:00100000:3.0:1786002519.410446:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002519.410559:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758560929920:0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.411342:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560930816 00000100:00100000:1.0:1786002519.411348:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560930816 00000100:00100000:1.0:1786002519.412872:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560931328 00000100:00100000:1.0:1786002519.412879:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560931328 00000100:00100000:0.0:1786002519.412941:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1786002519.412953:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758560930816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002519.413023:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758560930816:12345-0@lo:400:kworker.0 Request processed in 73us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002519.413030:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1786002519.413084:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758560930816:0@lo:400:kworker.0 00000100:00080000:3.0:1786002519.415891:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786002519.416017:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:1.0:1786002519.416027:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758560931328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002519.416094:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758560931328:12345-0@lo:400:kworker.0 Request processed in 69us (5647us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002519.416100:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1786002519.416832:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758560931328:0@lo:400:kworker.0 00010000:00010000:3.0:1786002519.980766:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786002520.681517:0:20897:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 60h: striped directory with missing stripes can be accessed ========================================================== 03:48:38 (1786002518) 00000100:00100000:2.0:1786002520.938330:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560931584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002520.938398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002520.938466:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560931584 00000100:00100000:2.0:1786002520.938473:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560931584 00000100:00100000:2.0:1786002520.938514:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:2.0:1786002520.938522:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560931584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786002520.938552:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445105664 avail 1298866176 00000100:00100000:2.0:1786002520.938594:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560931584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002520.938600:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00000100:00100000:2.0:1786002520.938641:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560931584:0@lo:41:osp-pre-1-0.0 00000020:00080000:0.0:1786002520.945159:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 415 batchid updated 00000020:00080000:0.0:1786002520.945170:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 414 batchid updated 00000020:00080000:0.0:1786002520.945174:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 413 batchid updated 00000020:00080000:0.0:1786002520.945180:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 406 batchid updated 00000020:00080000:2.0:1786002520.945267:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 415 00000004:00080000:2.0:1786002520.945333:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245dcf840 with version 780 00000020:00080000:2.0:1786002520.945349:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 406 cancel update log [0x200000401:0x3:0x0].403: rc = 0 00000020:00080000:2.0:1786002520.945416:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 406 cancel update log [0x240000400:0x3:0x0].403: rc = 0 00000004:00080000:2.0:1786002520.945439:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245dc6600 with version 781 00000020:00080000:2.0:1786002520.945442:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 407 cancel update log [0x200000401:0x3:0x0].404: rc = 0 00000020:00080000:2.0:1786002520.945460:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 407 cancel update log [0x240000400:0x3:0x0].404: rc = 0 00000004:00080000:2.0:1786002520.945478:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed342bf66c0 with version 782 00000020:00080000:2.0:1786002520.945482:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 408 cancel update log [0x200000401:0x3:0x0].405: rc = 0 00000020:00080000:2.0:1786002520.945498:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 408 cancel update log [0x240000400:0x3:0x0].405: rc = 0 00000004:00080000:2.0:1786002520.945516:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed342bf6000 with version 783 00000020:00080000:2.0:1786002520.945519:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 409 cancel update log [0x200000401:0x3:0x0].406: rc = 0 00000020:00080000:2.0:1786002520.945534:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 409 cancel update log [0x240000400:0x3:0x0].406: rc = 0 00000004:00080000:2.0:1786002520.945551:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed24362d9c0 with version 784 00000020:00080000:2.0:1786002520.945554:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 410 cancel update log [0x200000401:0x3:0x0].407: rc = 0 00000020:00080000:2.0:1786002520.945569:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 410 cancel update log [0x240000400:0x3:0x0].407: rc = 0 00000004:00080000:2.0:1786002520.945587:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed24362d240 with version 785 00000020:00080000:2.0:1786002520.945590:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 411 cancel update log [0x200000401:0x3:0x0].408: rc = 0 00000020:00080000:2.0:1786002520.945605:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 411 cancel update log [0x240000400:0x3:0x0].408: rc = 0 00000004:00080000:2.0:1786002520.945621:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed24362d480 with version 786 00000020:00080000:2.0:1786002520.945624:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 412 cancel update log [0x200000401:0x3:0x0].409: rc = 0 00000020:00080000:2.0:1786002520.945640:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 412 cancel update log [0x240000400:0x3:0x0].409: rc = 0 00000004:00080000:2.0:1786002520.945656:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed24362dc00 with version 787 00000020:00080000:2.0:1786002520.945658:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 413 cancel update log [0x200000401:0x3:0x0].410: rc = 0 00000020:00080000:2.0:1786002520.945675:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 413 cancel update log [0x240000400:0x3:0x0].410: rc = 0 00000004:00080000:2.0:1786002520.945694:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed24362da80 with version 788 00000020:00080000:2.0:1786002520.945698:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 414 cancel update log [0x200000401:0x3:0x0].411: rc = 0 00000020:00080000:2.0:1786002520.945715:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 414 cancel update log [0x240000400:0x3:0x0].411: rc = 0 00000004:00080000:2.0:1786002520.945732:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed3412543c0 with version 789 00000020:00080000:2.0:1786002520.945735:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 415 cancel update log [0x200000401:0x3:0x0].412: rc = 0 00000020:00080000:2.0:1786002520.945751:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 415 cancel update log [0x240000400:0x3:0x0].412: rc = 0 00000020:00080000:2.0:1786002520.945756:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 415 00000004:00080000:0.0:1786002520.945865:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 780 rpc_version 780 00000020:00100000:0.0:1786002520.945895:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002520.945906:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244be4a80 x1872758560931840/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002520.945929:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560931840:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002520.945992:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002520.946032:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab240 going to sleep for 11 seconds 00000100:00100000:2.0:1786002520.947399:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560931840 00000100:00100000:2.0:1786002520.947408:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560931840 00000100:00100000:2.0:1786002520.947450:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:2.0:1786002520.947459:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b57bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7466:x1872758560931840:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.947593:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b57bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7466:x1872758560931840:12345-0@lo:1000:osp_up0-1.0 Request processed in 135us (1600us total) trans 4294983530 rc 0/0 00000100:00100000:2.0:1786002520.947601:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00000100:00100000:2.0:1786002520.947751:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560931840:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786002520.947761:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 781 rpc_version 781 00000020:00100000:2.0:1786002520.947784:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002520.947789:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed370e02300 x1872758560932096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002520.947804:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e02300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560932096:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.947883:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002520.947906:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a000 going to sleep for 11 seconds 00000100:00100000:2.0:1786002520.947917:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560932096 00000100:00100000:2.0:1786002520.947920:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560932096 00000100:00100000:2.0:1786002520.947941:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:2.0:1786002520.947946:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:7466:x1872758560932096:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.948013:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:7466:x1872758560932096:12345-0@lo:1000:osp_up0-1.0 Request processed in 66us (129us total) trans 4294983531 rc 0/0 00000100:00100000:2.0:1786002520.948020:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:2.0:1786002520.948047:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e02300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560932096:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786002520.948053:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 782 rpc_version 782 00000020:00100000:2.0:1786002520.948062:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002520.948068:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed370e01f80 x1872758560932352/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002520.948079:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e01f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560932352:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.948100:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002520.950031:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a000 going to sleep for 11 seconds 00000100:00100000:1.0:1786002520.960211:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560932352 00000100:00100000:1.0:1786002520.960225:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560932352 00000100:00100000:1.0:1786002520.960283:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:1.0:1786002520.960293:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:7466:x1872758560932352:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002520.960483:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:7466:x1872758560932352:12345-0@lo:1000:osp_up0-1.0 Request processed in 190us (12381us total) trans 4294983532 rc 0/0 00000100:00100000:1.0:1786002520.960491:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00100000:2.0:1786002520.960871:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e01f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560932352:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786002520.960886:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 783 rpc_version 783 00000020:00100000:2.0:1786002520.960907:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002520.960914:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed370e03800 x1872758560932608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002520.960934:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e03800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560932608:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.960971:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002520.961003:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a000 going to sleep for 11 seconds 00000100:00100000:2.0:1786002520.961017:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560932608 00000100:00100000:2.0:1786002520.961021:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560932608 00000100:00100000:2.0:1786002520.961045:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:2.0:1786002520.961052:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:7466:x1872758560932608:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.961137:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:7466:x1872758560932608:12345-0@lo:1000:osp_up0-1.0 Request processed in 85us (164us total) trans 4294983533 rc 0/0 00000100:00100000:2.0:1786002520.961144:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000100:00100000:2.0:1786002520.961177:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e03800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560932608:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786002520.961184:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 784 rpc_version 784 00000020:00100000:2.0:1786002520.961194:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002520.961199:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed370e01180 x1872758560932864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002520.961211:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e01180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560932864:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.961237:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002520.961249:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a000 going to sleep for 11 seconds 00000100:00100000:2.0:1786002520.961260:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560932864 00000100:00100000:2.0:1786002520.961263:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560932864 00000100:00100000:2.0:1786002520.961285:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:2.0:1786002520.961291:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:7466:x1872758560932864:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.961360:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:7466:x1872758560932864:12345-0@lo:1000:osp_up0-1.0 Request processed in 68us (121us total) trans 4294983534 rc 0/0 00000100:00100000:2.0:1786002520.961367:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00100000:2.0:1786002520.961396:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e01180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560932864:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786002520.961403:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 785 rpc_version 785 00000020:00100000:2.0:1786002520.961414:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002520.961418:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed370e03b80 x1872758560933120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002520.961430:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e03b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560933120:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.961453:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002520.961467:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a000 going to sleep for 11 seconds 00000100:00100000:2.0:1786002520.961478:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560933120 00000100:00100000:2.0:1786002520.961481:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560933120 00000100:00100000:2.0:1786002520.961500:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:2.0:1786002520.961506:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:7466:x1872758560933120:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.961566:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:7466:x1872758560933120:12345-0@lo:1000:osp_up0-1.0 Request processed in 59us (111us total) trans 4294983535 rc 0/0 00000100:00100000:2.0:1786002520.961572:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00100000:2.0:1786002520.961602:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e03b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560933120:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786002520.961609:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 786 rpc_version 786 00000020:00100000:2.0:1786002520.961619:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002520.961624:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed370e03480 x1872758560933376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002520.961636:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560933376:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.961658:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002520.961670:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a000 going to sleep for 11 seconds 00000100:00100000:2.0:1786002520.961680:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560933376 00000100:00100000:2.0:1786002520.961683:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560933376 00000100:00100000:2.0:1786002520.961701:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:2.0:1786002520.961707:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:7466:x1872758560933376:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.961780:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:7466:x1872758560933376:12345-0@lo:1000:osp_up0-1.0 Request processed in 72us (120us total) trans 4294983536 rc 0/0 00000100:00100000:2.0:1786002520.961787:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00100000:2.0:1786002520.961814:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560933376:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786002520.961820:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 787 rpc_version 787 00000020:00100000:2.0:1786002520.961830:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002520.961834:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed370e00700 x1872758560933632/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002520.961844:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560933632:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.961883:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002520.961900:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a000 going to sleep for 11 seconds 00000100:00100000:2.0:1786002520.961909:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560933632 00000100:00100000:2.0:1786002520.961911:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560933632 00000100:00100000:2.0:1786002520.961929:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:2.0:1786002520.961934:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+16:7466:x1872758560933632:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.961990:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+17:7466:x1872758560933632:12345-0@lo:1000:osp_up0-1.0 Request processed in 55us (106us total) trans 4294983537 rc 0/0 00000100:00100000:2.0:1786002520.961996:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00100000:2.0:1786002520.962021:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560933632:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786002520.962027:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 788 rpc_version 788 00000020:00100000:2.0:1786002520.962036:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002520.962041:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed370e00e00 x1872758560933888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002520.962051:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560933888:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.962072:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002520.962083:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a000 going to sleep for 11 seconds 00000100:00100000:2.0:1786002520.962092:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560933888 00000100:00100000:2.0:1786002520.962095:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560933888 00000100:00100000:2.0:1786002520.962112:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:2.0:1786002520.962118:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:7466:x1872758560933888:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.962174:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:7466:x1872758560933888:12345-0@lo:1000:osp_up0-1.0 Request processed in 56us (100us total) trans 4294983538 rc 0/0 00000100:00100000:2.0:1786002520.962180:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000100:00100000:2.0:1786002520.962205:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560933888:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1786002520.962211:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 789 rpc_version 789 00000020:00100000:2.0:1786002520.962220:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002520.962225:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2455f1880 x1872758560934144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002520.962236:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560934144:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.962258:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002520.962270:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a000 going to sleep for 11 seconds 00000100:00100000:2.0:1786002520.962279:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560934144 00000100:00100000:2.0:1786002520.962283:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560934144 00000100:00100000:2.0:1786002520.962300:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:2.0:1786002520.962305:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+18:7466:x1872758560934144:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002520.962367:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:7466:x1872758560934144:12345-0@lo:1000:osp_up0-1.0 Request processed in 61us (108us total) trans 4294983539 rc 0/0 00000100:00100000:2.0:1786002520.962373:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00100000:2.0:1786002520.962401:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560934144:0@lo:1000:osp_up0-1.0 00000001:00080000:0.0:1786002520.976935:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983531 is committed 00000020:00080000:0.0:1786002520.976950:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 405 batchid updated 00000020:00080000:0.0:1786002520.976954:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 399 batchid updated 00000020:00080000:3.0:1786002520.977259:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 405 00000004:00080000:3.0:1786002520.977318:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245c66a80 with version 759 00000020:00080000:3.0:1786002520.977328:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 399 cancel update log [0x240000401:0x3:0x0].393: rc = 0 00000020:00080000:3.0:1786002520.977389:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 399 cancel update log [0x200000400:0x3:0x0].394: rc = 0 00000004:00080000:3.0:1786002520.977412:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245c66480 with version 760 00000020:00080000:3.0:1786002520.977415:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 400 cancel update log [0x240000401:0x3:0x0].394: rc = 0 00000020:00080000:3.0:1786002520.977435:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 400 cancel update log [0x200000400:0x3:0x0].395: rc = 0 00000004:00080000:3.0:1786002520.977455:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245c66cc0 with version 761 00000020:00080000:3.0:1786002520.977458:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 401 cancel update log [0x240000401:0x3:0x0].395: rc = 0 00000020:00080000:3.0:1786002520.977475:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 401 cancel update log [0x200000400:0x3:0x0].396: rc = 0 00000004:00080000:3.0:1786002520.977496:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245c66d80 with version 762 00000020:00080000:3.0:1786002520.977499:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 402 cancel update log [0x240000401:0x3:0x0].396: rc = 0 00000020:00080000:3.0:1786002520.977516:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 402 cancel update log [0x200000400:0x3:0x0].397: rc = 0 00000004:00080000:3.0:1786002520.977536:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245c669c0 with version 763 00000020:00080000:3.0:1786002520.977539:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 403 cancel update log [0x240000401:0x3:0x0].397: rc = 0 00000020:00080000:3.0:1786002520.977556:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 403 cancel update log [0x200000400:0x3:0x0].398: rc = 0 00000004:00080000:3.0:1786002520.977573:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245c66540 with version 764 00000020:00080000:3.0:1786002520.977576:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 404 cancel update log [0x240000401:0x3:0x0].398: rc = 0 00000020:00080000:3.0:1786002520.977591:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 404 cancel update log [0x200000400:0x3:0x0].399: rc = 0 00000004:00080000:3.0:1786002520.977609:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245c66240 with version 765 00000020:00080000:3.0:1786002520.977612:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 405 cancel update log [0x240000401:0x3:0x0].399: rc = 0 00000020:00080000:3.0:1786002520.977628:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 405 cancel update log [0x200000400:0x3:0x0].400: rc = 0 00000020:00080000:3.0:1786002520.977634:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 405 00000004:00080000:3.0:1786002520.977642:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 759 rpc_version 759 00000020:00100000:3.0:1786002520.977670:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002520.977680:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed37bad3480 x1872758560934400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002520.977702:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560934400:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.977775:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002520.977816:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002520.977924:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560934400 00000100:00100000:3.0:1786002520.977931:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560934400 00000100:00100000:3.0:1786002520.977975:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00000100:00100000:3.0:1786002520.977983:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:7805:x1872758560934400:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.978098:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:7805:x1872758560934400:12345-0@lo:1000:osp_up1-0.0 Request processed in 114us (322us total) trans 4294968518 rc 0/0 00000100:00100000:3.0:1786002520.978106:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00000100:00100000:3.0:1786002520.978150:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560934400:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786002520.978159:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 760 rpc_version 760 00000020:00100000:3.0:1786002520.978170:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002520.978174:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed37bad0e00 x1872758560934656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002520.978185:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560934656:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.978213:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002520.978231:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002520.978245:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560934656 00000100:00100000:3.0:1786002520.978249:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560934656 00000100:00100000:3.0:1786002520.978271:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:3.0:1786002520.978277:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7805:x1872758560934656:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.978344:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560934656:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (130us total) trans 4294968519 rc 0/0 00000100:00100000:3.0:1786002520.978350:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000100:00100000:3.0:1786002520.978381:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad0e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560934656:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786002520.978388:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 761 rpc_version 761 00000020:00100000:3.0:1786002520.978398:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002520.978403:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed37bad1500 x1872758560934912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002520.978414:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560934912:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.978437:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002520.978450:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002520.978460:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560934912 00000100:00100000:3.0:1786002520.978463:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560934912 00000100:00100000:3.0:1786002520.978482:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:3.0:1786002520.978488:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560934912:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.978551:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560934912:12345-0@lo:1000:osp_up1-0.0 Request processed in 62us (112us total) trans 4294968520 rc 0/0 00000100:00100000:3.0:1786002520.978558:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00000100:00100000:3.0:1786002520.978587:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad1500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560934912:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786002520.978593:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 762 rpc_version 762 00000020:00100000:3.0:1786002520.978602:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002520.978607:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243ddf800 x1872758560935168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002520.978617:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddf800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560935168:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.978639:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002520.978650:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002520.978661:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560935168 00000100:00100000:3.0:1786002520.978664:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560935168 00000100:00100000:3.0:1786002520.978683:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:3.0:1786002520.978688:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560935168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.978750:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560935168:12345-0@lo:1000:osp_up1-0.0 Request processed in 61us (110us total) trans 4294968521 rc 0/0 00000100:00100000:3.0:1786002520.978757:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00000100:00100000:3.0:1786002520.978797:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddf800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560935168:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786002520.978803:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 763 rpc_version 763 00000020:00100000:3.0:1786002520.978812:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002520.978816:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243ddfb80 x1872758560935424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002520.978832:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddfb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560935424:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.978871:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002520.978883:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002520.978893:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560935424 00000100:00100000:3.0:1786002520.978895:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560935424 00000100:00100000:3.0:1786002520.978913:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:3.0:1786002520.978918:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560935424:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.978975:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560935424:12345-0@lo:1000:osp_up1-0.0 Request processed in 56us (103us total) trans 4294968522 rc 0/0 00000100:00100000:3.0:1786002520.978981:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00000100:00100000:3.0:1786002520.979005:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddfb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560935424:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786002520.979011:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 764 rpc_version 764 00000020:00100000:3.0:1786002520.979019:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002520.979024:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243ddea00 x1872758560935680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002520.979034:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560935680:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.979055:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002520.979066:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002520.979075:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560935680 00000100:00100000:3.0:1786002520.979077:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560935680 00000100:00100000:3.0:1786002520.979094:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:3.0:1786002520.979099:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560935680:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.979154:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:7805:x1872758560935680:12345-0@lo:1000:osp_up1-0.0 Request processed in 54us (97us total) trans 4294968523 rc 0/0 00000100:00100000:3.0:1786002520.979160:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00000100:00100000:3.0:1786002520.979184:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560935680:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1786002520.979190:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 765 rpc_version 765 00000020:00100000:3.0:1786002520.979198:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002520.979203:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243dddf80 x1872758560935936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002520.979213:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dddf80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560935936:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.979234:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002520.979245:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002520.979254:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560935936 00000100:00100000:3.0:1786002520.979257:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560935936 00000100:00100000:3.0:1786002520.979275:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00000100:00100000:3.0:1786002520.979280:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:7805:x1872758560935936:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002520.979340:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:7805:x1872758560935936:12345-0@lo:1000:osp_up1-0.0 Request processed in 59us (104us total) trans 4294968524 rc 0/0 00000100:00100000:3.0:1786002520.979346:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00000100:00100000:3.0:1786002520.979374:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dddf80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560935936:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1786002521.003494:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002522.028036:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002522.261196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002522.261309:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530868736 00000100:00100000:2.0:1786002522.261319:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530868736 00000100:00100000:2.0:1786002522.261391:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23809 00000100:00100000:2.0:1786002522.261402:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:18389:x1872758530868736:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002522.261422:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002522.261443:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784141de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a908 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.261504:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af5784141e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.261517:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af5784141e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.261529:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af5784141e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002522.261575:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:2.0:1786002522.261579:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786002522.261596:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af5784141e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.261625:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784141de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a908 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.261640:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af5784141e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a908 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.261649:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002522.261652:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786002522.261656:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a400, rc 0) 00000100:00100000:2.0:1786002522.261708:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18389:x1872758530868736:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 308us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002522.261715:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23809 00000100:00080000:3.0:1786002522.261927:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002522.270938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002522.271185:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530868864 00000100:00100000:1.0:1786002522.271195:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530868864 00000100:00100000:1.0:1786002522.271252:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23810 00000100:00100000:1.0:1786002522.271263:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18389:x1872758530868864:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002522.271282:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002522.271302:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af5784141ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a90f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271361:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784141f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271374:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784141f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271384:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784141f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271398:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784141fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271405:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784141fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271411:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784141fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271463:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784141f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271470:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784141f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271477:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784141f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271483:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784141f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271488:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002522.271492:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784141f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271499:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784141f3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271510:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002522.271513:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002522.271517:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784141f3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271524:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784141f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271535:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784141fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271541:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784141fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271546:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784141fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271551:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002522.271554:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784141fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271560:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784141fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271567:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9ed244f15900) 00010000:00010000:1.0:1786002522.271569:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002522.271572:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784141fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271578:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784141fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271607:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af5784141ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a90f expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271624:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002522.271626:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002522.271629:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af5784141ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a90f expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.271638:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f600, rc 0) 00000100:00100000:1.0:1786002522.271688:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18389:x1872758530868864:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 428us (760us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002522.271696:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23810 00000100:00100000:2.0:1786002522.312283:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002522.312886:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530869120 00000100:00100000:3.0:1786002522.312895:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530869120 00000100:00100000:3.0:1786002522.312952:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23811 00000100:00100000:3.0:1786002522.312962:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18389:x1872758530869120:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:3.0:1786002522.313015:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002522.313042:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af5784141e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a908 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.313058:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002522.313064:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002522.313138:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414201 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.313152:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414201 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.313162:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414201 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.313176:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.313183:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.313190:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:02000000:3.0:1786002522.313693:0:14496:0:(lod_object.c:4389:lod_xattr_set_lmv()) *** cfs_fail_loc=188, val=0*** 00000040:00080000:3.0:1786002522.315450:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].401, 1760 off600696 00000040:00080000:3.0:1786002522.315522:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].400, 1928 off650400 00000004:00080000:3.0:1786002522.315529:0:14496:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245d3f480 with version 766 00000004:00080000:3.0:1786002522.315554:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 766 rpc_version 766 00000020:00100000:3.0:1786002522.315583:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002522.315592:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed243dddc00 x1872758560936192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002522.315615:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dddc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560936192:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002522.315677:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002522.315720:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b3e300 going to sleep for 11 seconds 00000100:00100000:3.0:1786002522.315740:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560936192 00000100:00100000:3.0:1786002522.315745:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560936192 00000100:00100000:1.0:1786002522.328304:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:1.0:1786002522.328320:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:7805:x1872758560936192:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002522.328531:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:7805:x1872758560936192:12345-0@lo:1000:osp_up1-0.0 Request processed in 216us (12852us total) trans 4294968525 rc 0/0 00000100:00100000:1.0:1786002522.328540:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000100:00100000:3.0:1786002522.335316:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dddc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560936192:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1786002522.341171:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af57841420f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.341188:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af57841420f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.341199:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af57841420f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.341220:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414216 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.341227:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414216 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.341233:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414216 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.341269:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841421d lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.341276:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841421d lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.341286:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841421d lrc: 3/0,1 mode: --/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002522.341309:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560936320:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002522.341367:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002522.341412:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a840 going to sleep for 11 seconds 00000100:00100000:3.0:1786002522.343116:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560936320 00000100:00100000:3.0:1786002522.343126:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560936320 00000100:00100000:3.0:1786002522.343176:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:3.0:1786002522.343185:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:14496:x1872758560936320:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002522.343205:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002522.343222:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414224 lrc: 2/0,0 mode: --/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841421d expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.343245:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414224 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841421d expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.343258:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414224 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841421d expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.343266:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd5:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002522.343269:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002522.343273:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ca00, rc 0) 00000100:00100000:3.0:1786002522.343322:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:14496:x1872758560936320:12345-0@lo:101:mdt00_004.0 Request processed in 138us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002522.343328:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:2.0:1786002522.345117:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560936320:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002522.345138:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841421d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414224 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345150:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841421d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414224 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002522.345172:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad343323 reply state 000000003265e818 transno 4294983540 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414216 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345184:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345191:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f600) 00010000:00010000:2.0:1786002522.345193:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002522.345196:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002522.345202:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841421d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414224 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345210:0:14496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841421d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414224 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002522.345220:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0xd5:0x0] 00000004:00010000:2.0:1786002522.345226:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad343323 reply state 000000003265e818 transno 4294983540 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af57841420f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345233:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af57841420f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345238:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9ed24559f800) 00010000:00010000:2.0:1786002522.345240:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002522.345241:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1786002522.345246:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1538:0x0]: returning size 4096 00010000:00010000:2.0:1786002522.345255:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414201 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345261:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414201 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345266:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414201 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345272:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414201 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345277:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002522.345280:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414201 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345291:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414201 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345300:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002522.345302:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.345305:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414201 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345310:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414201 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002522.345325:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad343323 reply state 000000003265e818 transno 4294983540 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345331:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.345337:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9ed245fed700) 00010000:00010000:2.0:1786002522.345339:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002522.345341:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1786002522.345408:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:18389:x1872758530869120:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 32445us (33130us total) trans 4294983540 rc 0/0 00000100:00100000:2.0:1786002522.345415:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23811 00000100:00100000:0.0:1786002522.354395:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002522.354520:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530869248 00000100:00100000:1.0:1786002522.354529:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530869248 00000100:00100000:1.0:1786002522.354586:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23812 00000100:00100000:1.0:1786002522.354596:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:18233:x1872758530869248:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002522.354618:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002522.354638:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af57841422b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a916 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.354695:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414232 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.354713:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.354723:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002522.354777:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:1.0:1786002522.354783:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786002522.354801:0:10360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.354824:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af57841422b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a916 expref: 12 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.354840:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a916 expref: 11 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.354877:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002522.354880:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786002522.354883:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7ee00, rc 0) 00000100:00100000:1.0:1786002522.354938:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:18233:x1872758530869248:12345-192.168.203.49@tcp:101:bash.0 Request processed in 343us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002522.354945:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23812 00000100:00100000:3.0:1786002522.376682:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002522.376770:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530869376 00000100:00100000:0.0:1786002522.376780:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530869376 00000100:00100000:0.0:1786002522.376839:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23813 00000100:00100000:0.0:1786002522.376877:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:18233:x1872758530869376:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002522.376897:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002522.376915:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a91d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.376969:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414240 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.376982:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.376993:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377013:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414247 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377021:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377029:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377092:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af57841424e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377109:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af57841424e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377117:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af57841424e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002522.377180:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1538:0x0]: returning size 4096 00000004:00200000:0.0:1786002522.377185:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1786002522.377201:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af57841424e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377218:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414240 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377225:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414240 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377232:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414240 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377238:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414240 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377244:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002522.377248:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414240 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377256:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414240 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377267:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002522.377270:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002522.377273:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414240 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377289:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414240 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377302:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377308:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414247 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377316:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377321:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002522.377324:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377330:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414247 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377336:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9ed245fed700) 00010000:00010000:0.0:1786002522.377339:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002522.377341:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414247 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377347:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414247 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377369:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a91d expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377381:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af57841424e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a91d expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.377388:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9ed24559f800) 00010000:00010000:0.0:1786002522.377390:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786002522.377392:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35800, rc 0) 00000100:00100000:0.0:1786002522.377444:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18233:x1872758530869376:12345-192.168.203.49@tcp:101:bash.0 Request processed in 596us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002522.377455:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23813 00000100:00100000:1.0:1786002522.386156:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002522.391325:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530869504 00000100:00100000:0.0:1786002522.391339:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530869504 00000100:00100000:0.0:1786002522.391406:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23814 00000100:00100000:0.0:1786002522.391417:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18233:x1872758530869504:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002522.391437:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002522.391457:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414255 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a924 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.391514:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841425c lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.391527:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841425c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.391537:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841425c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002522.391581:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd5:0x0]: returning size 4096 00000004:00200000:0.0:1786002522.391586:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786002522.391622:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414255 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a924 expref: 14 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.391637:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841425c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a924 expref: 13 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.391646:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f600) 00010000:00010000:0.0:1786002522.391649:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002522.391653:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:0.0:1786002522.391718:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:18233:x1872758530869504:12345-192.168.203.49@tcp:101:bash.0 Request processed in 303us (5571us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002522.391725:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23814 00000100:00100000:3.0:1786002522.404565:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002522.404643:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530869760 00000100:00100000:0.0:1786002522.404653:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530869760 00000100:00100000:0.0:1786002522.404712:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23815 00000100:00100000:0.0:1786002522.404722:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:18233:x1872758530869760:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002522.404741:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002522.404745:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786002522.404778:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841425c lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a924 expref: 13 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.404797:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f600) 00010000:00010000:0.0:1786002522.404802:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002522.404814:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414263 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a92b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.404947:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af57841426a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.404960:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af57841426a lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.404970:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af57841426a lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.404984:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414271 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.404995:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414271 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405012:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414271 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002522.405442:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c7:0x0], index 1: 0 00010000:00010000:0.0:1786002522.405563:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578414278 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405572:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578414278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405580:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578414278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405610:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af57841426a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405617:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af57841426a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405623:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af57841426a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405630:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af57841426a lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405636:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002522.405641:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af57841426a lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405652:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af57841426a lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405660:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f600) 00010000:00010000:0.0:1786002522.405663:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002522.405667:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af57841426a lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405673:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af57841426a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002522.405683:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5834041 reply state 00000000336ab3b6 transno 4294983541 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414271 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405693:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414271 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405699:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xdcc87686 (ffff9ed2456eff00) 00010000:00010000:0.0:1786002522.405701:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002522.405704:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002522.405727:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414263 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a92b expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405739:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578414278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a92b expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.405746:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9ed2456efc00) 00010000:00010000:0.0:1786002522.405748:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002522.405750:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35a00, rc 0) 00000100:00100000:0.0:1786002522.405817:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18233:x1872758530869760:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1096us (1261us total) trans 4294983541 rc 0/0 00000100:00100000:0.0:1786002522.405825:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23815 00000100:00100000:3.0:1786002522.434331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002522.438274:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530869888 00000100:00100000:1.0:1786002522.438287:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530869888 00000100:00100000:1.0:1786002522.438349:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5189 00000100:00100000:1.0:1786002522.438358:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:18233:x1872758530869888:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002522.438377:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002522.438396:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a932 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002522.438418:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002522.438438:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c7:0x0].0x0 since=882s v=(0 0) 00010000:00010000:1.0:1786002522.438443:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002522.438452:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.438467:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.438479:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f600, rc 0) 00000100:00100000:1.0:1786002522.438534:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:18233:x1872758530869888:12345-192.168.203.49@tcp:101:bash.0 Request processed in 178us (4211us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002522.438541:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5189 00000100:00080000:1.0:1786002522.438561:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002522.480013:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002522.480093:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530870144 00000100:00100000:1.0:1786002522.480110:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530870144 00000100:00100000:1.0:1786002522.480159:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5070 00000100:00100000:1.0:1786002522.480169:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18233:x1872758530870144:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:1.0:1786002522.480414:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18233:x1872758530870144:12345-192.168.203.49@tcp:35:bash.0 Request processed in 245us (408us total) trans 4294983542 rc 0/0 00000100:00100000:1.0:1786002522.480421:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5070 00000100:00100000:1.0:1786002522.489566:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002522.489639:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530870400 00000100:00100000:2.0:1786002522.489649:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530870400 00000100:00100000:2.0:1786002522.489700:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23816 00000100:00100000:2.0:1786002522.489710:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18233:x1872758530870400:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002522.489733:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002522.489751:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af57841428d lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a939 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.489887:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414294 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.489900:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414294 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.489910:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414294 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.489923:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841429b lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.489929:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841429b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.489935:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841429b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002522.490299:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c8:0x0], index 0: 0 00010000:00010000:2.0:1786002522.490411:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784142a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490420:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784142a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490427:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784142a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490453:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414294 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490464:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414294 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490470:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414294 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490475:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414294 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490480:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002522.490484:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414294 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490490:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414294 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490501:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f600) 00010000:00010000:2.0:1786002522.490504:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.490507:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414294 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490512:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414294 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002522.490523:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000affeea3c reply state 000000004683abd8 transno 4294983543 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841429b lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490532:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841429b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490537:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xbc0ca3a9 (ffff9ed24559f900) 00010000:00010000:2.0:1786002522.490540:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002522.490542:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002522.490565:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af57841428d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a939 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490579:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784142a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a939 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.490586:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9ed24559f700) 00010000:00010000:2.0:1786002522.490588:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002522.490590:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2bc00, rc 0) 00000100:00100000:2.0:1786002522.490743:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18233:x1872758530870400:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1033us (1184us total) trans 4294983543 rc 0/0 00000100:00100000:2.0:1786002522.490751:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23816 00000100:00100000:0.0:1786002522.504237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002522.504351:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530870528 00000100:00100000:3.0:1786002522.504360:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530870528 00000100:00100000:3.0:1786002522.504425:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5190 00000100:00100000:3.0:1786002522.504436:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:18233:x1872758530870528:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002522.504454:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002522.504474:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a940 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002522.504497:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002522.504517:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=882s v=(0 0) 00010000:00010000:3.0:1786002522.504521:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002522.504530:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.504545:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.504558:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c000, rc 0) 00000100:00080000:1.0:1786002522.504653:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002522.504724:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:18233:x1872758530870528:12345-192.168.203.49@tcp:101:bash.0 Request processed in 290us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002522.504731:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5190 00000100:00100000:0.0:1786002522.516791:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002522.516871:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530870784 00000100:00100000:1.0:1786002522.516880:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530870784 00000100:00100000:1.0:1786002522.516934:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5071 00000100:00100000:1.0:1786002522.516943:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18233:x1872758530870784:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:1.0:1786002522.517214:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18233:x1872758530870784:12345-192.168.203.49@tcp:35:bash.0 Request processed in 271us (432us total) trans 4294983544 rc 0/0 00000100:00100000:1.0:1786002522.517222:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5071 00000100:00100000:0.0:1786002522.533831:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002522.533989:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530871040 00000100:00100000:1.0:1786002522.534008:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530871040 00000100:00100000:1.0:1786002522.534069:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23817 00000100:00100000:1.0:1786002522.534083:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18233:x1872758530871040:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002522.534118:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002522.534137:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af5784142b7 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a947 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534237:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784142be lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534250:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784142be lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534261:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784142be lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534275:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784142c5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534293:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784142c5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534300:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784142c5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002522.534563:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c8:0x0], index 1: 0 00010000:00010000:1.0:1786002522.534685:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af5784142cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534694:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af5784142cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534702:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af5784142cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534732:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784142be lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534740:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784142be lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534745:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784142be lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534751:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784142be lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534765:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002522.534769:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784142be lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534774:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784142be lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534790:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f600) 00010000:00010000:1.0:1786002522.534793:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002522.534797:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784142be lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534803:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784142be lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002522.534815:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb268c77 reply state 00000000801caa25 transno 4294983545 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784142c5 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534825:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784142c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.534831:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x391d5834 (ffff9ed244f15200) 00010000:00010000:1.0:1786002522.534834:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002522.534836:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002522.537217:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af5784142b7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a947 expref: 23 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.537241:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af5784142cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a947 expref: 22 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.537250:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9ed244f15b00) 00010000:00010000:1.0:1786002522.537253:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002522.537256:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e600, rc 0) 00000100:00100000:1.0:1786002522.537385:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:18233:x1872758530871040:12345-192.168.203.49@tcp:101:bash.0 Request processed in 3306us (3562us total) trans 4294983545 rc 0/0 00000100:00100000:1.0:1786002522.537394:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23817 00000100:00100000:0.0:1786002522.558054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002522.558204:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530871168 00000100:00100000:3.0:1786002522.558213:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530871168 00000100:00100000:3.0:1786002522.558280:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5191 00000100:00100000:3.0:1786002522.558292:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:18233:x1872758530871168:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002522.558310:0:8764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002522.558332:0:8764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a94e expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002522.558359:0:8764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002522.558379:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=882s v=(0 0) 00010000:00010000:3.0:1786002522.558384:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002522.558392:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 8 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.558408:0:8764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 8 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.558419:0:8764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d200, rc 0) 00000100:00100000:3.0:1786002522.558474:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:18233:x1872758530871168:12345-192.168.203.49@tcp:101:bash.0 Request processed in 184us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002522.558481:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5191 00000100:00100000:2.0:1786002522.562274:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002522.562394:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530871424 00000100:00100000:3.0:1786002522.562404:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530871424 00000100:00100000:3.0:1786002522.562453:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5072 00000100:00100000:3.0:1786002522.562463:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:18233:x1872758530871424:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:3.0:1786002522.562729:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18233:x1872758530871424:12345-192.168.203.49@tcp:35:bash.0 Request processed in 266us (462us total) trans 4294983546 rc 0/0 00000100:00100000:3.0:1786002522.562737:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5072 00000100:00100000:0.0:1786002522.578173:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002522.578328:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530871680 00000100:00100000:3.0:1786002522.578336:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530871680 00000100:00100000:3.0:1786002522.578395:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23818 00000100:00100000:3.0:1786002522.578404:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18233:x1872758530871680:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002522.578430:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002522.578449:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af5784142e1 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a955 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.578540:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784142e8 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.578554:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784142e8 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.578565:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784142e8 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.578578:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784142ef lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.578585:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784142ef lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.578591:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784142ef lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002522.578897:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c9:0x0], index 0: 0 00010000:00010000:3.0:1786002522.579033:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784142f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579042:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784142f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579049:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784142f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579083:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784142e8 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579240:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784142e8 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579249:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784142e8 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579254:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784142e8 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579260:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002522.579264:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784142e8 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579280:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784142e8 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579293:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f600) 00010000:00010000:3.0:1786002522.579296:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002522.579300:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784142e8 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579306:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784142e8 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002522.579322:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007392cae2 reply state 00000000e5b984f5 transno 4294983547 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784142ef lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579332:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784142ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579337:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x18618557 (ffff9ed245fedd00) 00010000:00010000:3.0:1786002522.579339:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002522.579341:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002522.579365:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af5784142e1 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a955 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579378:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784142f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a955 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.579385:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:3.0:1786002522.579388:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002522.579389:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c400, rc 0) 00000100:00100000:3.0:1786002522.579452:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:18233:x1872758530871680:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1048us (1288us total) trans 4294983547 rc 0/0 00000100:00100000:3.0:1786002522.579459:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23818 00000100:00100000:0.0:1786002522.604975:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002522.605104:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530871808 00000100:00100000:1.0:1786002522.605113:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530871808 00000100:00100000:1.0:1786002522.605167:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5192 00000100:00100000:1.0:1786002522.605177:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:18233:x1872758530871808:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002522.605195:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002522.605215:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a95c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002522.605237:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002522.605258:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=882s v=(0 0) 00010000:00010000:1.0:1786002522.605262:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002522.605271:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.605297:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.605309:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7ec00, rc 0) 00000100:00100000:1.0:1786002522.605360:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18233:x1872758530871808:12345-192.168.203.49@tcp:101:bash.0 Request processed in 184us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002522.605366:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5192 00000100:00100000:0.0:1786002522.631183:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002522.631305:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530872064 00000100:00100000:3.0:1786002522.631314:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530872064 00000100:00100000:3.0:1786002522.631367:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5073 00000100:00100000:3.0:1786002522.631376:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:18233:x1872758530872064:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:3.0:1786002522.631654:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18233:x1872758530872064:12345-192.168.203.49@tcp:35:bash.0 Request processed in 277us (479us total) trans 4294983548 rc 0/0 00000100:00100000:3.0:1786002522.631662:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5073 00000100:00100000:0.0:1786002522.643444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002522.643540:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530872320 00000100:00100000:2.0:1786002522.643550:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530872320 00000100:00100000:2.0:1786002522.643614:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23819 00000100:00100000:2.0:1786002522.643626:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18233:x1872758530872320:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002522.643649:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002522.643668:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841430b lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a963 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.643769:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414312 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.643782:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414312 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.643797:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414312 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.643811:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414319 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.643818:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414319 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.643825:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414319 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002522.644228:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c9:0x0], index 1: 0 00010000:00010000:2.0:1786002522.644408:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414320 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.644417:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414320 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.644423:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414320 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.644452:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414312 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.644459:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414312 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.644955:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414312 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.644964:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414312 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.645335:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002522.645341:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414312 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.645349:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414312 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.645363:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f600) 00010000:00010000:2.0:1786002522.645366:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.645370:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414312 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.645376:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414312 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002522.645391:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b64b442d reply state 0000000022d1e857 transno 4294983549 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414319 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.645401:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414319 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.645408:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xb62e0cbf (ffff9ed24559f200) 00010000:00010000:2.0:1786002522.645410:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002522.645413:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002522.645448:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841430b lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a963 expref: 31 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.645463:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414320 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a963 expref: 30 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.645475:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9ed24559fb00) 00010000:00010000:2.0:1786002522.645477:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002522.645479:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b800, rc 0) 00000100:00100000:2.0:1786002522.645585:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:18233:x1872758530872320:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1961us (2149us total) trans 4294983549 rc 0/0 00000100:00100000:2.0:1786002522.645593:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23819 00000100:00100000:0.0:1786002522.667270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002522.667355:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530872448 00000100:00100000:2.0:1786002522.667364:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530872448 00000100:00100000:2.0:1786002522.667419:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5193 00000100:00100000:2.0:1786002522.667428:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:18233:x1872758530872448:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002522.667445:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002522.667465:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a96a expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002522.667487:0:14665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002522.667507:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=882s v=(0 0) 00010000:00010000:2.0:1786002522.667512:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002522.667520:0:14665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 9 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.667536:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 9 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.667548:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a600, rc 0) 00000100:00100000:2.0:1786002522.667602:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18233:x1872758530872448:12345-192.168.203.49@tcp:101:bash.0 Request processed in 176us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002522.667609:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5193 00000100:00100000:1.0:1786002522.689631:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002522.689716:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530872704 00000100:00100000:2.0:1786002522.689724:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530872704 00000100:00100000:2.0:1786002522.689786:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5074 00000100:00100000:2.0:1786002522.689796:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:18233:x1872758530872704:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1786002522.690089:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:18233:x1872758530872704:12345-192.168.203.49@tcp:35:bash.0 Request processed in 293us (466us total) trans 4294983550 rc 0/0 00000100:00100000:2.0:1786002522.690106:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5074 00000100:00100000:0.0:1786002522.693500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002522.693582:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530872960 00000100:00100000:3.0:1786002522.693592:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530872960 00000100:00100000:3.0:1786002522.693648:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23820 00000100:00100000:3.0:1786002522.693658:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:18233:x1872758530872960:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002522.693682:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002522.693701:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414335 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a971 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.693806:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af57841433c lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.693820:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af57841433c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.693832:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af57841433c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.693880:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414343 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.693888:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414343 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.693895:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414343 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002522.694159:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ca:0x0], index 0: 0 00010000:00010000:3.0:1786002522.694270:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af57841434a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694290:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af57841434a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694297:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af57841434a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694330:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af57841433c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694338:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af57841433c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694344:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af57841433c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694349:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af57841433c lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694355:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002522.694359:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af57841433c lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694365:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af57841433c lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694375:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f600) 00010000:00010000:3.0:1786002522.694377:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002522.694381:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af57841433c lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694387:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af57841433c lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002522.694403:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be766312 reply state 000000001ea14bda transno 4294983551 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414343 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694412:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414343 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694418:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x84832a57 (ffff9ed245fedc00) 00010000:00010000:3.0:1786002522.694420:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002522.694422:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002522.694445:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414335 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a971 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694459:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af57841434a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a971 expref: 34 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.694466:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9ed245fed000) 00010000:00010000:3.0:1786002522.694469:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002522.694471:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8cc00, rc 0) 00000100:00100000:3.0:1786002522.694528:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:18233:x1872758530872960:12345-192.168.203.49@tcp:101:bash.0 Request processed in 872us (1038us total) trans 4294983551 rc 0/0 00000100:00100000:3.0:1786002522.694536:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23820 00000100:00100000:0.0:1786002522.711253:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002522.711436:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530873088 00000100:00100000:1.0:1786002522.711445:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530873088 00000100:00100000:1.0:1786002522.711498:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5194 00000100:00100000:1.0:1786002522.711508:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18233:x1872758530873088:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002522.711527:0:14687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002522.711547:0:14687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a978 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002522.711571:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002522.711592:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=882s v=(0 0) 00010000:00010000:1.0:1786002522.711597:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002522.711607:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 10 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.711624:0:14687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 10 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.711637:0:14687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e000, rc 0) 00000100:00100000:1.0:1786002522.711691:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:18233:x1872758530873088:12345-192.168.203.49@tcp:101:bash.0 Request processed in 185us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002522.711699:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5194 00000100:00100000:1.0:1786002522.726491:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002522.726660:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530873344 00000100:00100000:3.0:1786002522.726669:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530873344 00000100:00100000:3.0:1786002522.726722:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5075 00000100:00100000:3.0:1786002522.726733:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:18233:x1872758530873344:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:3.0:1786002522.734419:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:18233:x1872758530873344:12345-192.168.203.49@tcp:35:bash.0 Request processed in 7678us (7927us total) trans 4294983552 rc 0/0 00000100:00100000:3.0:1786002522.734433:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5075 00000100:00100000:0.0:1786002522.773024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002522.773183:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530873600 00000100:00100000:1.0:1786002522.773192:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530873600 00000100:00100000:1.0:1786002522.773254:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23821 00000100:00100000:1.0:1786002522.773264:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:18390:x1872758530873600:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002522.773298:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002522.773318:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841435f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a97f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002522.773462:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1538:0x0]: returning size 4096 00010000:00010000:1.0:1786002522.773552:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841435f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a97f expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.773567:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002522.773570:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002522.773574:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841435f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a97f expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.773587:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f200, rc 0) 00000100:00100000:1.0:1786002522.773646:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:18390:x1872758530873600:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 383us (630us total) trans 4294983553 rc 301/301 00000100:00100000:1.0:1786002522.773653:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23821 00000100:00100000:2.0:1786002522.781991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002522.782125:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530873728 00000100:00100000:3.0:1786002522.782134:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530873728 00000100:00100000:3.0:1786002522.782187:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5076 00000100:00100000:3.0:1786002522.782198:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:18390:x1872758530873728:12345-192.168.203.49@tcp:33:lfs.0 00000004:00200000:3.0:1786002522.782340:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1538:0x0]: returning size 4096 00000004:00200000:3.0:1786002522.782346:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1786002522.782414:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:18390:x1872758530873728:12345-192.168.203.49@tcp:33:lfs.0 Request processed in 217us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002522.782422:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5076 00000100:00100000:2.0:1786002522.794369:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002522.794570:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530873984 00000100:00100000:3.0:1786002522.794580:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530873984 00000100:00100000:3.0:1786002522.794634:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5077 00000100:00100000:3.0:1786002522.794644:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:18390:x1872758530873984:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1786002522.794893:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+38:18390:x1872758530873984:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 249us (532us total) trans 4294983554 rc 0/0 00000100:00100000:3.0:1786002522.794902:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5077 00000100:00100000:0.0:1786002522.838975:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002522.839117:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530874240 00000100:00100000:3.0:1786002522.839126:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530874240 00000100:00100000:3.0:1786002522.839184:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23822 00000100:00100000:3.0:1786002522.839194:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+38:18391:x1872758530874240:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002522.839219:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002522.839238:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841436d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a986 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.839383:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414374 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.839397:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1538:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.839409:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1538:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002522.839420:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1538:0x0]: returning size 4096 00010000:00010000:3.0:1786002522.839520:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841436d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a986 expref: 41 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.839543:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414374 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1538:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a986 expref: 40 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.839552:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9ed24559f800) 00010000:00010000:3.0:1786002522.839555:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786002522.839559:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ce00, rc 0) 00000100:00100000:3.0:1786002522.839617:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:18391:x1872758530874240:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 424us (650us total) trans 4294983555 rc 0/0 00000100:00100000:3.0:1786002522.839624:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23822 00000100:00100000:2.0:1786002522.845842:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002522.845906:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002522.845971:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530874368 00000100:00100000:0.0:1786002522.845980:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530874368 00000100:00100000:0.0:1786002522.846041:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1453 00000100:00100000:0.0:1786002522.846051:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed346568450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:2413:x1872758530874368:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:0.0:1786002522.846065:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002522.846087:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414232 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a916 expref: 40 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.846105:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002522.846110:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002522.846163:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed346568450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+39:2413:x1872758530874368:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 113us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002522.846171:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1453 00000100:00100000:1.0:1786002522.846299:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530874624 00000100:00100000:1.0:1786002522.846303:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530874624 00000100:00100000:1.0:1786002522.846338:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5078 00000100:00100000:1.0:1786002522.846344:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+39:18391:x1872758530874624:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1786002522.846518:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:18391:x1872758530874624:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 173us (685us total) trans 4294983556 rc 0/0 00000100:00100000:1.0:1786002522.846525:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5078 00000100:00100000:1.0:1786002522.856396:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002522.856440:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002522.856537:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530875008 00000100:00100000:0.0:1786002522.856547:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530875008 00000100:00100000:0.0:1786002522.856619:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:0.0:1786002522.856630:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:18391:x1872758530875008:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:0.0:1786002522.856721:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.856733:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.856742:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002522.856772:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560936448:0@lo:101:mdt_io00_000.0 00000100:00100000:0.0:1786002522.856816:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002522.856879:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002522.857375:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530874752 00000100:00100000:3.0:1786002522.857381:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530874752 00000100:00100000:3.0:1786002522.857422:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1454 00000100:00100000:3.0:1786002522.857430:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:2412:x1872758530874752:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:3.0:1786002522.857441:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786002522.857461:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414374 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1538:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a986 expref: 40 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.857495:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af57841424e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1538:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a91d expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002522.857505:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9ed24559f800) 00010000:00010000:3.0:1786002522.857510:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002522.857557:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+38:2412:x1872758530874752:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 127us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002522.857564:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1454 00000100:00080000:1.0:1786002522.857699:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002522.857713:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560936448 00000100:00100000:1.0:1786002522.857717:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560936448 00000100:00100000:1.0:1786002522.857762:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000100:00100000:1.0:1786002522.857769:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6533:x1872758560936448:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1786002522.857784:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002522.857799:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414389 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414382 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.857820:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414389 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414382 expref: 18 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.857832:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414389 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414382 expref: 18 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.857838:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed244f15a00) 00010000:00010000:1.0:1786002522.857840:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002522.857842:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fa00, rc 0) 00000100:00100000:1.0:1786002522.857916:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6533:x1872758560936448:12345-0@lo:101:mdt_io00_000.0 Request processed in 147us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002522.857922:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00100000:0.0:1786002522.858230:0:6533:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983531 gen 2 00000004:00080000:0.0:1786002522.858236:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983530 committed transno 4294983531 00000004:00080000:0.0:1786002522.858252:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983531 committed transno 4294983531 00000100:00100000:0.0:1786002522.858264:0:6533:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed370e01f80 x1872758560932352/t4294983532(4294983532) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1786002536 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786002522.858286:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560936448:0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002522.858300:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414389 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.858311:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414389 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002522.858328:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000004:00080000:0.0:1786002522.858346:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1786002522.858380:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560936576:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.858408:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002522.858485:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1786002522.866972:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560936576 00000100:00100000:2.0:1786002522.866984:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560936576 00000100:00100000:2.0:1786002522.867173:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:2.0:1786002522.867185:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6533:x1872758560936576:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002522.867314:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6533:x1872758560936576:12345-0@lo:1000:mdt_io00_000.0 Request processed in 131us (8905us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002522.867387:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560936576:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.867457:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560936704:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.867490:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002522.867533:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab900 going to sleep for 11 seconds 00000100:00100000:3.0:1786002522.872063:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560936704 00000100:00100000:3.0:1786002522.872077:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560936704 00000100:00100000:2.0:1786002522.873369:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00100000:3.0:1786002522.875084:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:3.0:1786002522.875160:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6533:x1872758560936704:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002522.877115:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6533:x1872758560936704:12345-0@lo:1000:mdt_io00_000.0 Request processed in 1960us (9619us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002522.877125:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00000100:00100000:0.0:1786002522.883176:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560936704:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.883262:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560936832:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.883369:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002522.883472:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1786002522.889399:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560936832 00000100:00100000:2.0:1786002522.889412:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560936832 00000100:00100000:2.0:1786002522.889531:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:2.0:1786002522.889543:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:6533:x1872758560936832:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002522.889692:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:6533:x1872758560936832:12345-0@lo:1000:mdt_io00_000.0 Request processed in 151us (6322us total) trans 0 rc 1/1 00000100:00100000:2.0:1786002522.889702:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:0.0:1786002522.889798:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560936832:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.889912:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560936960:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.889948:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002522.896325:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab900 going to sleep for 11 seconds 00000100:00100000:3.0:1786002522.908287:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560936960 00000100:00100000:3.0:1786002522.908303:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560936960 00000100:00100000:3.0:1786002522.908359:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:3.0:1786002522.908369:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6533:x1872758560936960:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002522.908482:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+18:6533:x1872758560936960:12345-0@lo:1000:mdt_io00_000.0 Request processed in 114us (18533us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002522.908490:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000100:00100000:0.0:1786002522.908774:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560936960:0@lo:1000:mdt_io00_000.0 00010000:00010000:0.0:1786002522.908865:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.908875:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.908890:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002522.908909:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560937088:0@lo:101:mdt_io00_000.0 00000100:00100000:0.0:1786002522.908944:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002522.908983:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002522.909793:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560937088 00000100:00100000:2.0:1786002522.909800:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560937088 00000100:00100000:2.0:1786002522.909874:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:2.0:1786002522.909883:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+18:6533:x1872758560937088:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1786002522.909895:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002522.909909:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578414397 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414390 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.909933:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578414397 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414390 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.909948:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578414397 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414390 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.909956:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002522.909960:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.909963:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a200, rc 0) 00000100:00100000:2.0:1786002522.910010:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:6533:x1872758560937088:12345-0@lo:101:mdt_io00_000.0 Request processed in 128us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002522.910017:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00100000:0.0:1786002522.910185:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560937088:0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002522.910200:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414397 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.910212:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414397 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002522.910228:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1786002522.910253:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.910260:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.910268:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002522.910294:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560937216:0@lo:101:mdt_io00_000.0 00000100:00100000:0.0:1786002522.910320:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002522.910348:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002522.910362:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560937216 00000100:00100000:0.0:1786002522.910365:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560937216 00000100:00100000:0.0:1786002522.910384:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:0.0:1786002522.910391:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:6533:x1872758560937216:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002522.910399:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002522.910409:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af5784143a5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841439e expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.910423:0:15596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.910433:0:15596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af5784143a5 lrc: 4/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841439e expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.910447:0:15596:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1786002522.910473:0:15596:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1786002522.910505:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af5784143a5 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841439e expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.910512:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9ed245fed700) 00010000:00010000:0.0:1786002522.910514:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002522.910518:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af5784143a5 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841439e expref: 20 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.910524:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34600, rc 0) 00000100:00100000:0.0:1786002522.910554:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+20:6533:x1872758560937216:12345-0@lo:101:mdt_io00_000.0 Request processed in 163us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002522.910560:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00100000:0.0:1786002522.910831:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560937216:0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002522.910842:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.910871:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.912634:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841421d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414224 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002522.912651:0:6499:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841421d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414224 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.912684:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841421d lrc: 2/0,0 mode: --/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414224 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.912690:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002522.912717:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af57841421d lrc: 0/0,0 mode: --/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414224 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002522.912736:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983556 is committed 00000100:00100000:3.0:1786002522.912765:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560937344:0@lo:103:jbd2/dm-0-8.0 00000001:00080000:0.0:1786002522.912782:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983539 is committed 00000100:00100000:3.0:1786002522.912818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786002522.912869:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.912882:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.912888:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.912896:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002522.912900:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.912906:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.912919:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9ed245fed700) 00010000:00010000:2.0:1786002522.912922:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.912926:0:3630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af5784143a5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841439e expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.912938:0:3630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af5784143a5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af57841439e expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.912946:0:3630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af5784143a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af57841439e expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002522.912961:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560937344 00000100:00100000:0.0:1786002522.912968:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560937344 00010000:00010000:2.0:1786002522.912972:0:3630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af5784143a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841439e expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002522.912989:0:3630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3630:1872758560937472:0@lo:105: 00000100:00100000:2.0:1786002522.913019:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002522.913039:0:3630:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002522.913061:0:17237:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1786002522.913073:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560937472 00000100:00100000:2.0:1786002522.913077:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560937472 00000100:00100000:0.0:1786002522.913113:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:0.0:1786002522.913128:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+14:3647:x1872758560937344:12345-0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1786002522.913129:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00010000:00010000:0.0:1786002522.913143:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1786002522.913152:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f498c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3630:x1872758560937472:12345-0@lo:105: 00010000:00010000:0.0:1786002522.913162:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414224 lrc: 0/0,0 mode: --/PW res: [0x240000401:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841421d expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913165:0:17237:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913186:0:17237:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913196:0:17237:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.913196:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xd5:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:0.0:1786002522.913208:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002522.913209:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913219:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913228:0:17237:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002522.913242:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+13:3647:x1872758560937344:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 119us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002522.913249:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00010000:00010000:2.0:1786002522.913252:0:17237:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f35c00) 00000100:00100000:2.0:1786002522.913289:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f498c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3630:x1872758560937472:12345-0@lo:105: Request processed in 149us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002522.913296:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1786002522.913343:0:3630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3630:1872758560937472:0@lo:105: 00010000:00010000:2.0:1786002522.913359:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913367:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414208 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002522.913375:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560937344:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1786002522.913395:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af57841420f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913404:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af57841420f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913410:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af57841420f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.913416:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913417:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ac00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002522.913423:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af57841420f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.913435:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913436:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af57841420f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913456:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9ed24559f800) 00010000:00010000:2.0:1786002522.913460:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.913463:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af57841420f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002522.913466:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1786002522.913471:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af57841420f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1538:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913484:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913491:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414216 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913498:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913504:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002522.913506:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35200/0x7cee4af5784143ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913508:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.913525:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35200/0x7cee4af5784143ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913526:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414216 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913546:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f600) 00010000:00010000:0.0:1786002522.913548:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35200/0x7cee4af5784143ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913550:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.913555:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414216 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913563:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414216 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002522.913570:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560937600:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1786002522.913581:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414271 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913590:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414271 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913597:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414271 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002522.913601:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786002522.913610:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002522.913613:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414271 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913619:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414271 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913630:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xdcc87686 (ffff9ed2456eff00) 00010000:00010000:2.0:1786002522.913648:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.913650:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414271 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913656:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414271 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002522.913661:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1786002522.913672:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841429b lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913679:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841429b lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913684:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841429b lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913688:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002522.913690:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841429b lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913694:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841429b lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913700:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xbc0ca3a9 (ffff9ed24559f900) 00010000:00010000:2.0:1786002522.913716:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.913718:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841429b lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913722:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841429b lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913733:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784142c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913738:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784142c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913743:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784142c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913747:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ea00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002522.913749:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784142c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913778:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784142c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913793:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x391d5834 (ffff9ed244f15200) 00010000:00010000:2.0:1786002522.913795:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.913797:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784142c5 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913803:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784142c5 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913815:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784142ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913820:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784142ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913825:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784142ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913830:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002522.913832:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784142ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913837:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784142ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913843:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x18618557 (ffff9ed245fedd00) 00010000:00010000:2.0:1786002522.913875:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.913878:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784142ef lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913882:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784142ef lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913894:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414319 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913900:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414319 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913905:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414319 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913908:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002522.913910:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414319 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913915:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414319 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913924:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xb62e0cbf (ffff9ed24559f200) 00010000:00010000:2.0:1786002522.913925:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.913928:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414319 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913933:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414319 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913941:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414343 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913946:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414343 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913950:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414343 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913955:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002522.913957:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414343 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913961:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414343 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913966:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x84832a57 (ffff9ed245fedc00) 00010000:00010000:2.0:1786002522.913968:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.913971:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414343 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.913977:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414343 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002522.914077:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560937600 00000100:00100000:1.0:1786002522.914083:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560937600 00000100:00100000:3.0:1786002522.919427:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:2.0:1786002522.919477:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:6533:x1872758560937600:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1786002522.919502:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002522.919527:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784143b3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784143ac expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.919568:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784143b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784143ac expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.919583:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784143b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784143ac expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.919591:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9ed24559f000) 00010000:00010000:2.0:1786002522.919594:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1786002522.919598:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b400, rc 0) 00000100:00100000:2.0:1786002522.919730:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560937600:12345-0@lo:101:mdt_io00_000.0 Request processed in 288us (6129us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002522.919738:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00000100:00100000:1.0:1786002522.923050:0:6533:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983539 gen 2 00000004:00080000:1.0:1786002522.923060:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983532 committed transno 4294983539 00000004:00080000:1.0:1786002522.923079:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983533 committed transno 4294983539 00000004:00080000:1.0:1786002522.923601:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983534 committed transno 4294983539 00000004:00080000:1.0:1786002522.923610:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983535 committed transno 4294983539 00000004:00080000:1.0:1786002522.923617:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983536 committed transno 4294983539 00000004:00080000:1.0:1786002522.923623:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983537 committed transno 4294983539 00000004:00080000:1.0:1786002522.923630:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983538 committed transno 4294983539 00000004:00080000:1.0:1786002522.923637:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983539 committed transno 4294983539 00000100:00100000:1.0:1786002522.923651:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560937600:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1786002522.923675:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35200/0x7cee4af5784143ac lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784143b3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.923703:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35200/0x7cee4af5784143ac lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784143b3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002522.923722:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1538:0x0] 00000100:00100000:1.0:1786002522.924608:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560937728:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.924671:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.924695:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002522.924798:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560937728 00000100:00100000:3.0:1786002522.924805:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560937728 00000100:00100000:3.0:1786002522.924878:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:3.0:1786002522.924888:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560937728:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002522.924973:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560937728:12345-0@lo:1000:mdt_io00_000.0 Request processed in 86us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002522.924980:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00100000:1.0:1786002522.925636:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560937728:0@lo:1000:mdt_io00_000.0 00000004:00080000:1.0:1786002522.925665:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1538:0x0] 00000100:00100000:1.0:1786002522.925698:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560937856:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.925724:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.925748:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1786002522.925787:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560937856 00000100:00100000:0.0:1786002522.925793:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560937856 00000100:00100000:0.0:1786002522.925830:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:0.0:1786002522.925838:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560937856:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.925937:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560937856:12345-0@lo:1000:mdt_io00_000.0 Request processed in 99us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002522.925944:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00100000:1.0:1786002522.926640:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560937856:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.929359:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560937984:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1786002522.930307:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.930347:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8000 going to sleep for 11 seconds 00000100:00100000:2.0:1786002522.930590:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560937984 00000100:00100000:2.0:1786002522.930598:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560937984 00000100:00100000:2.0:1786002522.930658:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:2.0:1786002522.930668:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560937984:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1786002522.935834:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560937984:12345-0@lo:403:mdt_io00_000.0 Request processed in 5160us (5521us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002522.935867:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00000100:00100000:1.0:1786002522.936231:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560937984:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1786002522.938054:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938112:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.938107:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.938887:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1786002522.944840:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560938112 00000100:00100000:0.0:1786002522.944881:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560938112 00000100:00100000:0.0:1786002522.944996:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:0.0:1786002522.945007:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938112:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.945119:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938112:12345-0@lo:1000:mdt_io00_000.0 Request processed in 113us (7011us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002522.945126:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00100000:1.0:1786002522.945222:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938112:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.945281:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938240:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.945316:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.956376:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1786002522.963245:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560938240 00000100:00100000:2.0:1786002522.963259:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560938240 00000100:00100000:2.0:1786002522.963457:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:2.0:1786002522.963468:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938240:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002522.963592:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938240:12345-0@lo:1000:mdt_io00_000.0 Request processed in 125us (18275us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002522.963599:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00100000:1.0:1786002522.963718:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938240:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.964324:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938368:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1786002522.964364:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.964393:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8000 going to sleep for 11 seconds 00000100:00100000:1.0:1786002522.964408:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560938368 00000100:00100000:1.0:1786002522.964411:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560938368 00000100:00100000:1.0:1786002522.964433:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:1.0:1786002522.964439:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938368:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1786002522.970340:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938368:12345-0@lo:403:mdt_io00_000.0 Request processed in 5893us (5967us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002522.970352:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00100000:0.0:1786002522.970644:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938368:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1786002522.974366:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938496:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.974431:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.974468:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8600 going to sleep for 11 seconds 00000100:00100000:2.0:1786002522.975230:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560938496 00000100:00100000:2.0:1786002522.975237:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560938496 00000100:00100000:2.0:1786002522.975285:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:2.0:1786002522.975293:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938496:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002522.975386:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938496:12345-0@lo:1000:mdt_io00_000.0 Request processed in 93us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002522.975393:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00100000:1.0:1786002522.975472:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938496:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.975519:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938624:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.975553:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.975572:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8600 going to sleep for 11 seconds 00000100:00100000:3.0:1786002522.975671:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560938624 00000100:00100000:3.0:1786002522.975675:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560938624 00000100:00100000:3.0:1786002522.975703:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:3.0:1786002522.975709:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938624:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002522.975780:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938624:12345-0@lo:1000:mdt_io00_000.0 Request processed in 70us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002522.975785:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000100:00100000:2.0:1786002522.976076:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938624:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002522.976117:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938752:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002522.976155:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002522.976178:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002522.976272:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560938752 00000100:00100000:3.0:1786002522.976276:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560938752 00000100:00100000:3.0:1786002522.976303:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000100:00100000:3.0:1786002522.976308:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938752:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002522.976362:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938752:12345-0@lo:1000:mdt_io00_000.0 Request processed in 53us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002522.976367:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00000100:00100000:0.0:1786002522.976426:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938752:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.976456:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938880:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.976480:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002522.976499:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002522.976553:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560938880 00000100:00100000:3.0:1786002522.976557:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560938880 00000100:00100000:3.0:1786002522.976582:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:3.0:1786002522.976587:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938880:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002522.976629:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560938880:12345-0@lo:1000:mdt_io00_000.0 Request processed in 42us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002522.976635:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00100000:0.0:1786002522.976732:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560938880:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.976770:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560939008:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.976791:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002522.976812:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1786002522.976824:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560939008 00000100:00100000:0.0:1786002522.976827:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560939008 00000100:00100000:0.0:1786002522.976842:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:0.0:1786002522.976870:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560939008:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.976914:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560939008:12345-0@lo:1000:mdt_io00_000.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002522.976920:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:0.0:1786002522.976940:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560939008:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.977474:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560939136:0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1786002522.977501:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002522.977514:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcf840 going to sleep for 11 seconds 00000100:00100000:0.0:1786002522.977525:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560939136 00000100:00100000:0.0:1786002522.977528:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560939136 00000100:00100000:1.0:1786002522.977663:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:1.0:1786002522.977672:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560939136:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1786002522.982861:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560939136:12345-0@lo:403:mdt_io00_000.0 Request processed in 5169us (5336us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002522.982874:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00100000:0.0:1786002522.983252:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560939136:0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1786002522.983982:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560939264:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002522.984024:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002522.984048:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002522.984654:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560939264 00000100:00100000:2.0:1786002522.984661:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560939264 00000100:00100000:2.0:1786002522.984708:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:2.0:1786002522.984717:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560939264:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002522.984799:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560939264:12345-0@lo:1000:mdt_io00_000.0 Request processed in 83us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002522.984806:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00000100:00100000:1.0:1786002522.984884:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560939264:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.984951:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560939392:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.984976:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.985058:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1786002522.986456:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560939392 00000100:00100000:3.0:1786002522.986464:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560939392 00000100:00100000:1.0:1786002522.990391:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560939520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002522.990455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.990523:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560939520 00000100:00100000:1.0:1786002522.990530:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560939520 00000100:00100000:1.0:1786002522.990592:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1786002522.990601:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758560939520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002522.990626:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002522.990666:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758560939520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002522.990672:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00080000:1.0:1786002522.990690:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002522.990719:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560939520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786002522.990860:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:2.0:1786002522.990871:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560939392:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002522.990930:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560939392:12345-0@lo:1000:mdt_io00_000.0 Request processed in 62us (5953us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002522.990936:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000100:00100000:1.0:1786002522.991040:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002522.991047:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560939648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002522.991072:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.991101:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560939648 00000100:00100000:1.0:1786002522.991106:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560939648 00000100:00100000:1.0:1786002522.991132:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1786002522.991149:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560939648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786002522.991160:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17055168 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002522.991191:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560939648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002522.991197:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00080000:1.0:1786002522.991211:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002522.991231:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560939648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002522.991257:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560939392:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.991305:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560939776:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.991329:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.991346:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2456d89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002522.991360:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560939776 00000100:00100000:1.0:1786002522.991363:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560939776 00000100:00100000:1.0:1786002522.991384:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:1.0:1786002522.991390:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560939776:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002522.991436:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6533:x1872758560939776:12345-0@lo:1000:mdt_io00_000.0 Request processed in 45us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002522.991442:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00100000:1.0:1786002522.991467:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560939776:0@lo:1000:mdt_io00_000.0 00000040:00080000:1.0:1786002522.992438:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].413, 2464 off618744 00000040:00080000:1.0:1786002522.992498:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].413, 2544 off667912 00000004:00080000:1.0:1786002522.992505:0:6533:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed2456d86c0 with version 790 00000004:00080000:1.0:1786002522.992521:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 790 rpc_version 790 00000020:00100000:1.0:1786002522.992717:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002522.992725:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2423fad80 x1872758560940032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002522.992743:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560940032:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002522.992793:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002522.992819:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d480 going to sleep for 11 seconds 00000100:00100000:2.0:1786002522.996189:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560940032 00000100:00100000:2.0:1786002522.996201:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560940032 00000100:00100000:2.0:1786002522.996263:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:2.0:1786002522.996272:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:7466:x1872758560940032:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002522.997012:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:7466:x1872758560940032:12345-0@lo:1000:osp_up0-1.0 Request processed in 740us (4217us total) trans 4294983557 rc 0/0 00000100:00100000:2.0:1786002522.997020:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00100000:1.0:1786002522.997304:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560940032:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1786002522.997399:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784143ba lrc: 3/0,1 mode: --/PW res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.997415:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784143ba lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.997427:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784143ba lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.997448:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.997455:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.997461:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.997495:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.997503:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002522.997512:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002522.997529:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e03800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560940160:0@lo:101:mdt_io00_000.0 00000100:00100000:0.0:1786002522.997575:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002522.997603:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002522.999246:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560940160 00000100:00100000:2.0:1786002522.999254:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560940160 00000100:00100000:2.0:1786002522.999287:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1786002522.999295:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6533:x1872758560940160:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1786002522.999312:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002522.999329:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af5784143cf lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784143c8 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.999358:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af5784143cf lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784143c8 expref: 15 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.999370:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af5784143cf lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784143c8 expref: 15 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002522.999378:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f200) 00010000:00010000:2.0:1786002522.999381:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002522.999385:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2be00, rc 0) 00000100:00100000:2.0:1786002522.999437:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:6533:x1872758560940160:12345-0@lo:101:mdt_io00_000.0 Request processed in 143us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002522.999443:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000100:00100000:1.0:1786002522.999526:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e03800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6533:1872758560940160:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1786002522.999552:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784143cf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999563:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784143cf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002522.999588:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046798412 reply state 00000000ce54aa03 transno 4294968526 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999601:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999608:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed351207c00) 00010000:00010000:1.0:1786002522.999610:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002522.999613:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002522.999619:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784143cf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999627:0:6533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784143cf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002522.999637:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00000004:00010000:1.0:1786002522.999646:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046798412 reply state 00000000ce54aa03 transno 4294968526 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784143ba lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999660:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784143ba lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999667:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed351207600) 00010000:00010000:1.0:1786002522.999669:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002522.999671:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1786002522.999680:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x1538:0x0] 00010000:00010000:1.0:1786002522.999686:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35200/0x7cee4af5784143ac lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784143b3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999693:0:6533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35200/0x7cee4af5784143ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784143b3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002522.999700:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1786002522.999706:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414397 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999714:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414397 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999721:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414397 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999758:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786002522.999763:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1786002522.999768:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999775:0:6533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002522.999785:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1786002522.999789:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414389 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999796:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414389 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999802:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414389 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999819:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786002522.999874:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002522.999881:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414397 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999888:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002522.999893:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414397 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002522.999902:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414397 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999928:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414397 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999935:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002522.999954:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414397 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999967:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af578414390 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414397 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999979:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002522.999983:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414389 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002522.999990:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002522.999994:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414389 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002523.000001:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414389 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.000016:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414389 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.000022:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002523.000029:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414389 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.000036:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af578414382 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414389 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.000049:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002523.000051:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002523.000052:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002523.000094:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18391:x1872758530875008:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 143464us (143706us total) trans 4294968526 rc 0/0 00000100:00100000:1.0:1786002523.000102:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00010000:00010000:2.0:1786002523.000253:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002523.000394:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560940288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002523.000429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.000473:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786002523.000480:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560940416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002523.000501:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.011264:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560940288 00000100:00100000:2.0:1786002523.011278:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560940288 00000100:00100000:3.0:1786002523.011497:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560940416 00000100:00100000:3.0:1786002523.011501:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560940416 00000100:00100000:3.0:1786002523.011536:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1786002523.011546:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+16:3646:x1872758560940288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002523.011562:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002523.011585:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578414397 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414390 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.011605:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002523.011610:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002523.011637:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1786002523.011676:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+15:3646:x1872758560940288:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (11246us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.011682:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1786002523.011705:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+14:3646:x1872758560940416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002523.011714:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002523.011725:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414389 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414382 expref: 14 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.011736:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed244f15a00) 00010000:00010000:3.0:1786002523.011744:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002523.011918:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+13:3646:x1872758560940416:12345-0@lo:103:ldlm_bl.0 Request processed in 273us (11416us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.011925:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:0.0:1786002523.012016:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560940416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002523.012028:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560940288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002523.012269:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002523.012335:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530875136 00000100:00100000:2.0:1786002523.012339:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530875136 00000100:00100000:2.0:1786002523.012379:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23823 00000100:00100000:2.0:1786002523.012387:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18391:x1872758530875136:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002523.012405:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002523.012420:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af5784143d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a98d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.012473:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784143dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.012486:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784143dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.012495:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784143dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002523.012534:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:2.0:1786002523.012537:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786002523.012619:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784143dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.012642:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af5784143d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a98d expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.012657:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784143dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a98d expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.012665:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002523.012668:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786002523.012671:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2ac00, rc 0) 00000100:00100000:2.0:1786002523.012716:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18391:x1872758530875136:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 330us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.012722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23823 00000100:00100000:2.0:1786002523.034898:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002523.034971:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530875392 00000100:00100000:0.0:1786002523.034980:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530875392 00000100:00100000:0.0:1786002523.035037:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23824 00000100:00100000:0.0:1786002523.035047:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18391:x1872758530875392:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1786002523.035065:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002523.035084:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784143e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a994 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.035169:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784143eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.035184:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784143eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.035195:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784143eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.035207:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.035216:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af5784143a5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841439e expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.035224:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.035255:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af5784143a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af57841439e expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.035269:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560940544:0@lo:104: 00000100:00100000:0.0:1786002523.035309:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.035366:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002523.035545:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560940544 00000100:00100000:2.0:1786002523.035549:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560940544 00000100:00100000:2.0:1786002523.035598:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:2.0:1786002523.035606:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10360:x1872758560940544:12345-0@lo:104: 00010000:00010000:2.0:1786002523.035618:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.035678:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786002523.035684:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10360:x1872758560940544:12345-0@lo:104: Request processed in 80us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.035691:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00010000:00010000:3.0:1786002523.035745:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002523.035764:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.035777:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35c00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002523.035782:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002523.035791:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.035815:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.035821:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002523.035844:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.035869:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35c00/0x7cee4af57841439e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784143a5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.035888:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002523.035889:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002523.035891:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002523.036035:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560940544:0@lo:104: 00010000:00010000:1.0:1786002523.036053:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.036273:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002523.036292:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560940672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002523.036320:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.036393:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560940672 00000100:00100000:3.0:1786002523.036397:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560940672 00010000:00010000:3.0:1786002523.036415:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af5784143a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af57841439e expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.036443:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:3.0:1786002523.036449:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3645:x1872758560940672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002523.036460:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1786002523.038562:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983557 is committed 00010000:00010000:3.0:1786002523.039048:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af5784143a5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af57841439e expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.039065:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9ed245fed700) 00010000:00010000:3.0:1786002523.039070:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.039079:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.039206:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.039239:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002523.039460:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.039469:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002523.039593:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560940800:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786002523.039633:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.039667:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d480 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.040465:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3645:x1872758560940672:12345-0@lo:103:ldlm_bl.0 Request processed in 4014us (4141us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.040475:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00100000:0.0:1786002523.041500:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560940800 00000100:00100000:0.0:1786002523.041508:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560940800 00000100:00100000:0.0:1786002523.041564:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:0.0:1786002523.041573:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:10360:x1872758560940800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786002523.041661:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:10360:x1872758560940800:12345-0@lo:1000:mdt00_003.0 Request processed in 89us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002523.041668:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:00100000:3.0:1786002523.043731:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10360:1872758560940800:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1786002523.043804:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784143f9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043818:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784143f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043828:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784143f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043843:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784143eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043869:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784143eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043875:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784143eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043881:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784143eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043887:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.043890:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784143eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043897:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784143eb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043907:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002523.043910:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.043914:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784143eb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043920:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784143eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043933:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043939:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043944:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043949:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.043952:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043957:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043962:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9ed245fed700) 00010000:00010000:3.0:1786002523.043965:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.043967:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.043972:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784143f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.044012:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784143e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a994 expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.044024:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784143f9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a994 expref: 16 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.044031:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed245fed300) 00010000:00010000:3.0:1786002523.044033:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002523.044035:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ce00, rc 0) 00000100:00100000:3.0:1786002523.044112:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18391:x1872758530875392:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 9067us (9223us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.044120:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23824 00000100:00100000:2.0:1786002523.049425:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560940672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002523.050069:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002523.051724:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.051799:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530875648 00000100:00100000:3.0:1786002523.051808:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530875648 00000100:00100000:3.0:1786002523.051878:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23825 00000100:00100000:3.0:1786002523.051887:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18391:x1872758530875648:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002523.051907:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002523.051927:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578414400 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a99b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002523.052067:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00010000:00010000:3.0:1786002523.052154:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578414400 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a99b expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.052168:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed351207600) 00010000:00010000:3.0:1786002523.052171:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002523.052176:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578414400 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a99b expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.052194:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d400, rc 0) 00000100:00100000:3.0:1786002523.052252:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:18391:x1872758530875648:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 365us (533us total) trans 4294968527 rc 301/301 00000100:00100000:3.0:1786002523.052258:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23825 00000100:00100000:3.0:1786002523.064415:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002523.064531:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530875776 00000100:00100000:1.0:1786002523.064540:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530875776 00000100:00100000:1.0:1786002523.064608:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23826 00000100:00100000:1.0:1786002523.064618:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:18391:x1872758530875776:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002523.064641:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002523.064661:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af57841440e lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9a2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.064713:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414415 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.064726:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414415 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.064738:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414415 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002523.064789:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xd2:0x0]: returning size 4096 00000004:00200000:1.0:1786002523.064794:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:1.0:1786002523.064825:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f000/0x7cee4af57841440e lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9a2 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.064843:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414415 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9a2 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.064891:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed351207c00) 00010000:00010000:1.0:1786002523.064895:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002523.064898:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fe00, rc 0) 00000100:00100000:1.0:1786002523.064953:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:18391:x1872758530875776:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 337us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.064961:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23826 00000100:00100000:0.0:1786002523.075146:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.075349:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530875904 00000100:00100000:3.0:1786002523.075359:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530875904 00000100:00100000:3.0:1786002523.075422:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23827 00000100:00100000:3.0:1786002523.075432:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18391:x1872758530875904:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002523.075452:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002523.075470:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841441c lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9a9 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.075525:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414423 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.075539:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af5784143cf lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784143c8 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.075547:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414423 lrc: 4/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.075588:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af5784143cf lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af5784143c8 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.075604:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560940928:0@lo:104: 00000100:00100000:3.0:1786002523.075648:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.075686:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.075744:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560940928 00000100:00100000:1.0:1786002523.075758:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560940928 00000100:00100000:1.0:1786002523.075792:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1786002523.075798:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10360:x1872758560940928:12345-0@lo:104: 00010000:00010000:1.0:1786002523.075809:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784143cf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.075885:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786002523.075891:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10360:x1872758560940928:12345-0@lo:104: Request processed in 94us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.075897:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00010000:00010000:1.0:1786002523.075914:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002523.075920:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784143cf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.075928:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002523.075933:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af5784143cf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002523.075942:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af5784143cf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.075965:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784143cf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.075971:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002523.075987:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784143cf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.075994:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34e00/0x7cee4af5784143c8 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784143cf expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.076009:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002523.076010:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002523.076012:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002523.076018:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002523.076027:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560941056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002523.076066:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.076102:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560941056 00000100:00100000:1.0:1786002523.076106:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560941056 00010000:00010000:1.0:1786002523.076121:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af5784143cf lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af5784143c8 expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002523.076150:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:1.0:1786002523.076157:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3644:x1872758560941056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002523.076166:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786002523.076715:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10360:1872758560940928:0@lo:104: 00010000:00010000:3.0:1786002523.076732:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414423 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.076844:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af5784143cf lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af5784143c8 expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.076890:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f200) 00010000:00010000:1.0:1786002523.076895:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414423 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.076903:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414423 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.076910:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414423 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.076926:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002523.076956:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3644:x1872758560941056:12345-0@lo:103:ldlm_bl.0 Request processed in 799us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.076963:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00000100:00100000:1.0:1786002523.076989:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560941056:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002523.077639:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414423 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.077648:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414423 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002523.077689:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd5:0x0]: returning size 4096 00000004:00200000:3.0:1786002523.077693:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1786002523.077731:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841441c lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9a9 expref: 18 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.077764:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414423 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9a9 expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.077773:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f200) 00010000:00010000:3.0:1786002523.077777:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002523.077779:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c600, rc 0) 00000100:00100000:3.0:1786002523.077832:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18391:x1872758530875904:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 2401us (2704us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.077839:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23827 00000100:00100000:2.0:1786002523.091885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.091966:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530876032 00000100:00100000:3.0:1786002523.091975:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530876032 00000100:00100000:3.0:1786002523.092029:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23828 00000100:00100000:3.0:1786002523.092046:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:18391:x1872758530876032:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002523.092068:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002523.092096:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af57841442a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9b0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.092161:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578414431 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.092175:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578414431 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.092187:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578414431 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002523.092265:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00000004:00200000:3.0:1786002523.092270:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:3.0:1786002523.092289:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578414431 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.092311:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af57841442a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9b0 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.092339:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578414431 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9b0 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.092348:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed351207600) 00010000:00010000:3.0:1786002523.092351:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002523.092354:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8de00, rc 0) 00000100:00100000:3.0:1786002523.092410:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18391:x1872758530876032:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 371us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.092417:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23828 00000100:00100000:1.0:1786002523.113725:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.119210:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530876160 00000100:00100000:3.0:1786002523.119223:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530876160 00000100:00100000:3.0:1786002523.119293:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5079 00000100:00100000:3.0:1786002523.119303:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18391:x1872758530876160:12345-192.168.203.49@tcp:37:lfs.0 00000100:00100000:2.0:1786002523.126936:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18391:x1872758530876160:12345-192.168.203.49@tcp:37:lfs.0 Request processed in 7623us (13210us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.126949:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5079 00000100:00100000:0.0:1786002523.152006:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.152099:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530876288 00000100:00100000:3.0:1786002523.152109:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530876288 00000100:00100000:3.0:1786002523.152167:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5080 00000100:00100000:3.0:1786002523.152176:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18391:x1872758530876288:12345-192.168.203.49@tcp:37:lfs.0 00000100:00100000:2.0:1786002523.177395:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18391:x1872758530876288:12345-192.168.203.49@tcp:37:lfs.0 Request processed in 25198us (25375us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.177412:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5080 00000100:00100000:0.0:1786002523.231199:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.231324:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530876416 00000100:00100000:3.0:1786002523.231333:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530876416 00000100:00100000:3.0:1786002523.231400:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23829 00000100:00100000:3.0:1786002523.231410:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18391:x1872758530876416:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:3.0:1786002523.231477:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414438 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231492:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414438 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231504:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414438 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231518:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841443f lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231525:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841443f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231532:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841443f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231578:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414446 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231586:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231591:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002523.231632:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231645:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414438 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231656:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414438 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231662:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414438 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231668:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414438 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231674:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.231678:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414438 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231685:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414438 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231695:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f200) 00010000:00010000:3.0:1786002523.231698:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.231702:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414438 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231708:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414438 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231725:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841443f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231730:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841443f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231736:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841443f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231741:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.231743:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841443f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231761:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841443f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231768:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x84832a57 (ffff9ed245fed700) 00010000:00010000:3.0:1786002523.231770:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.231773:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841443f lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231779:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841443f lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231792:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414446 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231798:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414446 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231803:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414446 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231809:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.231811:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414446 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231816:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414446 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231825:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9ed245fed000) 00010000:00010000:3.0:1786002523.231827:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.231830:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414446 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.231834:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414446 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.231946:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18391:x1872758530876416:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 536us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.231953:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23829 00000100:00100000:0.0:1786002523.247715:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.248261:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530876672 00000100:00100000:3.0:1786002523.248271:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530876672 00000100:00100000:3.0:1786002523.248328:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23830 00000100:00100000:3.0:1786002523.248338:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18391:x1872758530876672:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002523.248356:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002523.249228:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841444d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9b7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.249329:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414454 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.249342:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414454 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.249353:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414454 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002523.249364:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153e:0x0]: returning size 3 00010000:00010000:3.0:1786002523.249716:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841444d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x153e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9b7 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.249737:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414454 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9b7 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.249745:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9ed245fed000) 00010000:00010000:3.0:1786002523.249760:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786002523.249764:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c200, rc 0) 00000100:00100000:3.0:1786002523.249815:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18391:x1872758530876672:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 1479us (2109us total) trans 4294983558 rc 0/0 00000100:00100000:3.0:1786002523.249823:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23830 00000100:00100000:2.0:1786002523.271112:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002523.271408:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530876800 00000100:00100000:1.0:1786002523.271417:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530876800 00000100:00100000:1.0:1786002523.271472:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5195 00000100:00100000:1.0:1786002523.271482:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2413:x1872758530876800:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:1.0:1786002523.271523:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.271543:0:14686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 10 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.271551:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9ca:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786002523.271555:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786002523.271560:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.271590:0:14686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 10 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.271616:0:14686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 10 pid: 14687 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002523.271631:0:14686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14686:1872758560941184:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002523.271711:0:14686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.276561:0:14686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14686:1872758560941184:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002523.276590:0:14686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.284201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002523.284330:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530876928 00000100:00100000:0.0:1786002523.284339:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530876928 00002000:00100000:0.0:1786002523.284392:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9ca:0x0] (0->2) req@ffff9ed2455f0380 x1872758530876928/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:204/0 lens 496/0 e 0 to 0 dl 1786002534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002523.284404:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455f0380 with x1872758530876928 ext(0->2) 00010000:00010000:0.0:1786002523.284413:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 11 pid: 14687 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.284431:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 11 pid: 14687 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002523.284440:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed2455f0380 00000100:00100000:0.0:1786002523.284468:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 0 00000100:00100000:0.0:1786002523.284478:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530876928:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002523.286416:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2413:x1872758530876928:12345-192.168.203.49@tcp:4:bash.0 Request processed in 1931us (2216us total) trans 4294969882 rc 0/0 00000100:00100000:0.0:1786002523.286427:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 0 00002000:00100000:0.0:1786002523.286437:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9ca:0x0] (0->2) req@ffff9ed2455f0380 x1872758530876928/t4294969882(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:204/0 lens 496/448 e 0 to 0 dl 1786002534 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002523.286452:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455f0380 with x1872758530876928 ext(0->2) 00010000:00010000:0.0:1786002523.286459:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 13 pid: 14687 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.286475:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 13 pid: 14687 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002523.286482:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed2455f0380 00000100:00100000:0.0:1786002523.308267:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.308393:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530877056 00000100:00100000:3.0:1786002523.308401:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530877056 00010000:00010000:3.0:1786002523.308436:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 13 pid: 14687 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.308474:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1656 00000100:00100000:3.0:1786002523.308483:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed346569850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2410:x1872758530877056:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002523.308497:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786002523.308513:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb size from disk: 0 -> 3 00002000:00010000:3.0:1786002523.308516:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb mtime from disk: 0 -> 1786002522 00002000:00010000:3.0:1786002523.308518:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb ctime from disk: 0 -> 1786002522 00002000:00010000:3.0:1786002523.308520:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9ca:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1786002523.308526:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 13 pid: 14687 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.308544:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 13 pid: 14687 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.308566:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff0b44b5/0x7cee4af578414358 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a978 expref: 13 pid: 14687 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.308582:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002523.308586:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002523.308591:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.308600:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.308639:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002523.308691:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed346569850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2410:x1872758530877056:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 208us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.308698:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1656 00010000:00010000:1.0:1786002523.308876:0:14686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.308886:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.308906:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.308913:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.308921:0:14686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.308927:0:14686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002523.308931:0:14686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.308939:0:14686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.308951:0:14686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.308963:0:14686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da9092e7/0x7cee4af578414462 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002523.309014:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530876800:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 37533us (37910us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.309022:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5195 00000100:00100000:2.0:1786002523.320322:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002523.320353:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002523.320392:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.320494:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530877312 00000100:00100000:3.0:1786002523.320504:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530877312 00000100:00100000:3.0:1786002523.320565:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530877184 00000100:00100000:3.0:1786002523.320568:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530877184 00000100:00100000:3.0:1786002523.320579:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530877440 00000100:00100000:3.0:1786002523.320581:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530877440 00000100:00100000:3.0:1786002523.320594:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1458 00000100:00100000:3.0:1786002523.320603:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758530877312:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:3.0:1786002523.320618:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002523.320642:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414423 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9a9 expref: 19 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.320663:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24559f200) 00010000:00010000:3.0:1786002523.320672:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002523.320718:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2412:x1872758530877312:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 115us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.320725:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1458 00000100:00100000:3.0:1786002523.320741:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1459 00000100:00100000:3.0:1786002523.320757:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758530877184:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:3.0:1786002523.320767:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002523.320779:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af578414431 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9b0 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.320790:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed351207600) 00010000:00010000:3.0:1786002523.320793:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002523.320809:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530877184:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 62us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.320815:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1459 00000100:00100000:3.0:1786002523.320827:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1460 00000100:00100000:3.0:1786002523.320833:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2412:x1872758530877440:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:3.0:1786002523.320840:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002523.320875:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414415 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9a2 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.320893:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed351207c00) 00010000:00010000:3.0:1786002523.320896:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002523.320911:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758530877440:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 79us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.320917:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1460 00000100:00100000:2.0:1786002523.326298:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002523.326382:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530877696 00000100:00100000:0.0:1786002523.326391:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530877696 00000100:00100000:0.0:1786002523.326445:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:0.0:1786002523.326455:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18391:x1872758530877696:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:0.0:1786002523.326504:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002523.326526:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af57841434a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a971 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.326547:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9ed245fed000) 00010000:00010000:0.0:1786002523.326552:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002523.326573:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414469 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.326585:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414469 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.326594:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414469 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002523.326618:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00000100:00100000:0.0:1786002523.326665:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560941312:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.326711:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.326741:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.327075:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560941312 00000100:00100000:3.0:1786002523.327080:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560941312 00000100:00100000:3.0:1786002523.327116:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:3.0:1786002523.327123:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560941312:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002523.327213:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560941312:12345-0@lo:1000:mdt_io00_002.0 Request processed in 90us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.327220:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000100:00100000:2.0:1786002523.327422:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560941312:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002523.327990:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245511f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560941440:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1786002523.328025:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.328052:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.328240:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560941440 00000100:00100000:1.0:1786002523.328245:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560941440 00000100:00100000:1.0:1786002523.328286:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:1.0:1786002523.328294:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560941440:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1786002523.334322:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560941440:12345-0@lo:403:mdt_io00_002.0 Request processed in 6020us (6287us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.334336:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000100:00100000:3.0:1786002523.344262:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560941440:0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1786002523.345541:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560941568:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.345601:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.345640:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.345831:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560941568 00000100:00100000:3.0:1786002523.345837:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560941568 00000100:00100000:3.0:1786002523.345897:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:3.0:1786002523.345906:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560941568:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002523.345977:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560941568:12345-0@lo:1000:mdt_io00_002.0 Request processed in 71us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.345984:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:0.0:1786002523.346523:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560941568:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1786002523.346579:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.346589:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.346599:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.346706:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560941696:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1786002523.346734:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.346767:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.347214:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560941696 00000100:00100000:1.0:1786002523.347219:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560941696 00000100:00100000:1.0:1786002523.347257:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:1.0:1786002523.347266:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560941696:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002523.347335:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002523.347351:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578414477 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414470 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.347761:0:20598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 2/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.347774:0:20598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578414477 lrc: 4/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414470 expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.347793:0:20598:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1786002523.347818:0:20598:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:1.0:1786002523.348736:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578414477 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414470 expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.348757:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed351207c00) 00010000:00010000:1.0:1786002523.348761:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.348765:0:20598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578414477 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414470 expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.348773:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e200, rc 0) 00000100:00100000:1.0:1786002523.348822:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6535:x1872758560941696:12345-0@lo:101:mdt_io00_002.0 Request processed in 1557us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.348830:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00100000:0.0:1786002523.348935:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560941696:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1786002523.348950:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 4/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.348958:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 4/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.361841:0:7451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35200/0x7cee4af5784143ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784143b3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.361990:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784143ba lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362004:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784143ba lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362012:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784143ba lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362018:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002523.362021:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784143ba lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362028:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784143ba lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362051:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed351207600) 00010000:00010000:2.0:1786002523.362055:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002523.362058:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784143ba lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362064:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784143ba lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362084:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362213:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362218:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362223:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002523.362226:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362232:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362240:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed351207c00) 00010000:00010000:2.0:1786002523.362243:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002523.362249:0:3631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578414477 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414470 expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362259:0:3631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578414477 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578414470 expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362267:0:3631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578414477 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578414470 expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.362363:0:3631:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578414477 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414470 expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.362429:0:3631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3631:1872758560941824:0@lo:105: 00000100:00100000:2.0:1786002523.362489:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.362525:0:3631:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.362595:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560941824 00000100:00100000:1.0:1786002523.362716:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560941824 00000100:00100000:1.0:1786002523.362781:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1786002523.362790:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:3631:x1872758560941824:12345-0@lo:105: 00010000:00010000:1.0:1786002523.362802:0:17237:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 5/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.362811:0:17237:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 5/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.362819:0:17237:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 5/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.362826:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 5/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.362833:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.362840:0:17237:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.362879:0:17237:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f35000) 00000100:00100000:1.0:1786002523.362918:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:3631:x1872758560941824:12345-0@lo:105: Request processed in 129us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.362924:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1786002523.362955:0:3631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3631:1872758560941824:0@lo:105: 00010000:00010000:1.0:1786002523.362971:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.362979:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784143c1 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.363365:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.363428:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002523.363455:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:3.0:1786002523.363485:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.363492:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.363500:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.363514:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560941952:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1786002523.363544:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.363567:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b3ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.363764:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560941952 00000100:00100000:1.0:1786002523.363769:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560941952 00000100:00100000:1.0:1786002523.363803:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00100000:1.0:1786002523.363811:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:6535:x1872758560941952:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002523.363825:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002523.363840:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414485 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841447e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.363889:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414485 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841447e expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.363900:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414485 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841447e expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.363907:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x84832a57 (ffff9ed245ddcd00) 00010000:00010000:1.0:1786002523.363910:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.363912:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fe00, rc 0) 00000100:00100000:1.0:1786002523.363940:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560941952:12345-0@lo:101:mdt_io00_002.0 Request processed in 130us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.363946:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000004:00010000:0.0:1786002523.364067:0:7451:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35200/0x7cee4af5784143ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784143b3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.364191:0:7451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35200/0x7cee4af5784143ac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784143b3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.364199:0:7451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002523.364222:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35200/0x7cee4af5784143ac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784143b3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002523.364236:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968527 is committed 00000001:00080000:0.0:1786002523.364248:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968525 is committed 00000100:00100000:2.0:1786002523.364437:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002523.364448:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560942080:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1786002523.364478:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.364564:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560941952:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1786002523.364576:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414485 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.364586:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414485 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002523.364598:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:3.0:1786002523.364730:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841448c lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.364739:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841448c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.364757:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841448c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.364773:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414493 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.364780:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414493 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.364786:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414493 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.364822:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.364833:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414454 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9b7 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.364840:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.364888:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414454 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9b7 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.364901:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414454 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9b7 expref: 17 pid: 6522 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.364912:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6535:1872758560942208:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002523.364961:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b3ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.364973:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560942080 00000100:00100000:3.0:1786002523.364977:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560942080 00000100:00100000:3.0:1786002523.365008:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1786002523.365015:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3647:x1872758560942080:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1786002523.365023:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002523.365035:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784143b3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1538:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784143ac expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.365046:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1538:0x0].0x0 (ffff9ed24559f000) 00010000:00010000:3.0:1786002523.365052:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002523.365079:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758560942080:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 65us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.366778:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1786002523.366826:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560942080:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1786002523.371168:0:6535:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@00000000c55ff1a8 x1872758560942208) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414454 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9b7 expref: 17 pid: 6522 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.371193:0:6535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414454 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9b7 expref: 17 pid: 6522 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.371215:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414454 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9b7 expref: 17 pid: 6522 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.371234:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6535:1872758560942208:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002523.371252:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9ed245fed000) 00010000:00010000:3.0:1786002523.371257:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.371266:0:6535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.371273:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.371291:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.371298:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.371304:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.371439:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560942336:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002523.371495:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.371524:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d000 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.371694:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560942336 00000100:00100000:0.0:1786002523.371700:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560942336 00000100:00100000:0.0:1786002523.371745:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:0.0:1786002523.371765:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560942336:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.371902:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560942336:12345-0@lo:1000:mdt_io00_002.0 Request processed in 137us (406us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786002523.371910:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00100000:3.0:1786002523.373167:0:6535:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968525 gen 2 00000004:00080000:3.0:1786002523.373175:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968518 committed transno 4294968525 00000004:00080000:3.0:1786002523.373189:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968519 committed transno 4294968525 00000004:00080000:3.0:1786002523.373196:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968520 committed transno 4294968525 00000004:00080000:3.0:1786002523.373204:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968521 committed transno 4294968525 00000004:00080000:3.0:1786002523.373212:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968522 committed transno 4294968525 00000004:00080000:3.0:1786002523.373218:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968523 committed transno 4294968525 00000004:00080000:3.0:1786002523.373225:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968524 committed transno 4294968525 00000004:00080000:3.0:1786002523.373232:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968525 committed transno 4294968525 00000020:00080000:3.0:1786002523.373238:0:6535:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed245d3f6c0 refcount 2 committed 0 result 0 batchid 406 00000020:00080000:3.0:1786002523.373241:0:6535:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455dfa00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d3f480 00000020:00080000:3.0:1786002523.373245:0:6535:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].400 00000020:00080000:3.0:1786002523.373247:0:6535:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455df500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed243125400 00000020:00080000:3.0:1786002523.373250:0:6535:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].401 00000100:00100000:3.0:1786002523.373270:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560942336:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002523.373312:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560942464:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002523.373341:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.373365:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7de40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.373545:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560942464 00000100:00100000:1.0:1786002523.373550:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560942464 00000100:00100000:1.0:1786002523.373586:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:1.0:1786002523.373594:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560942464:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.373670:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560942464:12345-0@lo:1000:mdt_io00_002.0 Request processed in 76us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.373676:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00100000:2.0:1786002523.373785:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560942464:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002523.373906:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560942592:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002523.373932:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.373946:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.373991:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560942592 00000100:00100000:1.0:1786002523.373995:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560942592 00000100:00100000:1.0:1786002523.374029:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:1.0:1786002523.374035:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560942592:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.374093:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560942592:12345-0@lo:1000:mdt_io00_002.0 Request processed in 58us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.374102:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00100000:1.0:1786002523.374125:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560942592:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.374192:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560942720:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.374216:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.374229:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d480 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.374239:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560942720 00000100:00100000:1.0:1786002523.374243:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560942720 00000100:00100000:1.0:1786002523.374260:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:1.0:1786002523.374265:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560942720:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.374306:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560942720:12345-0@lo:1000:mdt_io00_002.0 Request processed in 40us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.374311:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:1.0:1786002523.374333:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560942720:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.374358:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560942848:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.374756:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.374778:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d480 going to sleep for 11 seconds 00000100:00100000:2.0:1786002523.374823:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560942848 00000100:00100000:2.0:1786002523.374827:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560942848 00000100:00100000:2.0:1786002523.374867:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:2.0:1786002523.374874:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560942848:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002523.374918:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560942848:12345-0@lo:1000:mdt_io00_002.0 Request processed in 45us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.374925:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:1.0:1786002523.375274:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560942848:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.375327:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560942976:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.375350:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.375371:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d480 going to sleep for 11 seconds 00000100:00100000:2.0:1786002523.375465:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560942976 00000100:00100000:2.0:1786002523.375469:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560942976 00000100:00100000:2.0:1786002523.375499:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1786002523.375505:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6535:x1872758560942976:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002523.375570:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6535:x1872758560942976:12345-0@lo:1000:mdt_io00_002.0 Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.375576:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000020:00080000:0.0:1786002523.375659:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 406 committed batchid 405 00000020:00080000:0.0:1786002523.375709:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 405 00000100:00100000:3.0:1786002523.379348:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560942976:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1786002523.379759:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].402, 1264 off601960 00000040:00080000:3.0:1786002523.379808:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].401, 1344 off651744 00000100:00100000:3.0:1786002523.379841:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d33480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560943104:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002523.379922:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.379944:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d000 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.380054:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560943104 00000100:00100000:1.0:1786002523.380060:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560943104 00000100:00100000:1.0:1786002523.380109:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:1.0:1786002523.380117:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6535:x1872758560943104:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.380226:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6535:x1872758560943104:12345-0@lo:1000:mdt_io00_002.0 Request processed in 109us (303us total) trans 4294969883 rc 0/0 00000100:00100000:1.0:1786002523.380233:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1786002523.381498:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d33480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560943104:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1786002523.381508:0:6535:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed24362d3c0 with version 767 00000004:00080000:0.0:1786002523.383834:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 767 rpc_version 767 00000020:00100000:0.0:1786002523.383904:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002523.383913:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244bb8a80 x1872758560943360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3344/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002523.383934:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560943360:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002523.383996:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.384018:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.385805:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560943360 00000100:00100000:1.0:1786002523.385816:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560943360 00000100:00100000:1.0:1786002523.385901:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:1.0:1786002523.385911:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b579050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560943360:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002523.386647:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b579050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560943360:12345-0@lo:1000:osp_up1-0.0 Request processed in 736us (2649us total) trans 4294968528 rc 0/0 00000100:00100000:1.0:1786002523.386656:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:0.0:1786002523.386971:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560943360:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1786002523.387057:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adf26861 reply state 00000000f47cbb8d transno 4294983559 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387077:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387093:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9ed245fed000) 00010000:00010000:3.0:1786002523.387097:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1786002523.387100:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002523.387107:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841448c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387114:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841448c lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387127:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841448c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387133:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.387144:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841448c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387151:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841448c lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387161:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed245fedb00) 00010000:00010000:3.0:1786002523.387163:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.387166:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841448c lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387172:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841448c lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002523.387193:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adf26861 reply state 00000000f47cbb8d transno 4294983559 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414493 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387200:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414493 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387205:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x84832a57 (ffff9ed245fed400) 00010000:00010000:3.0:1786002523.387207:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002523.387209:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1786002523.387215:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:3.0:1786002523.387222:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387235:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387241:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387261:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002523.387265:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:3.0:1786002523.387270:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414485 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387277:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414485 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002523.387288:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00010000:00010000:3.0:1786002523.387294:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414469 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387299:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414469 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387305:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414469 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387311:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.387313:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414469 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387319:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414469 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387326:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed351207000) 00010000:00010000:3.0:1786002523.387328:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.387330:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414469 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.387336:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414469 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.387416:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18391:x1872758530877696:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 60961us (61124us total) trans 4294983559 rc 0/0 00000100:00100000:3.0:1786002523.387423:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1 00010000:00010000:1.0:1786002523.389534:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002523.389544:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.389556:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002523.389562:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002523.389571:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.389608:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.389615:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1786002523.389669:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1786002523.389826:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.389839:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414470 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414477 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.389880:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002523.389882:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002523.389884:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002523.397228:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002523.398243:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530877824 00000100:00100000:1.0:1786002523.398253:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530877824 00000100:00100000:1.0:1786002523.398310:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23831 00000100:00100000:1.0:1786002523.398320:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18391:x1872758530877824:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:1.0:1786002523.398393:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784144a1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398408:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784144a1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398419:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784144a1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398429:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784144a8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398435:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784144a8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398441:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784144a8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398490:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398498:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398505:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002523.398544:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398556:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784144a1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398562:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784144a1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398568:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784144a1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398574:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784144a1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398579:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002523.398583:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784144a1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398589:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784144a1 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398600:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed245ddc000) 00010000:00010000:1.0:1786002523.398603:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.398606:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784144a1 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398612:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784144a1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398627:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784144a8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398632:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784144a8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398638:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784144a8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398643:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002523.398646:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784144a8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398652:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784144a8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398658:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xdcc87686 (ffff9ed245ddc700) 00010000:00010000:1.0:1786002523.398660:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.398663:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784144a8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398668:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784144a8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398678:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398683:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398689:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398693:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002523.398696:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398701:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398706:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9ed2456efc00) 00010000:00010000:1.0:1786002523.398708:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.398710:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144af lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.398715:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002523.398799:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18391:x1872758530877824:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 478us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.398807:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23831 00000100:00100000:0.0:1786002523.403537:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560943488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002523.403900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.411455:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560943488 00000100:00100000:1.0:1786002523.411468:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560943488 00000100:00100000:0.0:1786002523.414009:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.415150:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530878080 00000100:00100000:3.0:1786002523.415159:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530878080 00000100:00100000:3.0:1786002523.415205:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23832 00000100:00100000:3.0:1786002523.415213:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18391:x1872758530878080:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002523.415231:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002523.415249:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784144b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9be expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.415344:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af5784144bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.415387:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af5784144bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.415402:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af5784144bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002523.415415:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1539:0x0]: returning size 2 00010000:00010000:3.0:1786002523.415501:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784144b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1539:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9be expref: 21 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.415522:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af5784144bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9be expref: 20 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.415529:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9ed2456efc00) 00010000:00010000:3.0:1786002523.415531:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786002523.415534:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c200, rc 0) 00000100:00100000:3.0:1786002523.415628:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18391:x1872758530878080:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 414us (1626us total) trans 4294983560 rc 0/0 00000100:00100000:3.0:1786002523.415633:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23832 00000100:00100000:2.0:1786002523.417513:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:2.0:1786002523.417524:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3646:x1872758560943488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002523.417537:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002523.417554:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af578414477 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414470 expref: 8 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.417570:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed351207c00) 00010000:00010000:2.0:1786002523.417578:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002523.417818:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1872758560943488:12345-0@lo:103:ldlm_bl.0 Request processed in 294us (13917us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.417825:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:0.0:1786002523.417949:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560943488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002523.431458:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.431559:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530878208 00000100:00100000:3.0:1786002523.431567:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530878208 00000100:00100000:3.0:1786002523.431626:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5196 00000100:00100000:3.0:1786002523.431636:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758530878208:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:3.0:1786002523.431674:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.431691:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.431710:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9c7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786002523.431713:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002523.431717:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.431770:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.431785:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 9 pid: 8435 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.431800:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1872758560943616:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002523.431894:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d180 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.438004:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1872758560943616:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002523.438046:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.439092:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002523.439243:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530878336 00000100:00100000:1.0:1786002523.439251:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530878336 00002000:00100000:1.0:1786002523.439302:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9c7:0x0] (0->1) req@ffff9ed245510a80 x1872758530878336/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:204/0 lens 496/0 e 0 to 0 dl 1786002534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002523.439312:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245510a80 with x1872758530878336 ext(0->1) 00010000:00010000:1.0:1786002523.439320:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 10 pid: 8435 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.439336:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 10 pid: 8435 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002523.439343:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ed245510a80 00000100:00100000:1.0:1786002523.439379:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1 00000100:00100000:1.0:1786002523.439389:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2410:x1872758530878336:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002523.441537:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2410:x1872758530878336:12345-192.168.203.49@tcp:4:bash.0 Request processed in 2143us (2446us total) trans 4294969879 rc 0/0 00000100:00100000:0.0:1786002523.441548:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1 00002000:00100000:0.0:1786002523.441558:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x9c7:0x0] (0->1) req@ffff9ed245510a80 x1872758530878336/t4294969879(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:204/0 lens 496/448 e 0 to 0 dl 1786002534 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002523.441567:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245510a80 with x1872758530878336 ext(0->1) 00010000:00010000:0.0:1786002523.441576:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 12 pid: 8435 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.441592:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 12 pid: 8435 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002523.441599:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ed245510a80 00000100:00100000:2.0:1786002523.453495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002523.453683:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530878464 00000100:00100000:0.0:1786002523.453691:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530878464 00010000:00010000:0.0:1786002523.453725:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 12 pid: 8435 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.453814:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1657 00000100:00100000:0.0:1786002523.453825:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2413:x1872758530878464:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002523.453841:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786002523.453871:0:10399:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:0.0:1786002523.453875:0:10399:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb mtime from disk: 0 -> 1786002522 00002000:00010000:0.0:1786002523.453877:0:10399:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb ctime from disk: 0 -> 1786002522 00002000:00010000:0.0:1786002523.453880:0:10399:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9c7:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1786002523.453886:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 12 pid: 8435 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.453900:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 12 pid: 8435 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.453920:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af578414286 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a932 expref: 12 pid: 8435 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.453935:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786002523.453940:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786002523.453946:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.453956:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.453996:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002523.454049:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530878464:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 226us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002523.454057:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1657 00010000:00010000:1.0:1786002523.454117:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.454127:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.454154:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.454162:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.454170:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.454177:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002523.454181:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.454194:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.454205:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.454212:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce8c6497/0x7cee4af5784144cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002523.454263:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758530878208:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 22629us (22814us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.454281:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5196 00000100:00100000:2.0:1786002523.469631:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002523.469702:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530878720 00000100:00100000:1.0:1786002523.469712:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530878720 00000100:00100000:1.0:1786002523.469773:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:1.0:1786002523.469783:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18391:x1872758530878720:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:1.0:1786002523.469832:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002523.469883:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578414278 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1539:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a92b expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.469901:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9ed2456efc00) 00010000:00010000:1.0:1786002523.469906:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002523.469927:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144d2 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.469945:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144d2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.469954:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144d2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002523.469971:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00000100:00100000:1.0:1786002523.470018:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e02d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560943744:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.470074:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.470111:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3412543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.470286:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560943744 00000100:00100000:3.0:1786002523.470291:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560943744 00000100:00100000:3.0:1786002523.470323:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:3.0:1786002523.470330:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560943744:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002523.470413:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560943744:12345-0@lo:1000:mdt_io00_000.0 Request processed in 82us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.470420:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00100000:0.0:1786002523.470577:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e02d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560943744:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.471125:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560943872:0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1786002523.471256:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.471337:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.471872:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560943872 00000100:00100000:3.0:1786002523.471878:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560943872 00000100:00100000:3.0:1786002523.471924:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:3.0:1786002523.471934:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560943872:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1786002523.473499:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560943872:12345-0@lo:403:mdt_io00_000.0 Request processed in 1563us (2238us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.473511:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00100000:0.0:1786002523.474243:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560943872:0@lo:403:mdt_io00_000.0 00010000:00010000:0.0:1786002523.475262:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.475638:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.475650:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.475671:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944000:0@lo:101:mdt_io00_000.0 00000100:00100000:0.0:1786002523.475716:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.475743:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.476858:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560944000 00000100:00100000:1.0:1786002523.476868:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560944000 00000100:00100000:1.0:1786002523.476921:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:1.0:1786002523.476929:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560944000:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1786002523.476944:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002523.476961:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f800/0x7cee4af5784144e0 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784144d9 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.476986:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f800/0x7cee4af5784144e0 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784144d9 expref: 8 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.476998:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f800/0x7cee4af5784144e0 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784144d9 expref: 8 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.477006:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245ddc000) 00010000:00010000:1.0:1786002523.477009:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.477013:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f800, rc 0) 00000100:00100000:1.0:1786002523.477062:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6533:x1872758560944000:12345-0@lo:101:mdt_io00_000.0 Request processed in 133us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.477068:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000100:00100000:0.0:1786002523.478079:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944000:0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002523.478097:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784144e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478108:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784144e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002523.478128:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:0.0:1786002523.478168:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478175:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478183:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.478198:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944128:0@lo:101:mdt_io00_000.0 00000100:00100000:0.0:1786002523.478227:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.478254:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.478270:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560944128 00000100:00100000:0.0:1786002523.478274:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560944128 00000100:00100000:0.0:1786002523.478307:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:0.0:1786002523.478314:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:6533:x1872758560944128:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002523.478324:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002523.478336:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784144ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784144e7 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478351:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784144ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784144e7 expref: 9 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478362:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784144ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784144e7 expref: 9 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478368:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xdcc87686 (ffff9ed351207900) 00010000:00010000:0.0:1786002523.478372:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002523.478374:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:0.0:1786002523.478400:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560944128:12345-0@lo:101:mdt_io00_000.0 Request processed in 86us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002523.478407:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:0.0:1786002523.478429:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944128:0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002523.478438:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784144ee expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478446:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784144ee expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002523.478455:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:0.0:1786002523.478470:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784144f5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478477:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784144f5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478485:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784144f5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478495:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784144fc lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478501:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784144fc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478507:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784144fc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478549:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478573:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af5784144bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9be expref: 19 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478581:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478601:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af5784144bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9be expref: 19 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.478621:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af5784144bd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9be expref: 19 pid: 10360 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.478632:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6533:1872758560944256:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002523.478683:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002523.479017:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.479364:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530878848 00000100:00100000:3.0:1786002523.479370:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530878848 00000100:00100000:1.0:1786002523.479465:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 511 00000100:00100000:1.0:1786002523.479476:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758530878848:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002523.479519:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758530878848:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 45us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.479526:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 511 00010000:00010000:0.0:1786002523.483422:0:6533:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@00000000a07f751b x1872758560944256) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af5784144bd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9be expref: 19 pid: 10360 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.483447:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af5784144bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9be expref: 19 pid: 10360 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.483469:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af5784144bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1539:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9be expref: 19 pid: 10360 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.483488:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6533:1872758560944256:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002523.483507:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9ed2456efc00) 00010000:00010000:0.0:1786002523.483512:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.483521:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.483529:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.483548:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.483568:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.483575:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.483701:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944384:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.483759:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.483793:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.483885:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560944384 00000100:00100000:3.0:1786002523.483892:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560944384 00000100:00100000:3.0:1786002523.483943:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:3.0:1786002523.483952:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560944384:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.484154:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560944384:12345-0@lo:1000:mdt_io00_000.0 Request processed in 203us (405us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786002523.484162:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00100000:3.0:1786002523.484900:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944384:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002523.484942:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944512:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002523.484967:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.484990:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.486771:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560944512 00000100:00100000:1.0:1786002523.486782:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560944512 00000100:00100000:1.0:1786002523.486840:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:1.0:1786002523.486885:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560944512:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.486985:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560944512:12345-0@lo:1000:mdt_io00_000.0 Request processed in 136us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.486993:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00100000:3.0:1786002523.487027:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944512:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002523.487158:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944640:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002523.487191:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.487223:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.487285:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560944640 00000100:00100000:1.0:1786002523.487290:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560944640 00000100:00100000:1.0:1786002523.487319:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:1.0:1786002523.487325:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560944640:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.487381:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560944640:12345-0@lo:1000:mdt_io00_000.0 Request processed in 47us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.487388:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00100000:1.0:1786002523.487413:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944640:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.487490:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e01500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944768:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.487516:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.487534:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560944768 00000100:00100000:1.0:1786002523.487537:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560944768 00000100:00080000:1.0:1786002523.487553:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002523.487574:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:1.0:1786002523.487580:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6533:x1872758560944768:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.487633:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6533:x1872758560944768:12345-0@lo:1000:mdt_io00_000.0 Request processed in 53us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.487640:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00100000:1.0:1786002523.487654:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed342bf66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.487666:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e01500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944768:0@lo:1000:mdt_io00_000.0 00000040:00080000:1.0:1786002523.488343:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].403, 1264 off603224 00000040:00080000:1.0:1786002523.488480:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].402, 1344 off653088 00000100:00100000:1.0:1786002523.488505:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e01500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944896:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.488533:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.489814:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002523.491145:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560944896 00000100:00100000:2.0:1786002523.491155:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560944896 00000100:00100000:2.0:1786002523.491213:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:2.0:1786002523.491223:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6533:x1872758560944896:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002523.491407:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6533:x1872758560944896:12345-0@lo:1000:mdt_io00_000.0 Request processed in 184us (2871us total) trans 4294969880 rc 0/0 00000100:00100000:2.0:1786002523.491415:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000100:00100000:0.0:1786002523.493990:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e01500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560944896:0@lo:1000:mdt_io00_000.0 00000004:00080000:0.0:1786002523.494005:0:6533:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed2456d8d80 with version 768 00000004:00080000:3.0:1786002523.494069:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 768 rpc_version 768 00000020:00100000:3.0:1786002523.494104:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002523.494112:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244d32680 x1872758560945152/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002523.494133:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560945152:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002523.494185:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.494215:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d180 going to sleep for 11 seconds 00000100:00100000:2.0:1786002523.494316:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560945152 00000100:00100000:2.0:1786002523.494322:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560945152 00000100:00100000:2.0:1786002523.494380:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:2.0:1786002523.494390:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560945152:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002523.494737:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560945152:12345-0@lo:1000:osp_up1-0.0 Request processed in 347us (550us total) trans 4294968529 rc 0/0 00000100:00100000:2.0:1786002523.494745:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00100000:0.0:1786002523.494868:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560945152:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1786002523.495401:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087c2962b reply state 00000000128fe9a4 transno 4294983561 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495420:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495427:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9ed2456efc00) 00010000:00010000:2.0:1786002523.495430:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1786002523.495434:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002523.495442:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784144f5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495448:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784144f5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495454:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784144f5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495459:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784144f5 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495465:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002523.495469:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784144f5 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495476:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784144f5 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495485:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207100) 00010000:00010000:2.0:1786002523.495487:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002523.495490:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784144f5 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495496:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784144f5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002523.495512:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087c2962b reply state 00000000128fe9a4 transno 4294983561 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784144fc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495520:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784144fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495525:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xdcc87686 (ffff9ed351207800) 00010000:00010000:2.0:1786002523.495527:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002523.495529:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1786002523.495532:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:2.0:1786002523.495539:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784144e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495546:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784144e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495552:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784144e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495577:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002523.495582:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:2.0:1786002523.495587:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784144ee expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495594:0:6533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784144ee expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002523.495607:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00010000:00010000:2.0:1786002523.495613:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144d2 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495619:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144d2 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495625:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144d2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495629:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002523.495632:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144d2 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495637:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144d2 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495644:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed245ddc700) 00010000:00010000:2.0:1786002523.495646:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002523.495649:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144d2 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.495654:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784144d2 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.495736:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18391:x1872758530878720:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 25952us (26112us total) trans 4294983561 rc 0/0 00000100:00100000:2.0:1786002523.495759:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 2 00010000:00010000:0.0:1786002523.495814:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002523.495820:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784144e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.495826:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002523.495830:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784144e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002523.495837:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784144e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.495882:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784144e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.495888:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002523.495908:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784144e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.495916:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34c00/0x7cee4af5784144d9 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784144e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.495918:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1786002523.495929:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002523.495931:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002523.495932:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560945280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002523.495933:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002523.495966:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.496476:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560945280 00000100:00100000:0.0:1786002523.496482:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560945280 00000100:00100000:0.0:1786002523.496525:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:0.0:1786002523.496534:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34656bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+10:3645:x1872758560945280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002523.496546:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002523.496562:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f800/0x7cee4af5784144e0 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784144d9 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.496574:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245ddc000) 00010000:00010000:0.0:1786002523.496580:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002523.496630:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34656bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3645:x1872758560945280:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002523.496637:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:0.0:1786002523.496691:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560945280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002523.499322:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560945408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002523.499388:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.499460:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560945408 00000100:00100000:1.0:1786002523.499466:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560945408 00000100:00100000:1.0:1786002523.499522:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:1.0:1786002523.499532:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758560945408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786002523.499566:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444077568 avail 1297838080 00000100:00100000:1.0:1786002523.499621:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758560945408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.499627:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000100:00100000:2.0:1786002523.499687:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983557 gen 2 00000004:00080000:2.0:1786002523.499694:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983557 committed transno 4294983557 00000020:00080000:2.0:1786002523.499699:0:3645:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed2456d8780 refcount 2 committed 0 result 0 batchid 416 00000020:00080000:2.0:1786002523.499707:0:3645:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24540f200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2456d86c0 00000020:00080000:2.0:1786002523.499710:0:3645:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].413 00000020:00080000:2.0:1786002523.499713:0:3645:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24540f500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed243d1ce00 00000020:00080000:2.0:1786002523.499715:0:3645:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].413 00000100:00100000:2.0:1786002523.499770:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560945408:0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1786002523.499815:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 416 committed batchid 415 00000020:00080000:1.0:1786002523.499893:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 415 00000100:00100000:2.0:1786002523.503037:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.503127:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530878976 00000100:00100000:3.0:1786002523.503136:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530878976 00000100:00100000:3.0:1786002523.503194:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23833 00000100:00100000:3.0:1786002523.503204:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18391:x1872758530878976:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:3.0:1786002523.503279:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841450a lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503294:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841450a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503304:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841450a lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503315:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af578414511 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503322:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af578414511 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503328:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af578414511 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503386:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414518 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503395:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503401:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002523.503441:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503456:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841450a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503462:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841450a lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503467:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841450a lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503473:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841450a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503479:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.503484:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841450a lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503490:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841450a lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503501:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed245fedb00) 00010000:00010000:3.0:1786002523.503504:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.503508:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841450a lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503514:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841450a lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503534:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af578414511 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503540:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af578414511 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503545:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af578414511 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503549:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.503552:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af578414511 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503556:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af578414511 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503561:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xb62e0cbf (ffff9ed245fed500) 00010000:00010000:3.0:1786002523.503563:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.503565:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af578414511 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503569:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af578414511 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503577:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503582:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414518 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503586:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414518 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503590:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.503592:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414518 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503600:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414518 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503606:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9ed24559fb00) 00010000:00010000:3.0:1786002523.503608:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.503610:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414518 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.503614:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414518 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.503674:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18391:x1872758530878976:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 471us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.503681:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23833 00000100:00100000:3.0:1786002523.513538:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002523.513877:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530879232 00000100:00100000:1.0:1786002523.513887:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530879232 00000100:00100000:1.0:1786002523.513942:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23834 00000100:00100000:1.0:1786002523.513952:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18391:x1872758530879232:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002523.513970:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002523.513989:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af57841451f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9c5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.514098:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414526 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.514112:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414526 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.514123:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414526 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002523.514226:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153d:0x0]: returning size 2 00010000:00010000:1.0:1786002523.514316:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af57841451f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x153d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9c5 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.514333:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414526 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9c5 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.514341:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9ed24559fb00) 00010000:00010000:1.0:1786002523.514344:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786002523.514347:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fa00, rc 0) 00000100:00100000:1.0:1786002523.514400:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18391:x1872758530879232:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 449us (870us total) trans 4294983562 rc 0/0 00000100:00100000:1.0:1786002523.514407:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23834 00000100:00100000:2.0:1786002523.519224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002523.519457:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530879360 00000100:00100000:0.0:1786002523.519465:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530879360 00000100:00100000:0.0:1786002523.519513:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5197 00000100:00100000:0.0:1786002523.519522:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758530879360:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:0.0:1786002523.519559:0:14691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.519576:0:14691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 10 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.519586:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9c9:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786002523.519590:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786002523.519594:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.519621:0:14691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 10 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.519641:0:14691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 10 pid: 14665 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.519658:0:14691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14691:1872758560945536:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002523.519725:0:14691:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d780 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.524785:0:14691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:14691:1872758560945536:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002523.524820:0:14691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.545232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002523.545364:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530879488 00000100:00100000:0.0:1786002523.545434:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530879488 00002000:00100000:0.0:1786002523.545494:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->1) req@ffff9ed245513100 x1872758530879488/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:204/0 lens 496/0 e 0 to 0 dl 1786002534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002523.545506:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245513100 with x1872758530879488 ext(0->1) 00010000:00010000:0.0:1786002523.545521:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 11 pid: 14665 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.545539:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 11 pid: 14665 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002523.545553:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ed245513100 00000100:00100000:0.0:1786002523.545771:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:0.0:1786002523.545782:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530879488:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002523.548509:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2413:x1872758530879488:12345-192.168.203.49@tcp:4:bash.0 Request processed in 2722us (3279us total) trans 4294969881 rc 0/0 00000100:00100000:0.0:1786002523.548520:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 2 00002000:00100000:0.0:1786002523.548530:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->1) req@ffff9ed245513100 x1872758530879488/t4294969881(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:204/0 lens 496/448 e 0 to 0 dl 1786002534 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002523.548540:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245513100 with x1872758530879488 ext(0->1) 00010000:00010000:0.0:1786002523.548549:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 13 pid: 14665 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.548567:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 13 pid: 14665 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002523.548575:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ed245513100 00000100:00100000:2.0:1786002523.553731:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.553830:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530879616 00000100:00100000:3.0:1786002523.553839:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530879616 00010000:00010000:3.0:1786002523.553905:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 13 pid: 14665 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.553938:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1658 00000100:00100000:3.0:1786002523.553947:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2410:x1872758530879616:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002523.553961:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786002523.553975:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1786002523.553978:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb mtime from disk: 0 -> 1786002522 00002000:00010000:3.0:1786002523.553980:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb ctime from disk: 0 -> 1786002522 00002000:00010000:3.0:1786002523.553982:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9c9:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1786002523.553989:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 13 pid: 14665 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.554004:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 13 pid: 14665 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.554028:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd24d709/0x7cee4af57841432e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a96a expref: 13 pid: 14665 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.554056:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002523.554061:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002523.554068:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.554078:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.554111:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002523.554158:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2410:x1872758530879616:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 212us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.554165:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1658 00010000:00010000:2.0:1786002523.554270:0:14691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.554280:0:14691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.554298:0:14691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.554307:0:14691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.554320:0:14691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.554327:0:14691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002523.554331:0:14691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.554340:0:14691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.554352:0:14691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.554360:0:14691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af578414534 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.554424:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2412:x1872758530879360:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 34902us (35296us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.554432:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5197 00000100:00100000:2.0:1786002523.561691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002523.562915:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530879872 00000100:00100000:0.0:1786002523.562926:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530879872 00000100:00100000:0.0:1786002523.562982:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:0.0:1786002523.562991:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18391:x1872758530879872:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:0.0:1786002523.563046:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002523.563069:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414320 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a963 expref: 22 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.563087:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9ed24559fb00) 00010000:00010000:0.0:1786002523.563092:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002523.563115:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841453b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.563132:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841453b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.563141:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841453b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002523.563159:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00000100:00100000:0.0:1786002523.563207:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560945664:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.563257:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.563336:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.565452:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560945664 00000100:00100000:1.0:1786002523.565460:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560945664 00000100:00100000:1.0:1786002523.565544:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:1.0:1786002523.565552:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560945664:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.565669:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560945664:12345-0@lo:1000:mdt_io00_002.0 Request processed in 117us (2410us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.565676:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:0.0:1786002523.565736:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560945664:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.566273:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560945792:0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1786002523.566307:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.573235:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:2.0:1786002523.573969:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560945792 00000100:00100000:2.0:1786002523.573979:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560945792 00000100:00100000:2.0:1786002523.574029:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:2.0:1786002523.574038:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560945792:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1786002523.575615:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560945792:12345-0@lo:403:mdt_io00_002.0 Request processed in 1572us (9300us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.575626:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:0.0:1786002523.576921:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560945792:0@lo:403:mdt_io00_002.0 00010000:00010000:0.0:1786002523.577574:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.577589:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.577597:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.577615:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560945920:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1786002523.577656:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.577680:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.577701:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560945920 00000100:00100000:0.0:1786002523.577706:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560945920 00000100:00100000:0.0:1786002523.577736:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:0.0:1786002523.577743:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560945920:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1786002523.577768:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002523.577784:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414549 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414542 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.577808:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414549 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414542 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.577821:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414549 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414542 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.577827:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed351207100) 00010000:00010000:0.0:1786002523.577830:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002523.577834:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34600, rc 0) 00000100:00100000:0.0:1786002523.577886:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6535:x1872758560945920:12345-0@lo:101:mdt_io00_002.0 Request processed in 142us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002523.577892:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00100000:0.0:1786002523.577923:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560945920:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1786002523.577935:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414549 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.577945:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414549 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002523.577958:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:0.0:1786002523.577978:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.577984:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.577991:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.578002:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560946048:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1786002523.578024:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.578042:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.578053:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560946048 00000100:00100000:0.0:1786002523.578056:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560946048 00000100:00100000:0.0:1786002523.578073:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:0.0:1786002523.578078:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6535:x1872758560946048:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1786002523.578086:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002523.578096:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578414557 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414550 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578110:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578414557 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414550 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578119:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578414557 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414550 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578126:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xb62e0cbf (ffff9ed351207300) 00010000:00010000:0.0:1786002523.578129:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002523.578131:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35a00, rc 0) 00000100:00100000:0.0:1786002523.578158:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560946048:12345-0@lo:101:mdt_io00_002.0 Request processed in 79us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002523.578164:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00100000:0.0:1786002523.578189:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560946048:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1786002523.578199:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414557 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578207:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414557 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002523.578218:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:0.0:1786002523.578232:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af57841455e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578239:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af57841455e lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578246:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af57841455e lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578255:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414565 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578261:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414565 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578267:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414565 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578302:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578318:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414526 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9c5 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578325:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578347:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414526 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9c5 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.578361:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414526 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9c5 expref: 21 pid: 6520 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.578372:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6535:1872758560946176:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002523.578521:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab300 going to sleep for 11 seconds 00010000:00010000:0.0:1786002523.588278:0:6535:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@0000000096476bf2 x1872758560946176) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414526 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9c5 expref: 21 pid: 6520 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.588304:0:6535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414526 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9c5 expref: 21 pid: 6520 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.588330:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414526 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9c5 expref: 21 pid: 6520 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.588345:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6535:1872758560946176:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002523.588363:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9ed24559fb00) 00010000:00010000:0.0:1786002523.588368:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.588377:0:6535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.588384:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.588406:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.588415:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.588420:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.588536:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560946304:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.588587:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.588613:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab900 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.588638:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560946304 00000100:00100000:0.0:1786002523.588643:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560946304 00000100:00100000:0.0:1786002523.588686:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:0.0:1786002523.588694:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560946304:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.588800:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560946304:12345-0@lo:1000:mdt_io00_002.0 Request processed in 106us (211us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786002523.588808:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00100000:0.0:1786002523.588835:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560946304:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.588949:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560946432:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.588972:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.588983:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab900 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.590251:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560946432 00000100:00100000:1.0:1786002523.590257:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560946432 00000100:00100000:1.0:1786002523.590293:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:1.0:1786002523.590301:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560946432:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.590356:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560946432:12345-0@lo:1000:mdt_io00_002.0 Request processed in 56us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.590362:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00100000:0.0:1786002523.590569:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560946432:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.590654:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560946560:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.590678:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.590702:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed36e7ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1786002523.590772:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560946560 00000100:00100000:2.0:1786002523.590776:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560946560 00000100:00100000:2.0:1786002523.590836:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:2.0:1786002523.590843:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560946560:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002523.590912:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560946560:12345-0@lo:1000:mdt_io00_002.0 Request processed in 69us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.590918:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:0.0:1786002523.590969:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560946560:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.591036:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560946688:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.591058:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.592880:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.596920:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560946688 00000100:00100000:1.0:1786002523.596931:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560946688 00000100:00100000:1.0:1786002523.596991:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:1.0:1786002523.597000:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6535:x1872758560946688:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.597113:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6535:x1872758560946688:12345-0@lo:1000:mdt_io00_002.0 Request processed in 113us (6053us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.597120:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:0.0:1786002523.597231:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560946688:0@lo:1000:mdt_io00_002.0 00000040:00080000:0.0:1786002523.597561:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].404, 1264 off604488 00000040:00080000:0.0:1786002523.597603:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].403, 1344 off654432 00000100:00100000:0.0:1786002523.597639:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560946816:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.597670:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.597689:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.597701:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560946816 00000100:00100000:0.0:1786002523.597704:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560946816 00000100:00100000:0.0:1786002523.597721:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:0.0:1786002523.597726:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6535:x1872758560946816:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.597818:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560946816:12345-0@lo:1000:mdt_io00_002.0 Request processed in 91us (146us total) trans 4294969882 rc 0/0 00000100:00100000:0.0:1786002523.597825:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:0.0:1786002523.597870:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560946816:0@lo:1000:mdt_io00_002.0 00000004:00080000:0.0:1786002523.597880:0:6535:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed36e7ab900 with version 769 00000004:00080000:0.0:1786002523.597890:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 769 rpc_version 769 00000020:00100000:0.0:1786002523.597906:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002523.597912:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed37bc50000 x1872758560947072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002523.597926:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560947072:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002523.597948:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.597959:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.597968:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560947072 00000100:00100000:0.0:1786002523.597971:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560947072 00000100:00100000:0.0:1786002523.597987:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:0.0:1786002523.597992:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7805:x1872758560947072:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002523.598273:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:7805:x1872758560947072:12345-0@lo:1000:osp_up1-0.0 Request processed in 280us (323us total) trans 4294968530 rc 0/0 00000100:00100000:0.0:1786002523.598280:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000100:00100000:0.0:1786002523.598314:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560947072:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1786002523.598342:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da41fdec reply state 00000000987a77b0 transno 4294983563 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598360:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598378:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9ed24559fb00) 00010000:00010000:0.0:1786002523.598381:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1786002523.598384:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002523.598390:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af57841455e lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598401:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af57841455e lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598408:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af57841455e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598415:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002523.598419:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af57841455e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598427:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af57841455e lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598436:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207000) 00010000:00010000:0.0:1786002523.598458:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002523.598462:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af57841455e lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598469:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af57841455e lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002523.598485:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da41fdec reply state 00000000987a77b0 transno 4294983563 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414565 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598492:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414565 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598498:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xb62e0cbf (ffff9ed351207600) 00010000:00010000:0.0:1786002523.598501:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002523.598502:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1786002523.598507:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:0.0:1786002523.598514:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414549 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598522:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414549 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598529:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414549 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598549:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786002523.598552:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:0.0:1786002523.598558:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414557 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598563:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414557 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002523.598573:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00010000:00010000:0.0:1786002523.598578:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841453b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598583:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841453b lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598588:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841453b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598592:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002523.598594:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841453b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598602:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841453b lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598610:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed351207400) 00010000:00010000:0.0:1786002523.598612:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002523.598615:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841453b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.598620:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841453b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.598690:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18391:x1872758530879872:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 35698us (37006us total) trans 4294983563 rc 0/0 00000100:00100000:0.0:1786002523.598697:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00010000:00010000:1.0:1786002523.599203:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002523.599209:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414549 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.599222:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002523.599227:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414549 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002523.599238:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414549 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.599260:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414549 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.599267:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002523.599290:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414549 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.599297:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35600/0x7cee4af578414542 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414549 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.599310:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002523.599312:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002523.599313:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002523.599902:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786002523.599916:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560947200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002523.599951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.600079:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560947200 00000100:00100000:2.0:1786002523.600085:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560947200 00000100:00100000:2.0:1786002523.600127:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:2.0:1786002523.600192:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+12:3647:x1872758560947200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002523.600205:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002523.600219:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414549 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414542 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.600231:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed351207100) 00010000:00010000:2.0:1786002523.600237:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002523.600267:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3647:x1872758560947200:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.600274:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00100000:1.0:1786002523.600333:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560947200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002523.608336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.610831:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530880000 00000100:00100000:3.0:1786002523.610843:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530880000 00000100:00100000:3.0:1786002523.611034:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23835 00000100:00100000:3.0:1786002523.611046:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18391:x1872758530880000:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:3.0:1786002523.611119:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414573 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611236:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414573 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611246:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414573 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611272:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af57841457a lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611293:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af57841457a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611298:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af57841457a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611339:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414581 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611360:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611365:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002523.611404:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611417:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414573 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611423:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414573 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611433:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414573 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611439:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414573 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611445:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.611449:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414573 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611456:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414573 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611467:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed245fed500) 00010000:00010000:3.0:1786002523.611470:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.611474:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414573 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611480:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414573 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611501:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af57841457a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611507:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af57841457a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611513:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af57841457a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611517:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.611521:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af57841457a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611526:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af57841457a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611533:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xbc0ca3a9 (ffff9ed245fedb00) 00010000:00010000:3.0:1786002523.611536:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.611539:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af57841457a lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611545:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af57841457a lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611557:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611562:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414581 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611566:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414581 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611570:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.611573:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414581 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611578:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414581 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611584:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9ed24559f700) 00010000:00010000:3.0:1786002523.611587:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.611590:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414581 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.611594:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414581 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.611673:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18391:x1872758530880000:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 629us (3345us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.611680:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23835 00000100:00100000:2.0:1786002523.617991:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.618223:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530880256 00000100:00100000:3.0:1786002523.618233:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530880256 00000100:00100000:3.0:1786002523.618288:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23836 00000100:00100000:3.0:1786002523.618298:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18391:x1872758530880256:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002523.618316:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002523.618334:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414588 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9cc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.618431:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841458f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.618444:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841458f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.618454:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841458f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002523.618466:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153a:0x0]: returning size 2 00010000:00010000:3.0:1786002523.618555:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414588 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x153a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9cc expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.618575:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841458f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9cc expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.618583:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9ed24559f700) 00010000:00010000:3.0:1786002523.618586:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786002523.618589:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c600, rc 0) 00000100:00100000:3.0:1786002523.618644:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18391:x1872758530880256:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 346us (662us total) trans 4294983564 rc 0/0 00000100:00100000:3.0:1786002523.618650:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23836 00000100:00100000:0.0:1786002523.625720:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002523.625810:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530880384 00000100:00100000:2.0:1786002523.625819:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530880384 00000100:00100000:2.0:1786002523.625899:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5198 00000100:00100000:2.0:1786002523.625909:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2412:x1872758530880384:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:2.0:1786002523.625950:0:14678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.625970:0:14678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.625992:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9c8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786002523.625996:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786002523.626000:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.626028:0:14678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.626045:0:14678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 11 pid: 8434 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.626059:0:14678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14678:1872758560947328:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002523.626433:0:14678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a240 going to sleep for 11 seconds 00000100:00100000:2.0:1786002523.628943:0:14678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14678:1872758560947328:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002523.628982:0:14678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.631702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002523.631967:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530880512 00000100:00100000:2.0:1786002523.631975:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530880512 00002000:00100000:2.0:1786002523.632021:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->1) req@ffff9ed37bc51880 x1872758530880512/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:204/0 lens 496/0 e 0 to 0 dl 1786002534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002523.632032:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37bc51880 with x1872758530880512 ext(0->1) 00010000:00010000:2.0:1786002523.632040:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 12 pid: 8434 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.632056:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 12 pid: 8434 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002523.632065:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed37bc51880 00000100:00100000:2.0:1786002523.632246:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:2.0:1786002523.632258:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530880512:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:2.0:1786002523.634412:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2412:x1872758530880512:12345-192.168.203.49@tcp:4:bash.0 Request processed in 2150us (2709us total) trans 4294969884 rc 0/0 00000100:00100000:2.0:1786002523.634422:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00002000:00100000:2.0:1786002523.634434:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->1) req@ffff9ed37bc51880 x1872758530880512/t4294969884(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:204/0 lens 496/448 e 0 to 0 dl 1786002534 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002523.634444:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37bc51880 with x1872758530880512 ext(0->1) 00010000:00010000:2.0:1786002523.634451:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 14 pid: 8434 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.634466:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 14 pid: 8434 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002523.634472:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed37bc51880 00000100:00100000:0.0:1786002523.643682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.643761:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530880640 00000100:00100000:3.0:1786002523.643770:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530880640 00010000:00010000:3.0:1786002523.643806:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 14 pid: 8434 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.643917:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1659 00000100:00100000:3.0:1786002523.643926:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2412:x1872758530880640:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002523.643941:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786002523.643965:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1786002523.643982:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb mtime from disk: 0 -> 1786002522 00002000:00010000:3.0:1786002523.643984:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb ctime from disk: 0 -> 1786002522 00002000:00010000:3.0:1786002523.643986:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9c8:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1786002523.643992:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 14 pid: 8434 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.644004:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 14 pid: 8434 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.644024:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af5784142b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a940 expref: 14 pid: 8434 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.644049:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002523.644053:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002523.644058:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.644068:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.644109:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002523.644266:0:14678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.644285:0:14678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.644304:0:14678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.644311:0:14678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.644317:0:14678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.644324:0:14678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002523.644327:0:14678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.644334:0:14678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.644345:0:14678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.644351:0:14678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af57841459d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.644427:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758530880640:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 500us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.644436:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1659 00000100:00100000:2.0:1786002523.648514:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530880384:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 22595us (22791us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.648529:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5198 00000100:00100000:2.0:1786002523.663528:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002523.663759:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530880896 00000100:00100000:0.0:1786002523.663769:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530880896 00000100:00100000:0.0:1786002523.663829:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:0.0:1786002523.663839:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18391:x1872758530880896:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:0.0:1786002523.663927:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002523.664234:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784142a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a939 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.664254:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9ed24559f700) 00010000:00010000:0.0:1786002523.664258:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002523.668529:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784145a4 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.668551:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784145a4 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.668564:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784145a4 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002523.668590:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00000100:00100000:1.0:1786002523.668650:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560947456:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.668708:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.668783:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.676442:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560947456 00000100:00100000:0.0:1786002523.676455:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560947456 00000100:00100000:0.0:1786002523.676517:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1786002523.676526:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6533:x1872758560947456:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.676656:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6533:x1872758560947456:12345-0@lo:1000:mdt_io00_000.0 Request processed in 130us (7947us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002523.676663:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:3.0:1786002523.678258:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560947456:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002523.678787:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560947584:0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1786002523.678882:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.678910:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d000 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.680492:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560947584 00000100:00100000:0.0:1786002523.680503:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560947584 00000100:00100000:0.0:1786002523.680558:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:0.0:1786002523.680568:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6533:x1872758560947584:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1786002523.684053:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6533:x1872758560947584:12345-0@lo:403:mdt_io00_000.0 Request processed in 3466us (5187us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002523.684067:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:3.0:1786002523.685406:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560947584:0@lo:403:mdt_io00_000.0 00010000:00010000:3.0:1786002523.686465:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.686478:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.686489:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.686513:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560947712:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1786002523.686565:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.686596:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d000 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.686719:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560947712 00000100:00100000:0.0:1786002523.686727:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560947712 00000100:00100000:0.0:1786002523.686825:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:0.0:1786002523.686836:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6533:x1872758560947712:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002523.686879:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002523.686896:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784145b2 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784145ab expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.686922:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784145b2 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784145ab expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.686935:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784145b2 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784145ab expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.686944:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed351207400) 00010000:00010000:0.0:1786002523.686947:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002523.686962:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35000, rc 0) 00000100:00100000:0.0:1786002523.687001:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:6533:x1872758560947712:12345-0@lo:101:mdt_io00_000.0 Request processed in 168us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002523.687007:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00100000:3.0:1786002523.689162:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560947712:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1786002523.689188:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784145b2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.689201:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784145b2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002523.689223:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:3.0:1786002523.689259:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.689267:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.689275:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.689292:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560947840:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1786002523.689334:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.693840:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d000 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.693977:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560947840 00000100:00100000:1.0:1786002523.693985:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560947840 00000100:00100000:1.0:1786002523.694305:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:1.0:1786002523.694318:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:6533:x1872758560947840:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1786002523.694337:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002523.694360:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ea00/0x7cee4af5784145c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784145b9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.694389:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ea00/0x7cee4af5784145c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784145b9 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.694404:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ea00/0x7cee4af5784145c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784145b9 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.694412:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xbc0ca3a9 (ffff9ed245ddc100) 00010000:00010000:1.0:1786002523.694415:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.694418:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7ea00, rc 0) 00000100:00100000:1.0:1786002523.694480:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560947840:12345-0@lo:101:mdt_io00_000.0 Request processed in 166us (5146us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.694487:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:3.0:1786002523.696077:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560947840:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1786002523.696105:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784145c0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.696122:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784145c0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002523.696264:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:3.0:1786002523.696287:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784145c7 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.696296:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784145c7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.696304:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784145c7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.696315:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784145ce lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.696320:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784145ce lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.696326:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784145ce lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.696367:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.696377:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841458f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9cc expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.696385:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.696416:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841458f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9cc expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.696431:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841458f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9cc expref: 23 pid: 6521 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.696444:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6533:1872758560947968:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002523.696520:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d000 going to sleep for 11 seconds 00010000:00010000:3.0:1786002523.702271:0:6533:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@000000008a150220 x1872758560947968) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841458f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9cc expref: 23 pid: 6521 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.702298:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841458f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9cc expref: 23 pid: 6521 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.702322:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841458f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9cc expref: 23 pid: 6521 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.702343:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6533:1872758560947968:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002523.702364:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9ed24559f700) 00010000:00010000:3.0:1786002523.702369:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.702378:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.702385:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.702407:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.702416:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.702422:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.702552:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560948096:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002523.702605:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.702640:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d180 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.702718:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560948096 00000100:00100000:1.0:1786002523.702725:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560948096 00000100:00100000:1.0:1786002523.702782:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:1.0:1786002523.702791:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560948096:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.702995:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560948096:12345-0@lo:1000:mdt_io00_000.0 Request processed in 204us (388us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002523.703003:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00100000:0.0:1786002523.706254:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fb100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560948096:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.706335:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc53480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560948224:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.706385:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.706469:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786002523.711365:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560948224 00000100:00100000:2.0:1786002523.711377:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560948224 00000100:00100000:2.0:1786002523.711449:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:2.0:1786002523.711459:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560948224:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002523.711569:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560948224:12345-0@lo:1000:mdt_io00_000.0 Request processed in 112us (5183us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.711577:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000100:00100000:1.0:1786002523.711733:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc53480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560948224:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.712019:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560948352:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.712466:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.712493:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002523.712540:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560948352 00000100:00100000:2.0:1786002523.712544:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560948352 00000100:00100000:2.0:1786002523.712601:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:2.0:1786002523.712609:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560948352:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002523.712671:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560948352:12345-0@lo:1000:mdt_io00_000.0 Request processed in 62us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.712677:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00100000:1.0:1786002523.712728:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560948352:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.712819:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560948480:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.712843:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.719442:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed342bf6000 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.719552:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560948480 00000100:00100000:3.0:1786002523.719562:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560948480 00000100:00100000:3.0:1786002523.719617:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:3.0:1786002523.719627:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6533:x1872758560948480:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002523.719738:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6533:x1872758560948480:12345-0@lo:1000:mdt_io00_000.0 Request processed in 112us (6892us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.719755:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:1.0:1786002523.720821:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560948480:0@lo:1000:mdt_io00_000.0 00000040:00080000:1.0:1786002523.721415:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].405, 1264 off605752 00000040:00080000:1.0:1786002523.721468:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].405, 1344 off656704 00000100:00100000:1.0:1786002523.721505:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560948608:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.721549:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.721569:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24362d240 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.721589:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560948608 00000100:00100000:1.0:1786002523.721594:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560948608 00000100:00100000:1.0:1786002523.721626:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:1.0:1786002523.721634:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6533:x1872758560948608:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.721741:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560948608:12345-0@lo:1000:mdt_io00_000.0 Request processed in 107us (190us total) trans 4294969885 rc 0/0 00000100:00100000:1.0:1786002523.721764:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:1.0:1786002523.721798:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560948608:0@lo:1000:mdt_io00_000.0 00000004:00080000:1.0:1786002523.721806:0:6533:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245d3f000 with version 770 00000004:00080000:1.0:1786002523.721956:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 770 rpc_version 770 00000020:00100000:1.0:1786002523.721975:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002523.721982:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed370e02300 x1872758560948864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4080/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002523.721996:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e02300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560948864:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002523.722023:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.722275:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6600 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.722289:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560948864 00000100:00100000:1.0:1786002523.722292:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560948864 00000100:00100000:1.0:1786002523.722312:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:1.0:1786002523.722318:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:7805:x1872758560948864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002523.722630:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:7805:x1872758560948864:12345-0@lo:1000:osp_up1-0.0 Request processed in 311us (604us total) trans 4294968531 rc 0/0 00000100:00100000:1.0:1786002523.722637:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00100000:1.0:1786002523.722673:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e02300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560948864:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1786002523.722705:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b01def6 reply state 000000002e52c246 transno 4294983565 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.722723:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.722732:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9ed24559f700) 00010000:00010000:1.0:1786002523.722735:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1786002523.722738:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002523.722758:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784145c7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.722786:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784145c7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.722792:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784145c7 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.722798:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784145c7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.722804:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002523.722808:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784145c7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.722815:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784145c7 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.722825:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed245fed200) 00010000:00010000:1.0:1786002523.722844:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.722867:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784145c7 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.722884:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784145c7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002523.722905:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b01def6 reply state 000000002e52c246 transno 4294983565 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784145ce lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.722933:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784145ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.722944:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xbc0ca3a9 (ffff9ed245fedf00) 00010000:00010000:1.0:1786002523.723912:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002523.723924:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1786002523.723930:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:1.0:1786002523.723938:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784145b2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.724015:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784145b2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.724021:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784145b2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.724236:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786002523.724243:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:1.0:1786002523.724257:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784145c0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.724270:0:6533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784145c0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002523.724283:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00010000:00010000:1.0:1786002523.724291:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784145a4 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.724297:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784145a4 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.724303:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784145a4 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.724308:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002523.724312:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784145a4 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.724318:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784145a4 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.724330:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed245ddc900) 00010000:00010000:1.0:1786002523.724332:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.724336:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784145a4 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.724341:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784145a4 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002523.724423:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18391:x1872758530880896:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 60582us (60900us total) trans 4294983565 rc 0/0 00000100:00100000:1.0:1786002523.724431:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00010000:00010000:3.0:1786002523.729030:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002523.729107:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784145b2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.729120:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002523.729127:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784145b2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002523.729203:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784145b2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.729253:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784145b2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.729259:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1786002523.729481:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560948992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002523.729539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.729618:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560948992 00000100:00100000:2.0:1786002523.729625:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560948992 00000100:00100000:2.0:1786002523.729678:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:2.0:1786002523.729686:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+14:3647:x1872758560948992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002523.729697:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002523.729714:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784145b2 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784145ab expref: 14 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.729736:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed351207400) 00010000:00010000:2.0:1786002523.729757:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002523.729803:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784145b2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.729812:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c000/0x7cee4af5784145ab lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784145b2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.729828:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002523.729830:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002523.729832:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002523.732970:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+13:3647:x1872758560948992:12345-0@lo:103:ldlm_bl.0 Request processed in 3276us (3422us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.732985:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:0.0:1786002523.735927:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.736076:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530881024 00000100:00100000:3.0:1786002523.736084:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530881024 00000100:00100000:3.0:1786002523.736144:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23837 00000100:00100000:3.0:1786002523.736154:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18391:x1872758530881024:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:3.0:1786002523.736224:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784145dc lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736246:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784145dc lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736255:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784145dc lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736265:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784145e3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736277:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784145e3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736283:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784145e3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736331:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784145ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736338:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784145ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736343:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784145ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002523.736384:0:10360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784145ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736397:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784145dc lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736403:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784145dc lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736409:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784145dc lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736416:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784145dc lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736423:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.736426:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784145dc lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736436:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784145dc lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736447:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed245fed600) 00010000:00010000:3.0:1786002523.736451:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.736455:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784145dc lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736460:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784145dc lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736480:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784145e3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736486:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784145e3 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736492:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784145e3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736497:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.736499:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784145e3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736504:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784145e3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736510:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x391d5834 (ffff9ed245fed100) 00010000:00010000:3.0:1786002523.736512:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.736514:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784145e3 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736521:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af5784145e3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736531:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784145ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736536:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784145ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736542:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784145ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736546:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002523.736548:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784145ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736553:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784145ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736559:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9ed244f15b00) 00010000:00010000:3.0:1786002523.736561:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.736563:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784145ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.736568:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784145ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.736627:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18391:x1872758530881024:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 474us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.736634:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23837 00000100:00100000:1.0:1786002523.738227:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560948992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002523.739911:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.740223:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530881280 00000100:00100000:3.0:1786002523.740231:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530881280 00000100:00100000:3.0:1786002523.740284:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23838 00000100:00100000:3.0:1786002523.740294:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18391:x1872758530881280:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002523.740314:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002523.740333:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af5784145f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9d3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.740431:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af5784145f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.740444:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af5784145f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.740453:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af5784145f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002523.740464:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153b:0x0]: returning size 2 00010000:00010000:3.0:1786002523.740555:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af5784145f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x153b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9d3 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.740574:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af5784145f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9d3 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.740582:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9ed244f15b00) 00010000:00010000:3.0:1786002523.740585:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786002523.740588:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229a00, rc 0) 00000100:00100000:3.0:1786002523.740720:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18391:x1872758530881280:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 427us (812us total) trans 4294983566 rc 0/0 00000100:00100000:3.0:1786002523.740731:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23838 00000100:00100000:0.0:1786002523.755710:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.759016:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530881408 00000100:00100000:3.0:1786002523.759030:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530881408 00000100:00100000:2.0:1786002523.761265:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5199 00000100:00100000:2.0:1786002523.762216:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530881408:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:2.0:1786002523.762260:0:14676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.762289:0:14676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 11 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.762299:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9c8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786002523.762304:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786002523.762309:0:14676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.762340:0:14676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 11 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.762355:0:14676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 11 pid: 8764 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.762378:0:14676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14676:1872758560949120:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002523.762464:0:14676:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a240 going to sleep for 11 seconds 00000100:00100000:2.0:1786002523.769566:0:14676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:14676:1872758560949120:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002523.769595:0:14676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.782711:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002523.783360:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530881536 00000100:00100000:2.0:1786002523.783369:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530881536 00002000:00100000:2.0:1786002523.783421:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->1) req@ffff9ed37bc50380 x1872758530881536/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:204/0 lens 496/0 e 0 to 0 dl 1786002534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002523.783432:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37bc50380 with x1872758530881536 ext(0->1) 00010000:00010000:2.0:1786002523.783441:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 12 pid: 8764 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.783457:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 12 pid: 8764 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002523.783466:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ed37bc50380 00000100:00100000:2.0:1786002523.783494:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:2.0:1786002523.783503:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530881536:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:2.0:1786002523.785920:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2412:x1872758530881536:12345-192.168.203.49@tcp:4:bash.0 Request processed in 2410us (3209us total) trans 4294969883 rc 0/0 00000100:00100000:2.0:1786002523.785930:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00002000:00100000:2.0:1786002523.785940:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->1) req@ffff9ed37bc50380 x1872758530881536/t4294969883(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:204/0 lens 496/448 e 0 to 0 dl 1786002534 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002523.785962:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37bc50380 with x1872758530881536 ext(0->1) 00010000:00010000:2.0:1786002523.785970:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 14 pid: 8764 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.785986:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 14 pid: 8764 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002523.785992:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ed37bc50380 00000100:00100000:0.0:1786002523.803325:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002523.803415:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530881664 00000100:00100000:1.0:1786002523.803425:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530881664 00010000:00010000:1.0:1786002523.803462:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 14 pid: 8764 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002523.803546:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1660 00000100:00100000:1.0:1786002523.803557:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2412:x1872758530881664:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002523.803574:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786002523.803590:0:10399:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:1.0:1786002523.803593:0:10399:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb mtime from disk: 0 -> 1786002522 00002000:00010000:1.0:1786002523.803596:0:10399:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb ctime from disk: 0 -> 1786002522 00002000:00010000:1.0:1786002523.803598:0:10399:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9c8:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1786002523.803604:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 14 pid: 8764 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.803618:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 14 pid: 8764 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.803641:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006411a76d/0x7cee4af5784142da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a94e expref: 14 pid: 8764 timeout: 983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.803656:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786002523.803661:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786002523.803667:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.803677:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.803710:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002523.803774:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758530881664:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 219us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.803782:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1660 00010000:00010000:2.0:1786002523.805079:0:14676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.805093:0:14676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.805113:0:14676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.805119:0:14676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.805127:0:14676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.805145:0:14676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002523.805150:0:14676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.805162:0:14676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.805173:0:14676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.805183:0:14676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093568eb/0x7cee4af578414606 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.805250:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2413:x1872758530881408:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 43040us (49545us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.805257:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5199 00000100:00100000:0.0:1786002523.808670:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002523.808754:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530881920 00000100:00100000:2.0:1786002523.808762:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530881920 00000100:00100000:2.0:1786002523.808820:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:2.0:1786002523.808830:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18391:x1872758530881920:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:2.0:1786002523.808903:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002523.808926:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af5784142cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a947 expref: 26 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.808944:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9ed244f15b00) 00010000:00010000:2.0:1786002523.808956:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002523.808977:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841460d lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.808994:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841460d lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.809002:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841460d lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002523.809018:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00000100:00100000:2.0:1786002523.809069:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560949248:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002523.809120:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.809526:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.809612:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560949248 00000100:00100000:3.0:1786002523.809617:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560949248 00000100:00100000:3.0:1786002523.809652:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:3.0:1786002523.809660:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560949248:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002523.809760:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560949248:12345-0@lo:1000:mdt_io00_002.0 Request processed in 100us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.809768:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000100:00100000:0.0:1786002523.809869:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560949248:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.810662:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc53b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560949376:0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1786002523.810701:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.810724:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.811052:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560949376 00000100:00100000:3.0:1786002523.811057:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560949376 00000100:00100000:3.0:1786002523.811099:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:3.0:1786002523.811107:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560949376:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1786002523.816113:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560949376:12345-0@lo:403:mdt_io00_002.0 Request processed in 4998us (5403us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.816126:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000100:00100000:2.0:1786002523.816581:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc53b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560949376:0@lo:403:mdt_io00_002.0 00010000:00010000:2.0:1786002523.817580:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.817591:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.817601:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.817619:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560949504:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1786002523.817659:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.817681:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.818903:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560949504 00000100:00100000:3.0:1786002523.818911:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560949504 00000100:00100000:3.0:1786002523.818961:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1786002523.818969:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560949504:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1786002523.818985:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002523.819001:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af57841461b lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414614 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.819026:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af57841461b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414614 expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.819319:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af57841461b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414614 expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.819329:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed100) 00010000:00010000:3.0:1786002523.819332:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002523.819336:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228c00, rc 0) 00000100:00100000:3.0:1786002523.819379:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6535:x1872758560949504:12345-0@lo:101:mdt_io00_002.0 Request processed in 410us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.819386:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:2.0:1786002523.819475:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560949504:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1786002523.819493:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841461b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.819503:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841461b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002523.819521:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:2.0:1786002523.819545:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.819551:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.819559:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.819571:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560949632:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1786002523.819597:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.819651:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a240 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.823408:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560949632 00000100:00100000:1.0:1786002523.823422:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560949632 00000100:00100000:1.0:1786002523.823477:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:1.0:1786002523.823486:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:6535:x1872758560949632:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002523.823505:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002523.823524:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578414629 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414622 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.823552:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578414629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414622 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.823569:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578414629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414622 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.823576:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x391d5834 (ffff9ed245ddc900) 00010000:00010000:1.0:1786002523.823579:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.823582:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e000, rc 0) 00000100:00100000:1.0:1786002523.825167:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560949632:12345-0@lo:101:mdt_io00_002.0 Request processed in 1677us (5564us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.825177:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00100000:2.0:1786002523.828379:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560949632:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1786002523.828409:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414629 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.828424:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414629 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002523.828448:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:2.0:1786002523.828474:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414630 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.828485:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414630 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.828515:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414630 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.828527:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414637 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.828534:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414637 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.828538:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414637 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.828580:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.828596:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af5784145f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9d3 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.828603:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.828635:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af5784145f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9d3 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.828650:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af5784145f8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9d3 expref: 25 pid: 6522 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.828663:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6535:1872758560949760:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002523.828799:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a240 going to sleep for 11 seconds 00010000:00010000:1.0:1786002523.836887:0:6535:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@000000009e97355b x1872758560949760) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af5784145f8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9d3 expref: 25 pid: 6522 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.836912:0:6535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af5784145f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9d3 expref: 25 pid: 6522 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.836936:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af5784145f8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9d3 expref: 25 pid: 6522 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002523.837213:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6535:1872758560949760:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002523.837236:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9ed244f15b00) 00010000:00010000:1.0:1786002523.837240:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.837248:0:6535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.837254:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.837411:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.837423:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.837428:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002523.837557:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560949888:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.837601:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.837670:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6000 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.841938:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560949888 00000100:00100000:0.0:1786002523.842125:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560949888 00000100:00100000:0.0:1786002523.842282:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:0.0:1786002523.842292:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560949888:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002523.842447:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560949888:12345-0@lo:1000:mdt_io00_002.0 Request processed in 156us (4844us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786002523.842455:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00100000:1.0:1786002523.842519:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560949888:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.842581:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560950016:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.842612:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.850596:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6000 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.851419:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560950016 00000100:00100000:3.0:1786002523.851437:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560950016 00000100:00100000:3.0:1786002523.851497:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1786002523.851507:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560950016:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002523.851611:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560950016:12345-0@lo:1000:mdt_io00_002.0 Request processed in 105us (8998us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.851620:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00100000:1.0:1786002523.853472:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560950016:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.853604:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560950144:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.853651:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.853672:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6000 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.853992:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560950144 00000100:00100000:3.0:1786002523.853999:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560950144 00000100:00100000:3.0:1786002523.854045:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:3.0:1786002523.854054:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560950144:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002523.854119:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560950144:12345-0@lo:1000:mdt_io00_002.0 Request processed in 66us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.854126:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00100000:1.0:1786002523.854128:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560950144:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.854220:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560950272:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.854244:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.854279:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.854481:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560950272 00000100:00100000:3.0:1786002523.854486:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560950272 00000100:00100000:3.0:1786002523.854516:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:3.0:1786002523.854523:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560950272:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002523.854581:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560950272:12345-0@lo:1000:mdt_io00_002.0 Request processed in 58us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.854587:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000100:00100000:1.0:1786002523.856321:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560950272:0@lo:1000:mdt_io00_002.0 00000040:00080000:1.0:1786002523.856793:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].406, 1264 off607016 00000040:00080000:1.0:1786002523.856844:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].406, 1344 off658048 00000100:00100000:1.0:1786002523.856904:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560950400:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.856941:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.856971:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6600 going to sleep for 11 seconds 00000100:00100000:3.0:1786002523.857913:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560950400 00000100:00100000:3.0:1786002523.857922:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560950400 00000100:00100000:3.0:1786002523.857977:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:3.0:1786002523.857986:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560950400:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002523.858428:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560950400:0@lo:1000:mdt_io00_002.0 00000004:00080000:1.0:1786002523.858439:0:6535:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245dc6000 with version 771 00000004:00080000:1.0:1786002523.858453:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 771 rpc_version 771 00000020:00100000:1.0:1786002523.858474:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002523.858481:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed366d6d880 x1872758560950656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002523.858505:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560950656:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002523.858536:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.858552:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.858563:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560950656 00000100:00100000:1.0:1786002523.858567:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560950656 00000100:00100000:1.0:1786002523.858586:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:1.0:1786002523.858591:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b57a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:7805:x1872758560950656:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002523.858873:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b57a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:7805:x1872758560950656:12345-0@lo:1000:osp_up1-0.0 Request processed in 280us (334us total) trans 4294968532 rc 0/0 00000100:00100000:1.0:1786002523.858880:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:1.0:1786002523.858913:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6d880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560950656:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1786002523.858945:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d80c17a4 reply state 0000000050fd2b9e transno 4294983567 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.859031:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6535:x1872758560950400:12345-0@lo:1000:mdt_io00_002.0 Request processed in 148us (1191us total) trans 4294969884 rc 0/0 00000100:00100000:3.0:1786002523.859045:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00010000:00010000:1.0:1786002523.860412:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860421:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9ed244f15b00) 00010000:00010000:1.0:1786002523.860425:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1786002523.860429:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002523.860436:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414630 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860451:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414630 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860458:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414630 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860463:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002523.860466:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414630 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860472:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414630 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860484:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed366e57300) 00010000:00010000:1.0:1786002523.860490:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.860493:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414630 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860498:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414630 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002523.860515:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d80c17a4 reply state 0000000050fd2b9e transno 4294983567 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414637 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860522:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414637 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860526:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x391d5834 (ffff9ed366e57900) 00010000:00010000:1.0:1786002523.860528:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002523.860529:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1786002523.860535:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:1.0:1786002523.860541:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841461b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860547:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af57841461b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860553:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af57841461b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860574:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786002523.860577:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:1.0:1786002523.860582:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414629 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860589:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414629 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002523.860600:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00010000:00010000:1.0:1786002523.860607:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841460d lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860612:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841460d lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860618:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841460d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860622:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002523.860625:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841460d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860630:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841460d lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860637:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed366e57000) 00010000:00010000:1.0:1786002523.860639:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.860643:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841460d lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.860648:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841460d lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002523.860732:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18391:x1872758530881920:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 51900us (52065us total) trans 4294983567 rc 0/0 00000100:00100000:1.0:1786002523.860753:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5 00010000:00010000:0.0:1786002523.861906:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002523.861914:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af57841461b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.861923:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002523.861928:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af57841461b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002523.861935:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af57841461b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.861975:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841461b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.861982:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002523.862004:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841461b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.862011:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af578414614 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841461b expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.862025:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002523.862027:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002523.862037:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002523.862278:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560950784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002523.862328:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.864066:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560950784 00000100:00100000:0.0:1786002523.864076:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560950784 00000100:00100000:2.0:1786002523.864306:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:2.0:1786002523.864318:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+16:3644:x1872758560950784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002523.864334:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002523.864354:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228c00/0x7cee4af57841461b lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414614 expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.864375:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed100) 00010000:00010000:2.0:1786002523.864387:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002523.864437:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+15:3644:x1872758560950784:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (2108us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.864445:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:1.0:1786002523.864619:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560950784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002523.870358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002523.874024:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530882048 00000100:00100000:2.0:1786002523.874044:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530882048 00000100:00100000:2.0:1786002523.875047:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23839 00000100:00100000:2.0:1786002523.875060:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18391:x1872758530882048:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:2.0:1786002523.875149:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578414645 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875163:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578414645 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875173:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578414645 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875184:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af57841464c lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875190:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af57841464c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875195:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af57841464c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875244:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414653 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875253:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875259:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002523.875300:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875313:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578414645 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875320:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578414645 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875327:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578414645 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875333:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578414645 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875339:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002523.875343:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578414645 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875350:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578414645 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875361:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed366e57500) 00010000:00010000:2.0:1786002523.875364:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002523.875368:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578414645 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875374:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af578414645 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875391:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af57841464c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875396:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af57841464c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875402:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af57841464c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875407:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002523.875410:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af57841464c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875415:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af57841464c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875422:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x18618557 (ffff9ed366e57800) 00010000:00010000:2.0:1786002523.875424:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002523.875426:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af57841464c lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875432:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af57841464c lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875443:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875450:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414653 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875455:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875460:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002523.875463:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875468:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414653 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875475:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:2.0:1786002523.875477:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002523.875480:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414653 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.875486:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414653 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.875550:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18391:x1872758530882048:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 493us (5200us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.875558:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23839 00000100:00100000:2.0:1786002523.880413:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002523.885389:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530882304 00000100:00100000:0.0:1786002523.885402:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530882304 00000100:00100000:1.0:1786002523.885533:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23840 00000100:00100000:1.0:1786002523.885543:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18391:x1872758530882304:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002523.885564:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002523.885582:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841465a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9da expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.885686:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414661 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.885699:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414661 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.885711:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414661 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002523.885724:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153c:0x0]: returning size 2 00010000:00010000:1.0:1786002523.885842:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af57841465a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x153c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9da expref: 29 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.885898:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414661 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9da expref: 28 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.885910:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:1.0:1786002523.885913:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786002523.885915:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f400, rc 0) 00000100:00100000:1.0:1786002523.885983:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18391:x1872758530882304:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 441us (5578us total) trans 4294983568 rc 0/0 00000100:00100000:1.0:1786002523.885989:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23840 00000100:00100000:0.0:1786002523.899510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002523.899657:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530882432 00000100:00100000:2.0:1786002523.899666:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530882432 00000100:00100000:2.0:1786002523.899754:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5200 00000100:00100000:2.0:1786002523.899764:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530882432:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:2.0:1786002523.899810:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.899831:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.899964:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9c9:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1786002523.899968:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786002523.899974:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.900006:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.900021:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 12 pid: 8436 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.900089:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1872758560950912:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002523.900243:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.911715:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002523.913011:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530882560 00000100:00100000:0.0:1786002523.913021:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530882560 00002000:00100000:0.0:1786002523.913086:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c9:0x0] (0->1) req@ffff9ed366d6ce00 x1872758530882560/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:204/0 lens 496/0 e 0 to 0 dl 1786002534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002523.913097:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed366d6ce00 with x1872758530882560 ext(0->1) 00010000:00010000:0.0:1786002523.913105:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 13 pid: 8436 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.913122:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 13 pid: 8436 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002523.913513:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed366d6ce00 00000100:00100000:0.0:1786002523.913552:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:0.0:1786002523.913563:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2413:x1872758530882560:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002523.917335:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2413:x1872758530882560:12345-192.168.203.49@tcp:4:bash.0 Request processed in 3764us (5617us total) trans 4294969886 rc 0/0 00000100:00100000:0.0:1786002523.917348:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5 00002000:00100000:0.0:1786002523.917359:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c9:0x0] (0->1) req@ffff9ed366d6ce00 x1872758530882560/t4294969886(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:204/0 lens 496/448 e 0 to 0 dl 1786002534 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002523.917369:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed366d6ce00 with x1872758530882560 ext(0->1) 00010000:00010000:0.0:1786002523.917380:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 15 pid: 8436 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.917399:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 15 pid: 8436 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002523.917408:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed366d6ce00 00000100:00100000:2.0:1786002523.918079:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1872758560950912:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002523.918244:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.923377:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002523.923454:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530882688 00000100:00100000:3.0:1786002523.923463:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530882688 00010000:00010000:3.0:1786002523.923501:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 15 pid: 8436 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.923544:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1661 00000100:00100000:3.0:1786002523.923554:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed345530c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2410:x1872758530882688:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002523.923568:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786002523.923583:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1786002523.923587:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb mtime from disk: 0 -> 1786002522 00002000:00010000:3.0:1786002523.923589:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb ctime from disk: 0 -> 1786002522 00002000:00010000:3.0:1786002523.923591:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9c9:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1786002523.923596:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 15 pid: 8436 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.923615:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 15 pid: 8436 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.923641:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009123b9c5/0x7cee4af578414304 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a95c expref: 15 pid: 8436 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.923657:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002523.923661:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002523.923666:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.923676:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.923707:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002523.923775:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed345530c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2410:x1872758530882688:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 222us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002523.923783:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1661 00010000:00010000:2.0:1786002523.923902:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.923926:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.924011:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.924021:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.924028:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.924251:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2aa00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002523.924255:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.924264:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.924278:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.924286:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d736f02/0x7cee4af57841466f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.924339:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758530882432:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 24576us (24836us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.924347:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5200 00000100:00100000:1.0:1786002523.942613:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002523.942755:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530882944 00000100:00100000:2.0:1786002523.942765:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530882944 00000100:00100000:2.0:1786002523.942825:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:2.0:1786002523.942836:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18391:x1872758530882944:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:2.0:1786002523.942918:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002523.943257:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784142f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a955 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.943281:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:2.0:1786002523.943285:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002523.943310:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414676 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.943322:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414676 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.943332:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414676 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002523.943349:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00000100:00100000:2.0:1786002523.943398:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951040:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002523.943484:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.943516:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.944166:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560951040 00000100:00100000:1.0:1786002523.944171:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560951040 00000100:00100000:1.0:1786002523.944210:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:1.0:1786002523.944217:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6533:x1872758560951040:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.944298:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6533:x1872758560951040:12345-0@lo:1000:mdt_io00_000.0 Request processed in 81us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.944305:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00100000:2.0:1786002523.944622:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951040:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002523.945217:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951168:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1786002523.945254:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.945269:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.946523:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560951168 00000100:00100000:0.0:1786002523.946532:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560951168 00000100:00100000:0.0:1786002523.946579:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:0.0:1786002523.946587:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6533:x1872758560951168:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1786002523.952755:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6533:x1872758560951168:12345-0@lo:403:mdt_io00_000.0 Request processed in 6152us (7483us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002523.952769:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:1.0:1786002523.953128:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951168:0@lo:403:mdt_io00_000.0 00010000:00010000:1.0:1786002523.953871:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.953899:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.953910:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002523.953926:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951296:0@lo:101:mdt_io00_000.0 00000100:00100000:1.0:1786002523.954144:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.954164:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.954463:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560951296 00000100:00100000:0.0:1786002523.954470:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560951296 00000100:00100000:0.0:1786002523.954507:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:0.0:1786002523.954514:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6533:x1872758560951296:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002523.954528:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002523.954543:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578414684 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841467d expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.954580:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578414684 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841467d expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.954607:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578414684 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841467d expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.954616:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed351207000) 00010000:00010000:0.0:1786002523.954619:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002523.954624:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35600, rc 0) 00000100:00100000:0.0:1786002523.954693:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:6533:x1872758560951296:12345-0@lo:101:mdt_io00_000.0 Request processed in 179us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002523.954699:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00000100:00100000:2.0:1786002523.955201:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951296:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1786002523.955215:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414684 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.955224:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414684 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002523.955240:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:2.0:1786002523.955261:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.955271:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.955278:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002523.955290:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951424:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1786002523.955315:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.955366:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.959386:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560951424 00000100:00100000:0.0:1786002523.959399:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560951424 00000100:00100000:1.0:1786002523.961222:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:1.0:1786002523.961233:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:6533:x1872758560951424:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1786002523.961251:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002523.961273:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ec00/0x7cee4af578414692 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841468b expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.961302:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ec00/0x7cee4af578414692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841468b expref: 17 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.961316:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ec00/0x7cee4af578414692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841468b expref: 17 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.961324:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x18618557 (ffff9ed245ddc600) 00010000:00010000:1.0:1786002523.961327:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002523.961330:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7ec00, rc 0) 00000100:00100000:1.0:1786002523.961450:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:6533:x1872758560951424:12345-0@lo:101:mdt_io00_000.0 Request processed in 218us (6134us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.961457:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00100000:3.0:1786002523.964231:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137f800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951424:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1786002523.964255:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414692 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.964271:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414692 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002523.964297:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:3.0:1786002523.964323:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414699 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.964336:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414699 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.964346:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414699 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.964355:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.964367:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.964374:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.964416:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.964430:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414661 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9da expref: 27 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.964438:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.964467:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414661 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9da expref: 27 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.964485:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414661 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9da expref: 27 pid: 14496 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.964496:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6533:1872758560951552:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002523.964560:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7d180 going to sleep for 11 seconds 00010000:00010000:3.0:1786002523.969897:0:6533:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@00000000643c8226 x1872758560951552) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414661 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9da expref: 27 pid: 14496 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.970189:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414661 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9da expref: 27 pid: 14496 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.970226:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414661 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x153c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9da expref: 27 pid: 14496 timeout: 984 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.970242:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6533:1872758560951552:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002523.970262:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:3.0:1786002523.970267:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.970276:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.970282:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.970304:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.970314:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002523.970320:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002523.970441:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951680:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002523.970495:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002523.970570:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.974048:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560951680 00000100:00100000:0.0:1786002523.974060:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560951680 00000100:00100000:0.0:1786002523.974244:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:0.0:1786002523.974254:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:6533:x1872758560951680:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.974408:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:6533:x1872758560951680:12345-0@lo:1000:mdt_io00_000.0 Request processed in 155us (3911us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786002523.974417:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000100:00100000:3.0:1786002523.974479:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951680:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002523.974539:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951808:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002523.974567:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.982288:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560951808 00000100:00100000:1.0:1786002523.982301:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560951808 00000100:00100000:1.0:1786002523.982370:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:1.0:1786002523.982615:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6533:x1872758560951808:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.982716:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6533:x1872758560951808:12345-0@lo:1000:mdt_io00_000.0 Request processed in 338us (8147us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.982722:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00000100:00100000:0.0:1786002523.984313:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.984355:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951808:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.984500:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951936:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.984550:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.984577:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66480 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.985930:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560951936 00000100:00100000:1.0:1786002523.985939:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560951936 00000100:00100000:1.0:1786002523.986002:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:1.0:1786002523.986010:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6533:x1872758560951936:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002523.986091:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6533:x1872758560951936:12345-0@lo:1000:mdt_io00_000.0 Request processed in 81us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002523.986097:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00100000:0.0:1786002523.986267:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560951936:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.986362:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560952064:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.986389:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.986412:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560952064 00000100:00100000:0.0:1786002523.986415:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560952064 00000100:00100000:0.0:1786002523.986437:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:0.0:1786002523.986441:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560952064:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.986490:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560952064:12345-0@lo:1000:mdt_io00_000.0 Request processed in 49us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002523.986496:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:0.0:1786002523.986511:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66300 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.986522:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560952064:0@lo:1000:mdt_io00_000.0 00000040:00080000:0.0:1786002523.986876:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].407, 1264 off608280 00000040:00080000:0.0:1786002523.986925:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].407, 1344 off659392 00000100:00100000:0.0:1786002523.986958:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560952192:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.986986:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002523.987001:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002523.987013:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560952192 00000100:00100000:0.0:1786002523.987016:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560952192 00000100:00100000:0.0:1786002523.987042:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:0.0:1786002523.987048:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560952192:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002523.987231:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:6533:x1872758560952192:12345-0@lo:1000:mdt_io00_000.0 Request processed in 81us (142us total) trans 4294969887 rc 0/0 00000100:00100000:0.0:1786002523.987239:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00100000:0.0:1786002523.987274:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560952192:0@lo:1000:mdt_io00_000.0 00000004:00080000:0.0:1786002523.987281:0:6533:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245c660c0 with version 772 00000004:00080000:1.0:1786002523.987602:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 772 rpc_version 772 00000020:00100000:1.0:1786002523.987624:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002523.987631:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed366d6c000 x1872758560952448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002523.987646:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560952448:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002523.987677:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002523.987702:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002523.987716:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560952448 00000100:00100000:1.0:1786002523.987719:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560952448 00000100:00100000:1.0:1786002523.987755:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:1.0:1786002523.987763:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:7805:x1872758560952448:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002523.989347:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:7805:x1872758560952448:12345-0@lo:1000:osp_up1-0.0 Request processed in 1581us (1666us total) trans 4294968533 rc 0/0 00000100:00100000:1.0:1786002523.989356:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00100000:1.0:1786002523.989416:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6c000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560952448:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1786002523.990179:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b095ff0 reply state 00000000b7f71669 transno 4294983569 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990200:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990209:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:0.0:1786002523.990212:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1786002523.990216:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002523.990224:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414699 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990231:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414699 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990238:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414699 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990245:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414699 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990250:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002523.990254:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414699 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990261:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414699 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990270:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed245fed600) 00010000:00010000:0.0:1786002523.990273:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002523.990277:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414699 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990282:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414699 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002523.990305:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b095ff0 reply state 00000000b7f71669 transno 4294983569 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990315:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990320:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x18618557 (ffff9ed245fedb00) 00010000:00010000:0.0:1786002523.990323:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002523.990325:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1786002523.990329:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:0.0:1786002523.990335:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414684 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990342:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414684 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990348:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414684 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990370:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786002523.990374:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd2:0x0] 00010000:00010000:0.0:1786002523.990379:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414692 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990385:0:6533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414692 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002523.990397:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x193:0x0] 00010000:00010000:0.0:1786002523.990403:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414676 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990410:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414676 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990416:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414676 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990421:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002523.990424:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414676 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990430:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414676 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990437:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed366e57800) 00010000:00010000:0.0:1786002523.990440:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002523.990443:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414676 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002523.990449:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414676 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002523.990522:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18391:x1872758530882944:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 47687us (47916us total) trans 4294983569 rc 0/0 00000100:00100000:0.0:1786002523.990530:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00010000:00010000:1.0:1786002523.990634:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002523.990641:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414684 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.990649:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fc00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002523.990654:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414684 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002523.990660:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414684 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.990690:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414684 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.990695:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002523.990719:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414684 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.990726:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245e7fc00/0x7cee4af57841467d lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414684 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002523.990739:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002523.990741:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002523.990754:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002523.990761:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002523.990773:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560952576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002523.990810:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002523.994388:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560952576 00000100:00100000:2.0:1786002523.994402:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560952576 00000100:00100000:2.0:1786002523.994472:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1786002523.994482:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+18:3644:x1872758560952576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002523.994497:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002523.994520:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578414684 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841467d expref: 18 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002523.994537:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed351207000) 00010000:00010000:2.0:1786002523.994547:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002523.994608:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+17:3644:x1872758560952576:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (3797us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002523.994615:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1786002523.994661:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560952576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002524.001268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002524.001330:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530883200 00000100:00100000:2.0:1786002524.001338:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530883200 00000100:00100000:2.0:1786002524.001408:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5081 00000100:00100000:2.0:1786002524.001419:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:18391:x1872758530883200:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:2.0:1786002524.001629:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:18391:x1872758530883200:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 211us (367us total) trans 4294968534 rc 0/0 00000100:00100000:2.0:1786002524.001638:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5081 00000100:00080000:1.0:1786002524.001928:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002524.032940:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002524.033013:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530883456 00000100:00100000:3.0:1786002524.033025:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530883456 00000100:00100000:3.0:1786002524.033105:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23841 00000100:00100000:3.0:1786002524.033116:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18392:x1872758530883456:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002524.033237:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002524.033257:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784146ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9e1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033436:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784146b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033449:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784146b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033461:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784146b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033476:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af5784146bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033483:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af5784146bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033489:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af5784146bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033552:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af5784146c3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033561:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af5784146c3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033568:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af5784146c3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033580:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784146b5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033587:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784146b5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033593:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784146b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033600:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784146b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033605:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002524.033609:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784146b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033617:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784146b5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033627:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002524.033631:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002524.033636:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784146b5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033642:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784146b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033659:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af5784146bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033665:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af5784146bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033671:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af5784146bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033676:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002524.033679:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af5784146bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033685:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af5784146bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033693:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9ed245fed900) 00010000:00010000:3.0:1786002524.033695:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002524.033698:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af5784146bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033708:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af5784146bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033739:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784146ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9e1 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033766:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af5784146c3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9e1 expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.033773:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed245fed300) 00010000:00010000:3.0:1786002524.033776:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002524.033778:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228200, rc 0) 00000100:00100000:3.0:1786002524.033924:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18392:x1872758530883456:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 810us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002524.033932:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23841 00000100:00080000:1.0:1786002524.034000:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002524.042944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.042982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.043047:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530883712 00000100:00100000:1.0:1786002524.043056:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530883712 00000100:00100000:1.0:1786002524.043112:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23842 00000100:00100000:1.0:1786002524.043122:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:18392:x1872758530883712:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002524.043153:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.043175:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af5784146ca lrc: 2/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9e8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002524.043325:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00010000:00010000:1.0:1786002524.043551:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af5784146ca lrc: 1/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9e8 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.043565:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed245ddcf00) 00010000:00010000:1.0:1786002524.043568:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002524.043573:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fc00/0x7cee4af5784146ca lrc: 0/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9e8 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.043589:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fc00, rc 0) 00000100:00100000:1.0:1786002524.043643:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18392:x1872758530883712:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 522us (661us total) trans 4294968535 rc 301/301 00000100:00100000:1.0:1786002524.043650:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23842 00000100:00100000:3.0:1786002524.044816:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530883840 00000100:00100000:3.0:1786002524.044824:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530883840 00000100:00100000:3.0:1786002524.044892:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1468 00000100:00100000:3.0:1786002524.044902:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2410:x1872758530883840:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002524.044915:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002524.044931:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af5784146c3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9e1 expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.044947:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed245fed300) 00010000:00010000:3.0:1786002524.044951:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002524.044994:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:2410:x1872758530883840:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 94us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002524.045001:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1468 00000100:00100000:0.0:1786002524.064599:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002524.064674:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530883968 00000100:00100000:2.0:1786002524.064684:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530883968 00000100:00100000:2.0:1786002524.064735:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5082 00000100:00100000:2.0:1786002524.064753:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18392:x1872758530883968:12345-192.168.203.49@tcp:33:lfs.0 00000004:00200000:2.0:1786002524.064925:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00000004:00200000:2.0:1786002524.064930:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:2.0:1786002524.066299:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18392:x1872758530883968:12345-192.168.203.49@tcp:33:lfs.0 Request processed in 1553us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002524.066308:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5082 00010000:00010000:3.0:1786002524.081337:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002524.087798:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.092038:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530884224 00000100:00100000:0.0:1786002524.092051:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530884224 00000100:00100000:1.0:1786002524.094911:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5083 00000100:00100000:1.0:1786002524.094923:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18392:x1872758530884224:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1786002524.099056:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:18392:x1872758530884224:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 4125us (11257us total) trans 4294968536 rc 0/0 00000100:00100000:1.0:1786002524.099070:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5083 00000100:00100000:0.0:1786002524.108034:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002524.108172:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530884352 00000100:00100000:3.0:1786002524.108183:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530884352 00000100:00100000:3.0:1786002524.108243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23843 00000100:00100000:3.0:1786002524.108253:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:18233:x1872758530884352:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002524.108285:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002524.108307:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af5784146d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9ef expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.108386:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229800/0x7cee4af5784146df lrc: 3/1,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.108399:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229800/0x7cee4af5784146df lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.108409:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229800/0x7cee4af5784146df lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002524.108500:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00000004:00200000:3.0:1786002524.108504:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:3.0:1786002524.108525:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229800/0x7cee4af5784146df lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.108551:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af5784146d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9ef expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.108578:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229800/0x7cee4af5784146df lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9ef expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.108591:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed245fedc00) 00010000:00010000:3.0:1786002524.108594:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002524.108597:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229800, rc 0) 00000100:00100000:3.0:1786002524.108653:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:18233:x1872758530884352:12345-192.168.203.49@tcp:101:bash.0 Request processed in 401us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002524.108658:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23843 00000100:00100000:0.0:1786002524.126930:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002524.128532:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530884480 00000100:00100000:3.0:1786002524.128544:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530884480 00000100:00100000:3.0:1786002524.128612:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23844 00000100:00100000:3.0:1786002524.128623:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:18233:x1872758530884480:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002524.128643:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002524.128664:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af5784146e6 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9f6 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.128719:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784146ed lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.128732:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784146ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.128753:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784146ed lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002524.128794:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xd2:0x0]: returning size 4096 00000004:00200000:3.0:1786002524.128799:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1786002524.128832:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af5784146e6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9f6 expref: 13 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.129049:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784146ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9f6 expref: 12 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.129059:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002524.129062:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002524.129065:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229400, rc 0) 00000100:00100000:2.0:1786002524.131904:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18233:x1872758530884480:12345-192.168.203.49@tcp:101:bash.0 Request processed in 3276us (4974us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002524.131915:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23844 00000100:00100000:1.0:1786002524.143293:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.146013:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530884608 00000100:00100000:0.0:1786002524.146024:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530884608 00000100:00100000:0.0:1786002524.146092:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23845 00000100:00100000:0.0:1786002524.146102:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18233:x1872758530884608:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002524.146120:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002524.146149:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af5784146f4 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3a9fd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.146204:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784146fb lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.146215:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784146fb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.146226:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784146fb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002524.146262:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd5:0x0]: returning size 4096 00000004:00200000:0.0:1786002524.146286:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1786002524.146316:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af5784146f4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9fd expref: 30 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.146332:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784146fb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9fd expref: 29 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.146341:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:0.0:1786002524.146344:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002524.146347:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34800, rc 0) 00000100:00100000:0.0:1786002524.146404:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18233:x1872758530884608:12345-192.168.203.49@tcp:101:bash.0 Request processed in 303us (3120us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002524.146411:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23845 00000100:00100000:0.0:1786002524.164689:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002524.164782:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530884864 00000100:00100000:3.0:1786002524.164791:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530884864 00000100:00100000:3.0:1786002524.164874:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23846 00000100:00100000:3.0:1786002524.164885:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18233:x1872758530884864:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002524.164904:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002524.164922:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af578414702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa04 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.165090:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578414709 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.165104:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578414709 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x193:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.165114:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578414709 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x193:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002524.165125:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00010000:00010000:3.0:1786002524.165463:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af578414702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa04 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.165489:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578414709 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x193:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa04 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.165498:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed245fedc00) 00010000:00010000:3.0:1786002524.165501:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786002524.165505:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228800, rc 0) 00000100:00100000:3.0:1786002524.165563:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18233:x1872758530884864:12345-192.168.203.49@tcp:101:bash.0 Request processed in 679us (881us total) trans 4294968537 rc 0/0 00000100:00100000:3.0:1786002524.165570:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23846 00000100:00100000:1.0:1786002524.189488:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.189583:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530884992 00000100:00100000:0.0:1786002524.189593:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530884992 00000100:00100000:0.0:1786002524.189650:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5084 00000100:00100000:0.0:1786002524.189662:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18233:x1872758530884992:12345-192.168.203.49@tcp:37:bash.0 00000100:00100000:0.0:1786002524.198800:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18233:x1872758530884992:12345-192.168.203.49@tcp:37:bash.0 Request processed in 9132us (9324us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002524.198814:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5084 00000100:00100000:1.0:1786002524.210725:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002524.210818:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530885120 00000100:00100000:2.0:1786002524.210827:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530885120 00000100:00100000:2.0:1786002524.210919:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5085 00000100:00100000:2.0:1786002524.210930:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18233:x1872758530885120:12345-192.168.203.49@tcp:37:bash.0 00000100:00100000:2.0:1786002524.222712:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18233:x1872758530885120:12345-192.168.203.49@tcp:37:bash.0 Request processed in 10911us (11124us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002524.222729:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5085 00000100:00100000:3.0:1786002524.282690:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002524.282844:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530885248 00000100:00100000:2.0:1786002524.282886:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530885248 00000100:00100000:2.0:1786002524.282936:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23847 00000100:00100000:2.0:1786002524.282946:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18394:x1872758530885248:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:2.0:1786002524.282966:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002524.282986:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414717 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa0b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283052:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841471e lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283066:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841471e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283076:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841471e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283097:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578414725 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283107:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578414725 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283113:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578414725 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283347:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841471e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283355:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841471e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283361:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841471e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283366:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841471e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283372:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002524.283376:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841471e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283384:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841471e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283396:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:2.0:1786002524.283399:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002524.283403:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841471e lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283408:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841471e lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283422:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578414725 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283427:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578414725 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283432:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578414725 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283436:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2bc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002524.283439:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578414725 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283443:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578414725 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283449:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xeddcfc6c (ffff9ed366e57400) 00010000:00010000:2.0:1786002524.283451:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002524.283454:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578414725 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283459:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578414725 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283489:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414717 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa0b expref: 30 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283499:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:2.0:1786002524.283501:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002524.283505:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414717 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa0b expref: 30 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.283514:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b600, rc 0) 00000100:00100000:2.0:1786002524.283945:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18394:x1872758530885248:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 998us (1261us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002524.283953:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23847 00000100:00100000:1.0:1786002524.294887:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002524.294979:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530885376 00000100:00100000:3.0:1786002524.294988:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530885376 00000100:00100000:3.0:1786002524.295041:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23848 00000100:00100000:3.0:1786002524.295057:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18394:x1872758530885376:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:3.0:1786002524.295075:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002524.295102:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841472c lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa12 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295164:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578414733 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295178:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578414733 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295188:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578414733 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295201:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841473a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295208:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841473a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295215:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841473a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295255:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578414733 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295262:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578414733 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295279:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578414733 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295285:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578414733 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295292:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002524.295296:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578414733 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295304:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578414733 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295314:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002524.295318:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002524.295322:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578414733 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295329:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578414733 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295345:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841473a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295352:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841473a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295357:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841473a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295361:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002524.295364:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841473a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295369:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841473a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295376:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xeddcfc6c (ffff9ed245fedd00) 00010000:00010000:3.0:1786002524.295378:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002524.295380:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841473a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295385:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228600/0x7cee4af57841473a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295414:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841472c lrc: 1/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa12 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295423:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002524.295425:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002524.295428:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841472c lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa12 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.295441:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228200, rc 0) 00000100:00100000:3.0:1786002524.295664:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18394:x1872758530885376:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 607us (820us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002524.295671:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23848 00000100:00100000:0.0:1786002524.320913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002524.321025:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530885504 00000100:00100000:3.0:1786002524.321035:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530885504 00000100:00100000:3.0:1786002524.321234:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23849 00000100:00100000:3.0:1786002524.321244:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18394:x1872758530885504:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:3.0:1786002524.321271:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002524.321290:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414741 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa19 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321382:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414748 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321408:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414748 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321432:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414748 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321460:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841474f lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321472:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841474f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321479:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841474f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321513:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414748 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321520:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414748 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321525:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414748 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321530:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414748 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321544:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002524.321548:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414748 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321558:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414748 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321567:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:3.0:1786002524.321573:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002524.321577:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414748 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321582:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414748 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321598:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841474f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321603:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841474f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321609:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841474f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321614:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002524.321617:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841474f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321622:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841474f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321629:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x3491cd4c (ffff9ed245fed600) 00010000:00010000:3.0:1786002524.321632:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002524.321634:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841474f lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321641:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841474f lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321674:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414741 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa19 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321684:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:3.0:1786002524.321686:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002524.321690:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414741 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa19 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.321701:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228c00, rc 0) 00000100:00100000:3.0:1786002524.321784:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18394:x1872758530885504:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 541us (878us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002524.321793:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23849 00000100:00100000:2.0:1786002524.328723:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.330200:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530885632 00000100:00100000:0.0:1786002524.330211:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530885632 00000100:00100000:0.0:1786002524.330270:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23850 00000100:00100000:0.0:1786002524.330280:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18394:x1872758530885632:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:0.0:1786002524.330297:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002524.330317:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414756 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa20 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330376:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af57841475d lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330389:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af57841475d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330399:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af57841475d lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330414:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578414764 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330422:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578414764 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330428:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578414764 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330463:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af57841475d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330609:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af57841475d lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330636:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af57841475d lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330643:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af57841475d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330649:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.330653:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af57841475d lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330660:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af57841475d lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330671:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:0.0:1786002524.330674:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.330678:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af57841475d lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330685:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af57841475d lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330697:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578414764 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330704:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578414764 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330710:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578414764 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330716:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.330719:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578414764 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330725:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578414764 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330731:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x3491cd4c (ffff9ed351207000) 00010000:00010000:0.0:1786002524.330733:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.330735:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578414764 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330749:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578414764 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330797:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414756 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa20 expref: 15 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330806:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:0.0:1786002524.330808:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002524.330812:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414756 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa20 expref: 15 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.330819:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34600, rc 0) 00000100:00100000:0.0:1786002524.331613:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18394:x1872758530885632:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 1332us (2896us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002524.331625:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23850 00000100:00100000:2.0:1786002524.348384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.354209:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530885760 00000100:00100000:1.0:1786002524.354223:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530885760 00000100:00100000:1.0:1786002524.354294:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23851 00000100:00100000:1.0:1786002524.354303:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18394:x1872758530885760:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002524.354330:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.354350:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af57841476b lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa27 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354413:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414772 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354440:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414772 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354451:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414772 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354464:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af578414779 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354469:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af578414779 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354475:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af578414779 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354514:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414772 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354529:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414772 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354535:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414772 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354541:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414772 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354545:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.354549:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414772 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354555:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414772 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354563:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:1.0:1786002524.354566:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.354570:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414772 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354574:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414772 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354585:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af578414779 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354589:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af578414779 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354594:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af578414779 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354598:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.354601:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af578414779 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354606:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af578414779 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354613:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x3735a305 (ffff9ed245ddcf00) 00010000:00010000:1.0:1786002524.354615:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.354617:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af578414779 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354622:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af578414779 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354649:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af57841476b lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa27 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354657:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:1.0:1786002524.354658:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002524.354661:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af57841476b lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa27 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.354668:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f600, rc 0) 00000100:00100000:1.0:1786002524.354729:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18394:x1872758530885760:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 427us (6355us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002524.354735:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23851 00000100:00100000:2.0:1786002524.358523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002524.358632:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530885888 00000100:00100000:3.0:1786002524.358641:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530885888 00000100:00100000:3.0:1786002524.358693:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23852 00000100:00100000:3.0:1786002524.358703:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18394:x1872758530885888:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:3.0:1786002524.358722:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002524.358739:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414780 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa2e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358800:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414787 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358812:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414787 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358822:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414787 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358833:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af57841478e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358840:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af57841478e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358865:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af57841478e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358898:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414787 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358910:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414787 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358917:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414787 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358923:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414787 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358929:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002524.358933:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414787 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358939:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414787 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358950:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002524.358952:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002524.358956:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414787 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358962:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414787 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358977:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af57841478e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358984:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af57841478e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358990:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af57841478e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.358995:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002524.358998:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af57841478e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.359004:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af57841478e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.359010:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x3735a305 (ffff9ed245fed600) 00010000:00010000:3.0:1786002524.359012:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002524.359014:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af57841478e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.359020:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af57841478e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.359045:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414780 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa2e expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.359053:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002524.359055:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002524.359058:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414780 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa2e expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.359066:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2423b4000, rc 0) 00000100:00100000:3.0:1786002524.359452:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18394:x1872758530885888:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 749us (936us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002524.359459:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23852 00000100:00100000:2.0:1786002524.377757:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.377838:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530886144 00000100:00100000:0.0:1786002524.377876:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530886144 00000100:00100000:0.0:1786002524.377924:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23853 00000100:00100000:0.0:1786002524.377933:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18394:x1872758530886144:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:0.0:1786002524.377951:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002524.377969:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414795 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa35 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378037:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841479c lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378088:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841479c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378099:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841479c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378123:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147a3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378137:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147a3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378142:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147a3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378177:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841479c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378192:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841479c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378198:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841479c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378203:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841479c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378208:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.378211:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841479c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378218:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841479c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378226:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:0.0:1786002524.378229:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.378232:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841479c lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378237:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841479c lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378247:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147a3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378253:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147a3 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378257:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147a3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378272:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.378275:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147a3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378286:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147a3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378291:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xdcc87686 (ffff9ed351207800) 00010000:00010000:0.0:1786002524.378294:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.378296:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147a3 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378301:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147a3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378331:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414795 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa35 expref: 30 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378354:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:0.0:1786002524.378364:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002524.378368:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414795 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa35 expref: 30 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.378378:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34600, rc 0) 00000100:00100000:0.0:1786002524.378429:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18394:x1872758530886144:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 497us (691us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002524.378437:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23853 00000100:00100000:2.0:1786002524.396598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.396684:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530886400 00000100:00100000:0.0:1786002524.396693:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530886400 00000100:00100000:0.0:1786002524.396752:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23854 00000100:00100000:0.0:1786002524.396762:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18394:x1872758530886400:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:0.0:1786002524.396781:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002524.396799:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784147aa lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa3c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.396895:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784147b1 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.396908:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784147b1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.396919:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784147b1 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.396928:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.396938:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784144ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784144e7 expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.396946:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.396974:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784144ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af5784144e7 expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002524.396988:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560952704:0@lo:104: 00000100:00100000:0.0:1786002524.397029:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002524.397094:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002524.397234:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560952704 00000100:00100000:3.0:1786002524.397240:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560952704 00000100:00100000:3.0:1786002524.397275:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:3.0:1786002524.397281:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:14496:x1872758560952704:12345-0@lo:104: 00010000:00010000:3.0:1786002524.397292:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784144ee expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.397346:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786002524.397351:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:14496:x1872758560952704:12345-0@lo:104: Request processed in 71us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002524.397357:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00010000:00010000:3.0:1786002524.397379:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002524.397385:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784144ee expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.397393:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002524.397397:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af5784144ee expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002524.397406:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af5784144ee expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.397428:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784144ee expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.397434:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002524.397453:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784144ee expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.397460:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af5784144e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784144ee expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.397478:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002524.397480:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002524.397481:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002524.397493:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560952832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002524.397519:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002524.397550:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560952832 00000100:00100000:3.0:1786002524.397554:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560952832 00010000:00010000:3.0:1786002524.397568:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784144ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af5784144e7 expref: 17 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002524.397595:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00000100:00100000:3.0:1786002524.397600:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+17:3646:x1872758560952832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002524.397609:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1786002524.398493:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560952704:0@lo:104: 00010000:00010000:0.0:1786002524.398510:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002524.406538:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968537 is committed 00000001:00080000:2.0:1786002524.406557:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968533 is committed 00000020:00080000:2.0:1786002524.406565:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 416 batchid updated 00000020:00080000:1.0:1786002524.406607:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 416 00000004:00080000:1.0:1786002524.406671:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed353790540 with version 791 00000020:00080000:1.0:1786002524.406692:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 416 cancel update log [0x200000401:0x3:0x0].413: rc = 0 00000020:00080000:1.0:1786002524.406778:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 416 cancel update log [0x240000400:0x3:0x0].413: rc = 0 00000020:00080000:1.0:1786002524.406786:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 416 00000004:00080000:3.0:1786002524.406836:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 791 rpc_version 791 00000020:00100000:3.0:1786002524.406886:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002524.406896:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2423f9180 x1872758560953088/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002524.406919:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560953088:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002524.406983:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002524.407018:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002524.407074:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560953088 00000100:00100000:1.0:1786002524.407088:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560953088 00000100:00100000:1.0:1786002524.407133:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:1.0:1786002524.407141:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7466:x1872758560953088:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002524.407261:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7466:x1872758560953088:12345-0@lo:1000:osp_up0-1.0 Request processed in 120us (278us total) trans 4294983570 rc 0/0 00000100:00100000:1.0:1786002524.407276:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:3.0:1786002524.407631:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560953088:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1786002524.416474:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784144ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af5784144e7 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.416511:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xdcc87686 (ffff9ed351207900) 00010000:00010000:3.0:1786002524.416517:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.416527:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.416534:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.424315:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002524.424394:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3646:x1872758560952832:12345-0@lo:103:ldlm_bl.0 Request processed in 26789us (26870us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002524.424406:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00000100:00100000:3.0:1786002524.424505:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560952832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002524.424602:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424614:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424726:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784147bf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424746:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784147bf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424757:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784147bf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002524.424767:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x195:0x0]: returning size 2 00010000:00010000:0.0:1786002524.424842:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784147b1 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424894:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784147b1 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424899:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784147b1 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424905:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784147b1 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424913:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.424917:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784147b1 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424923:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784147b1 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424933:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:0.0:1786002524.424939:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.424942:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784147b1 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424947:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784147b1 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424959:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424964:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424969:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424974:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.424976:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424980:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424989:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xdcc87686 (ffff9ed351207900) 00010000:00010000:0.0:1786002524.424991:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.424993:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.424997:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784147b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.425192:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784147aa lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa3c expref: 13 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.425207:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784147bf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa3c expref: 12 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.425213:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff9ed351207000) 00010000:00010000:0.0:1786002524.425215:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002524.425217:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34400, rc 0) 00000100:00100000:0.0:1786002524.425259:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18394:x1872758530886400:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 28499us (28671us total) trans 4294968538 rc 0/0 00000100:00100000:0.0:1786002524.425319:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23854 00000100:00100000:2.0:1786002524.432984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.435065:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530886528 00000100:00100000:1.0:1786002524.435085:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530886528 00000100:00100000:1.0:1786002524.435199:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5201 00000100:00100000:1.0:1786002524.435210:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2410:x1872758530886528:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002524.435227:0:14686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.435246:0:14686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af5784147cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa43 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002524.435284:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c7:0x0] initial LVB size: 2, mtime: 0x6a743c5a, atime: 0x0, ctime: 0x6a743c5a, blocks: 0x8 00010000:00010000:1.0:1786002524.435304:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c7:0x0].0x0 since=884s v=(0 0) 00010000:00010000:1.0:1786002524.435318:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002524.435348:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af5784147cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa43 expref: 13 pid: 14686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.435378:0:14686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af5784147cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa43 expref: 13 pid: 14686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.435395:0:14686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f600, rc 0) 00000100:00100000:1.0:1786002524.435463:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2410:x1872758530886528:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 254us (2486us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.435470:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5201 00000100:00080000:2.0:1786002524.436112:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002524.440794:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.440875:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530886656 00000100:00100000:0.0:1786002524.440885:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530886656 00002000:00100000:0.0:1786002524.440931:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c7:0x0] (0->4095) req@ffff9ed37137ea00 x1872758530886656/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:205/0 lens 488/0 e 0 to 0 dl 1786002535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002524.440942:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37137ea00 with x1872758530886656 ext(0->4095) 00002000:00010000:0.0:1786002524.440948:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37137ea00 00000100:00100000:0.0:1786002524.440982:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 2 00000100:00100000:0.0:1786002524.440992:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2411:x1872758530886656:12345-192.168.203.49@tcp:3:cmp.0 00000100:00100000:0.0:1786002524.441160:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2411:x1872758530886656:12345-192.168.203.49@tcp:3:cmp.0 Request processed in 168us (373us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786002524.441168:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 2 00002000:00100000:0.0:1786002524.441175:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c7:0x0] (0->4095) req@ffff9ed37137ea00 x1872758530886656/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:205/0 lens 488/4536 e 0 to 0 dl 1786002535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002524.441182:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37137ea00 with x1872758530886656 ext(0->4095) 00002000:00010000:0.0:1786002524.441185:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37137ea00 00000100:00100000:0.0:1786002524.456361:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002524.456445:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530886912 00000100:00100000:2.0:1786002524.456455:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530886912 00000100:00100000:2.0:1786002524.456504:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5086 00000100:00100000:2.0:1786002524.456513:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18394:x1872758530886912:12345-192.168.203.49@tcp:35:cmp.0 00000100:00100000:2.0:1786002524.456775:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:18394:x1872758530886912:12345-192.168.203.49@tcp:35:cmp.0 Request processed in 261us (420us total) trans 4294968539 rc 0/0 00000100:00100000:2.0:1786002524.456787:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5086 00000100:00100000:3.0:1786002524.478984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.479188:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530887040 00000100:00100000:1.0:1786002524.479197:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530887040 00000100:00100000:1.0:1786002524.479247:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3846 00000100:00100000:1.0:1786002524.479256:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2413:x1872758530887040:12345-192.168.203.49@tcp:63:ll_sa.0 00010000:00010000:1.0:1786002524.479316:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.479334:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784147d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa4a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479383:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784147db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479396:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784147db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479406:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784147db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479419:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784147e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479425:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784147e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479432:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784147e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479492:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784147db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479499:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784147db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479505:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784147db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479511:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.479515:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784147db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479521:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784147db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479532:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002524.479535:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.479539:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784147db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479545:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784147db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479555:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784147e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479561:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784147e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479566:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784147e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479572:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.479575:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784147e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479580:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784147e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479586:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9ed245ddc800) 00010000:00010000:1.0:1786002524.479588:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.479591:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784147e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479596:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af5784147e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479621:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784147d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa4a expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479630:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002524.479632:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002524.479636:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784147d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa4a expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.479644:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f800, rc -2) 00000100:00100000:1.0:1786002524.479689:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2413:x1872758530887040:12345-192.168.203.49@tcp:63:ll_sa.0 Request processed in 434us (712us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002524.479696:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3846 00000100:00100000:3.0:1786002524.493121:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.493265:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530887296 00000100:00100000:0.0:1786002524.493275:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530887296 00000100:00100000:0.0:1786002524.493341:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23855 00000100:00100000:0.0:1786002524.493351:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18396:x1872758530887296:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:0.0:1786002524.493368:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002524.493388:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147e9 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa82 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493456:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784147f0 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493480:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784147f0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493495:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784147f0 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493506:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784147f7 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493515:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784147f7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493520:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784147f7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493551:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784147f0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493556:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784147f0 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493561:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784147f0 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493567:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784147f0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493572:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.493576:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784147f0 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493582:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784147f0 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493591:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:0.0:1786002524.493595:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.493599:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784147f0 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493604:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784147f0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493617:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784147f7 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493624:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784147f7 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493629:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784147f7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493634:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.493637:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784147f7 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493643:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784147f7 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493650:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xbc0ca3a9 (ffff9ed245fedf00) 00010000:00010000:0.0:1786002524.493653:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.493656:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784147f7 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493661:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784147f7 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493689:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147e9 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa82 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493698:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:0.0:1786002524.493701:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002524.493704:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af5784147e9 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa82 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.493712:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35600, rc 0) 00000100:00100000:0.0:1786002524.493780:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18396:x1872758530887296:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 430us (667us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002524.493787:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23855 00000100:00100000:0.0:1786002524.497984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002524.498058:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530887552 00000100:00100000:2.0:1786002524.498068:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530887552 00000100:00100000:2.0:1786002524.498138:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23856 00000100:00100000:2.0:1786002524.498148:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:18396:x1872758530887552:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:2.0:1786002524.498168:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002524.498186:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af5784147fe lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa89 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.498248:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414805 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.498260:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414805 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.498270:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414805 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.498281:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.498290:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ea00/0x7cee4af5784145c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784145b9 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.498298:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.498326:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ea00/0x7cee4af5784145c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af5784145b9 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002524.498347:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758560953216:0@lo:104: 00000100:00100000:2.0:1786002524.498410:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002524.498461:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002524.498607:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560953216 00000100:00100000:0.0:1786002524.498612:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560953216 00000100:00100000:0.0:1786002524.498649:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1786002524.498657:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6520:x1872758560953216:12345-0@lo:104: 00010000:00010000:0.0:1786002524.498668:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784145c0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.498719:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786002524.498725:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6520:x1872758560953216:12345-0@lo:104: Request processed in 69us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002524.498731:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00010000:00010000:0.0:1786002524.498763:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002524.498769:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af5784145c0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.498776:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002524.498780:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af5784145c0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002524.498788:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af5784145c0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.498811:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784145c0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.498817:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002524.498833:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784145c0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.498841:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8c200/0x7cee4af5784145b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af5784145c0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.498877:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002524.498879:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002524.498880:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002524.498890:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560953344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002524.498915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002524.498990:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758560953216:0@lo:104: 00010000:00010000:2.0:1786002524.499007:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002524.499065:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560953344 00000100:00100000:3.0:1786002524.499069:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560953344 00010000:00010000:3.0:1786002524.499100:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ea00/0x7cee4af5784145c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af5784145b9 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002524.499126:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:3.0:1786002524.499134:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+10:3647:x1872758560953344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002524.499142:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1786002524.501769:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968539 is committed 00010000:00010000:2.0:1786002524.508243:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ea00/0x7cee4af5784145c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af5784145b9 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.508264:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xbc0ca3a9 (ffff9ed245ddc100) 00010000:00010000:2.0:1786002524.508289:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.508298:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.508306:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.508376:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002524.508449:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3647:x1872758560953344:12345-0@lo:103:ldlm_bl.0 Request processed in 9315us (9531us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002524.508459:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00100000:1.0:1786002524.509497:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560953344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002524.511990:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512005:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512229:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414813 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512241:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414813 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512251:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414813 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002524.512266:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x197:0x0]: returning size 2 00010000:00010000:0.0:1786002524.512366:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414805 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512374:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414805 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512380:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414805 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512386:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414805 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512392:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.512396:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414805 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512403:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414805 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512415:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:0.0:1786002524.512417:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.512422:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414805 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512428:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414805 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512442:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512452:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512458:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512463:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.512465:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512471:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512477:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xbc0ca3a9 (ffff9ed245ddc100) 00010000:00010000:0.0:1786002524.512480:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.512482:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512487:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af57841480c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512532:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af5784147fe lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa89 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512545:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414813 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa89 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.512551:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff9ed351207900) 00010000:00010000:0.0:1786002524.512553:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002524.512996:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34600, rc 0) 00000100:00100000:0.0:1786002524.513116:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:18396:x1872758530887552:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 14968us (15139us total) trans 4294968540 rc 0/0 00000100:00100000:0.0:1786002524.513125:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23856 00000100:00100000:1.0:1786002524.522244:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758560953472:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.522314:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002524.522359:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758560953984:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.522389:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002524.522406:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560954496:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.522430:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002524.522456:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786002524.522463:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758560953600:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.522485:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002524.522504:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560954112:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.522527:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002524.522571:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560954496 00000100:00100000:1.0:1786002524.522578:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560954496 00000100:00100000:1.0:1786002524.522631:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560954112 00000100:00100000:1.0:1786002524.522634:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560954112 00000100:00100000:1.0:1786002524.522656:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1786002524.522665:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758560954496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.522714:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758560954496:12345-0@lo:400:kworker.0 Request processed in 49us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.522721:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1786002524.522736:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1786002524.522754:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758560954112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.522784:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758560954112:12345-0@lo:400:kworker.0 Request processed in 42us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.522790:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00080000:1.0:1786002524.522810:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786002524.522814:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002524.522829:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758560953856:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.522879:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002524.522895:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758560954368:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.522916:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002524.522936:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786002524.522941:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758560953728:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.522961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002524.522978:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758560954240:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.522999:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002524.523020:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560953984 00000100:00100000:1.0:1786002524.523024:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560953984 00000100:00100000:1.0:1786002524.523051:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560953600 00000100:00100000:1.0:1786002524.523054:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560953600 00000100:00100000:1.0:1786002524.523065:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560953856 00000100:00100000:1.0:1786002524.523067:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560953856 00000100:00100000:1.0:1786002524.523092:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560954368 00000100:00100000:1.0:1786002524.523096:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560954368 00000100:00100000:1.0:1786002524.523108:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560953728 00000100:00100000:1.0:1786002524.523111:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560953728 00000100:00100000:1.0:1786002524.523121:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560954240 00000100:00100000:1.0:1786002524.523123:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560954240 00000100:00100000:1.0:1786002524.523134:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:1.0:1786002524.523141:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758560953984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523173:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758560953984:12345-0@lo:400:kworker.0 Request processed in 32us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.523179:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:1.0:1786002524.523192:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1786002524.523198:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758560953600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523225:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758560953600:12345-0@lo:400:kworker.0 Request processed in 27us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.523231:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1786002524.523243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1786002524.523249:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758560953856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523280:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758560953856:12345-0@lo:400:kworker.0 Request processed in 32us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.523286:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1786002524.523297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1786002524.523303:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758560954368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523330:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758560954368:12345-0@lo:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.523334:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1786002524.523345:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1786002524.523350:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758560953728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523375:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758560953728:12345-0@lo:400:kworker.0 Request processed in 25us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.523380:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1786002524.523390:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1786002524.523396:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758560954240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523421:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758560954240:12345-0@lo:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.523427:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00080000:1.0:1786002524.523440:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786002524.523444:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002524.523482:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758560953728:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523496:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758560954240:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523504:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758560953856:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523512:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758560954368:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523546:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758560953600:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523557:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560954112:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523565:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758560953984:0@lo:400:kworker.0 00000100:00100000:1.0:1786002524.523573:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560954496:0@lo:400:kworker.0 00000100:00100000:2.0:1786002524.523825:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560953472 00000100:00100000:2.0:1786002524.523830:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560953472 00000100:00100000:2.0:1786002524.523875:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1786002524.523882:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758560953472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002524.523919:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758560953472:12345-0@lo:400:kworker.0 Request processed in 38us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002524.523925:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1786002524.524259:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560954624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002524.524294:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002524.524374:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560954624 00000100:00100000:2.0:1786002524.524378:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560954624 00000100:00100000:2.0:1786002524.524415:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1786002524.524422:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3645:x1872758560954624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002524.524436:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42335680 pending 86016 free 3923492864 avail 3691970560 00000100:00100000:2.0:1786002524.524479:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3645:x1872758560954624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002524.524485:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1786002524.524754:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560954624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002524.525658:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560954752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002524.525695:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002524.525774:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758560953472:0@lo:400:kworker.0 00000100:00100000:2.0:1786002524.528998:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560954752 00000100:00100000:2.0:1786002524.529010:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560954752 00000100:00100000:2.0:1786002524.529069:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1786002524.529088:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560954752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002524.529111:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42335680 pending 86016 free 3923492864 avail 3691970560 00000100:00100000:3.0:1786002524.529992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.530108:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530887680 00000100:00100000:1.0:1786002524.530113:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530887680 00000100:00100000:1.0:1786002524.530160:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5202 00000100:00100000:1.0:1786002524.530168:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2413:x1872758530887680:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002524.530179:0:14678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.530200:0:14678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a766f448/0x7cee4af578414821 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa90 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002524.530223:0:14678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c8:0x0] initial LVB size: 2, mtime: 0x6a743c5a, atime: 0x0, ctime: 0x6a743c5a, blocks: 0x8 00010000:00010000:1.0:1786002524.530240:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=884s v=(0 0) 00010000:00010000:1.0:1786002524.530245:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002524.530254:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a766f448/0x7cee4af578414821 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa90 expref: 14 pid: 14678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.530271:0:14678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a766f448/0x7cee4af578414821 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa90 expref: 14 pid: 14678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.530285:0:14678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f800, rc 0) 00000100:00100000:1.0:1786002524.530327:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2413:x1872758530887680:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 159us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.530334:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5202 00000100:00080000:3.0:1786002524.530436:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002524.531104:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560954752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2024us (5406us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002524.531113:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1786002524.539766:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560954752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786002524.543784:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.546191:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530887808 00000100:00100000:0.0:1786002524.546205:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530887808 00002000:00100000:0.0:1786002524.546253:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->4095) req@ffff9ed2423fb100 x1872758530887808/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:205/0 lens 488/0 e 0 to 0 dl 1786002535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002524.546275:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2423fb100 with x1872758530887808 ext(0->4095) 00002000:00010000:0.0:1786002524.546281:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2423fb100 00000100:00100000:0.0:1786002524.546314:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3 00000100:00100000:0.0:1786002524.546323:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2413:x1872758530887808:12345-192.168.203.49@tcp:3:cmp.0 00000100:00100000:0.0:1786002524.546495:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2413:x1872758530887808:12345-192.168.203.49@tcp:3:cmp.0 Request processed in 172us (2717us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786002524.546502:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3 00002000:00100000:0.0:1786002524.546508:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c8:0x0] (0->4095) req@ffff9ed2423fb100 x1872758530887808/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:205/0 lens 488/4536 e 0 to 0 dl 1786002535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002524.546516:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2423fb100 with x1872758530887808 ext(0->4095) 00002000:00010000:0.0:1786002524.546519:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2423fb100 00000100:00100000:1.0:1786002524.570824:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002524.571244:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530888064 00000100:00100000:2.0:1786002524.571253:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530888064 00000100:00100000:2.0:1786002524.571308:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5087 00000100:00100000:2.0:1786002524.571317:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:18396:x1872758530888064:12345-192.168.203.49@tcp:35:cmp.0 00000100:00100000:2.0:1786002524.571579:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18396:x1872758530888064:12345-192.168.203.49@tcp:35:cmp.0 Request processed in 262us (762us total) trans 4294968541 rc 0/0 00000100:00100000:2.0:1786002524.571586:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5087 00000100:00100000:3.0:1786002524.612465:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.612552:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530888320 00000100:00100000:1.0:1786002524.612562:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530888320 00000100:00100000:1.0:1786002524.612622:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23857 00000100:00100000:1.0:1786002524.612632:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18400:x1872758530888320:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002524.612651:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.612670:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414828 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa97 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612737:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841482f lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612760:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841482f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612771:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841482f lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612783:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414836 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612791:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414836 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612797:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414836 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612834:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841482f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612842:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841482f lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612879:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841482f lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612886:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841482f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612892:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.612896:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841482f lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612902:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841482f lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612913:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:1.0:1786002524.612916:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.612920:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841482f lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612926:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af57841482f lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612938:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414836 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612943:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414836 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612948:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414836 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612952:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.612954:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414836 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612959:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414836 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612965:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x84832a57 (ffff9ed245fed400) 00010000:00010000:1.0:1786002524.612967:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.612969:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414836 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.612974:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af578414836 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.613001:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414828 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa97 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.613010:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:1.0:1786002524.613013:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002524.613016:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414828 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa97 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.613025:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e200, rc 0) 00000100:00100000:1.0:1786002524.613098:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18400:x1872758530888320:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 466us (640us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002524.613106:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23857 00000100:00100000:3.0:1786002524.621636:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.622351:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530888576 00000100:00100000:1.0:1786002524.622361:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530888576 00000100:00100000:1.0:1786002524.622412:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23858 00000100:00100000:1.0:1786002524.622423:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18400:x1872758530888576:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002524.622444:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.622463:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af57841483d lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aa9e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.622546:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578414844 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.622559:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578414844 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.622568:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578414844 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.622578:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.622587:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414485 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841447e expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.622599:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.622631:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414485 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af57841447e expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002524.622646:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758560954880:0@lo:104: 00000100:00100000:1.0:1786002524.622689:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002524.622755:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6600 going to sleep for 11 seconds 00000100:00100000:2.0:1786002524.622874:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560954880 00000100:00100000:2.0:1786002524.622879:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560954880 00000100:00100000:2.0:1786002524.622916:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:2.0:1786002524.622922:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6522:x1872758560954880:12345-0@lo:104: 00010000:00010000:2.0:1786002524.622936:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414485 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.622982:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786002524.622988:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6522:x1872758560954880:12345-0@lo:104: Request processed in 66us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002524.622994:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00010000:00010000:3.0:1786002524.623254:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002524.623271:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414485 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.623279:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8de00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002524.623284:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578414485 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002524.623291:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578414485 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.623317:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414485 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.623323:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002524.623355:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414485 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.623362:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed245c8de00/0x7cee4af57841447e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414485 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.623382:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002524.623384:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002524.623386:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002524.623483:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786002524.623495:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560955008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002524.623529:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002524.623671:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560955008 00000100:00100000:3.0:1786002524.623676:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560955008 00010000:00010000:3.0:1786002524.623694:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414485 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af57841447e expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002524.623727:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00000100:00100000:3.0:1786002524.623735:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3646:x1872758560955008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002524.623753:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1786002524.624818:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758560954880:0@lo:104: 00010000:00010000:1.0:1786002524.624836:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002524.630726:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968541 is committed 00010000:00010000:1.0:1786002524.630882:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414485 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af57841447e expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.630900:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x84832a57 (ffff9ed245ddcd00) 00010000:00010000:1.0:1786002524.630905:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.630915:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.630921:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.630955:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002524.631030:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3646:x1872758560955008:12345-0@lo:103:ldlm_bl.0 Request processed in 7294us (7497us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.631040:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00010000:00010000:0.0:1786002524.631119:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631127:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631225:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578414852 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631235:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578414852 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631243:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578414852 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002524.631253:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x194:0x0]: returning size 3 00010000:00010000:0.0:1786002524.631333:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578414844 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631341:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578414844 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631348:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578414844 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631354:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578414844 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631359:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.631363:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578414844 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631375:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578414844 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631384:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:0.0:1786002524.631386:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.631389:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578414844 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631395:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ee00/0x7cee4af578414844 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631405:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631412:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631417:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631422:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.631425:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631431:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631438:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x84832a57 (ffff9ed245ddcd00) 00010000:00010000:0.0:1786002524.631440:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.631443:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631452:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af57841484b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631492:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af57841483d lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa9e expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631505:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578414852 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa9e expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.631513:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff9ed351207400) 00010000:00010000:0.0:1786002524.631515:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002524.631518:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35600, rc 0) 00000100:00100000:0.0:1786002524.631571:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18400:x1872758530888576:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 9150us (9944us total) trans 4294968542 rc 0/0 00000100:00100000:0.0:1786002524.631578:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23858 00000100:00100000:3.0:1786002524.632003:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560955008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002524.635548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.635945:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530888704 00000100:00100000:1.0:1786002524.635954:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530888704 00000100:00100000:1.0:1786002524.636006:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5203 00000100:00100000:1.0:1786002524.636016:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2413:x1872758530888704:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002524.636033:0:14676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.636052:0:14676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b95571d0/0x7cee4af578414860 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aaa5 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002524.636077:0:14676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ca:0x0] initial LVB size: 3, mtime: 0x6a743c5a, atime: 0x0, ctime: 0x6a743c5a, blocks: 0x8 00010000:00010000:1.0:1786002524.636096:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=884s v=(0 0) 00010000:00010000:1.0:1786002524.636100:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002524.636110:0:14676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b95571d0/0x7cee4af578414860 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaa5 expref: 15 pid: 14676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.636127:0:14676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b95571d0/0x7cee4af578414860 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaa5 expref: 15 pid: 14676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.636140:0:14676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fc00, rc 0) 00000100:00100000:1.0:1786002524.636194:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2413:x1872758530888704:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 180us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.636201:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5203 00000100:00100000:2.0:1786002524.653285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.653504:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530888832 00000100:00100000:1.0:1786002524.653514:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530888832 00002000:00100000:1.0:1786002524.653563:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9ca:0x0] (0->4095) req@ffff9ed246629500 x1872758530888832/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:205/0 lens 488/0 e 0 to 0 dl 1786002535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002524.653579:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed246629500 with x1872758530888832 ext(0->4095) 00002000:00010000:1.0:1786002524.653585:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed246629500 00000100:00100000:1.0:1786002524.653623:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4 00000100:00100000:1.0:1786002524.653634:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2412:x1872758530888832:12345-192.168.203.49@tcp:3:cmp.0 00000100:00100000:1.0:1786002524.653799:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2412:x1872758530888832:12345-192.168.203.49@tcp:3:cmp.0 Request processed in 167us (520us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1786002524.653807:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4 00002000:00100000:1.0:1786002524.653813:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9ca:0x0] (0->4095) req@ffff9ed246629500 x1872758530888832/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:205/0 lens 488/4536 e 0 to 0 dl 1786002535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002524.653820:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed246629500 with x1872758530888832 ext(0->4095) 00002000:00010000:1.0:1786002524.653823:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed246629500 00000100:00100000:2.0:1786002524.675336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.675460:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530889088 00000100:00100000:1.0:1786002524.675470:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530889088 00000100:00100000:1.0:1786002524.675531:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5088 00000100:00100000:1.0:1786002524.675540:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18400:x1872758530889088:12345-192.168.203.49@tcp:35:cmp.0 00000100:00100000:0.0:1786002524.678503:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18400:x1872758530889088:12345-192.168.203.49@tcp:35:cmp.0 Request processed in 2957us (3168us total) trans 4294968543 rc 0/0 00000100:00100000:0.0:1786002524.678515:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5088 00000100:00100000:2.0:1786002524.710353:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.710472:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530889344 00000100:00100000:0.0:1786002524.710482:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530889344 00000100:00100000:0.0:1786002524.710537:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23859 00000100:00100000:0.0:1786002524.710546:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18402:x1872758530889344:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:0.0:1786002524.710566:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002524.710587:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414867 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aaac expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710666:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841486e lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710680:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841486e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710691:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841486e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710702:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414875 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710710:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414875 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710717:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414875 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710762:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841486e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710770:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841486e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710777:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841486e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710784:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841486e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710791:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.710796:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841486e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710803:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841486e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710815:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:0.0:1786002524.710818:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.710822:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841486e lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710829:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841486e lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710841:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414875 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710882:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414875 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710889:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414875 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710894:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.710897:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414875 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710904:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414875 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710911:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x391d5834 (ffff9ed366e57900) 00010000:00010000:0.0:1786002524.710914:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.710918:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414875 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710924:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414875 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710952:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414867 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaac expref: 30 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710962:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:0.0:1786002524.710964:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002524.710968:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414867 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaac expref: 30 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.710977:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35e00, rc 0) 00000100:00100000:0.0:1786002524.711035:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18402:x1872758530889344:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 489us (689us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002524.711042:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23859 00000100:00100000:2.0:1786002524.714400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.714503:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530889600 00000100:00100000:0.0:1786002524.714511:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530889600 00000100:00100000:0.0:1786002524.714568:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23860 00000100:00100000:0.0:1786002524.714578:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18402:x1872758530889600:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:0.0:1786002524.714600:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002524.714620:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841487c lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aab3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.714682:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414883 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.714698:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414883 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.714708:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414883 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.714717:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.714726:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578414629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414622 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.714733:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.714780:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578414629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578414622 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002524.714795:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758560955136:0@lo:104: 00000100:00100000:0.0:1786002524.714844:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002524.714910:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002524.714966:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786002524.714978:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560955136 00000100:00100000:3.0:1786002524.714982:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560955136 00000100:00100000:3.0:1786002524.715007:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1786002524.715014:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6520:x1872758560955136:12345-0@lo:104: 00010000:00010000:3.0:1786002524.715025:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414629 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.715082:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786002524.715088:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6520:x1872758560955136:12345-0@lo:104: Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002524.715095:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00010000:00010000:3.0:1786002524.715138:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002524.715144:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414629 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.715152:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002524.715158:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578414629 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002524.715171:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578414629 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.715194:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414629 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.715200:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002524.715217:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414629 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.715224:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a200/0x7cee4af578414622 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414629 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.715241:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002524.715242:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002524.715244:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002524.715250:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786002524.715258:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560955264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002524.715283:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002524.715341:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560955264 00000100:00100000:0.0:1786002524.715345:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560955264 00010000:00010000:0.0:1786002524.715361:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578414629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578414622 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002524.715396:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665 00000100:00100000:0.0:1786002524.715402:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3645:x1872758560955264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002524.715411:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1786002524.715759:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758560955136:0@lo:104: 00010000:00010000:0.0:1786002524.715777:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002524.726202:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968543 is committed 00010000:00010000:2.0:1786002524.726329:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af578414629 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578414622 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.726349:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x391d5834 (ffff9ed245ddc900) 00010000:00010000:2.0:1786002524.726355:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.726373:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.726382:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.726415:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002524.726487:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1872758560955264:12345-0@lo:103:ldlm_bl.0 Request processed in 11084us (11201us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002524.726497:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665 00000100:00100000:3.0:1786002524.726624:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560955264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002524.726684:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.726693:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.726810:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414891 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.726824:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414891 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.726832:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414891 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002524.726842:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x198:0x0]: returning size 2 00010000:00010000:1.0:1786002524.726949:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414883 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.726957:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414883 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.726963:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414883 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.726969:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414883 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.726974:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.726978:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414883 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.726985:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414883 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.726993:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:1.0:1786002524.726996:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.727000:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414883 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.727005:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414883 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.727016:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.727021:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.727027:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.727031:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.727033:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.727039:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.727046:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x391d5834 (ffff9ed245ddc900) 00010000:00010000:1.0:1786002524.727048:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.727050:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.727056:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841488a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.727112:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841487c lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aab3 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.727127:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414891 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aab3 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.727139:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002524.727141:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002524.727144:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fe00, rc 0) 00000100:00100000:1.0:1786002524.727182:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18402:x1872758530889600:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 12606us (12790us total) trans 4294968544 rc 0/0 00000100:00100000:1.0:1786002524.727189:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23860 00000100:00100000:3.0:1786002524.737315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.737391:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530889728 00000100:00100000:1.0:1786002524.737400:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530889728 00000100:00100000:1.0:1786002524.737454:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5204 00000100:00100000:1.0:1786002524.737463:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758530889728:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002524.737480:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.737498:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c03ff8f/0x7cee4af57841489f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aaba expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002524.737520:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c8:0x0] initial LVB size: 2, mtime: 0x6a743c5a, atime: 0x0, ctime: 0x6a743c5a, blocks: 0x8 00010000:00010000:1.0:1786002524.737539:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=884s v=(0 0) 00010000:00010000:1.0:1786002524.737543:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002524.737552:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c03ff8f/0x7cee4af57841489f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaba expref: 14 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.737568:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000c03ff8f/0x7cee4af57841489f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaba expref: 14 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.737582:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e600, rc 0) 00000100:00100000:1.0:1786002524.737640:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2412:x1872758530889728:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 177us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.737647:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5204 00000100:00100000:1.0:1786002524.745337:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.745405:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530889856 00000100:00100000:0.0:1786002524.745414:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530889856 00002000:00100000:0.0:1786002524.745460:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->4095) req@ffff9ed2455f1c00 x1872758530889856/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:205/0 lens 488/0 e 0 to 0 dl 1786002535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002524.745470:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455f1c00 with x1872758530889856 ext(0->4095) 00002000:00010000:0.0:1786002524.745475:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455f1c00 00000100:00100000:0.0:1786002524.745503:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5 00000100:00100000:0.0:1786002524.745512:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2411:x1872758530889856:12345-192.168.203.49@tcp:3:cmp.0 00000100:00100000:0.0:1786002524.745654:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2411:x1872758530889856:12345-192.168.203.49@tcp:3:cmp.0 Request processed in 141us (324us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786002524.745662:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5 00002000:00100000:0.0:1786002524.745669:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9c8:0x0] (0->4095) req@ffff9ed2455f1c00 x1872758530889856/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:205/0 lens 488/4536 e 0 to 0 dl 1786002535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002524.745677:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455f1c00 with x1872758530889856 ext(0->4095) 00002000:00010000:0.0:1786002524.745680:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455f1c00 00000100:00100000:3.0:1786002524.755933:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.756014:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530890112 00000100:00100000:0.0:1786002524.756023:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530890112 00000100:00100000:0.0:1786002524.756081:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5089 00000100:00100000:0.0:1786002524.756091:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18402:x1872758530890112:12345-192.168.203.49@tcp:35:cmp.0 00000100:00100000:0.0:1786002524.756363:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18402:x1872758530890112:12345-192.168.203.49@tcp:35:cmp.0 Request processed in 272us (437us total) trans 4294968545 rc 0/0 00000100:00100000:0.0:1786002524.756382:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5089 00000100:00100000:3.0:1786002524.760238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.760355:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530890240 00000100:00100000:1.0:1786002524.760364:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530890240 00000100:00100000:1.0:1786002524.760434:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3847 00000100:00100000:1.0:1786002524.760445:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2413:x1872758530890240:12345-192.168.203.49@tcp:63:ll_sa.0 00010000:00010000:1.0:1786002524.760481:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.760502:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af5784148a6 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aac1 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760571:0:15596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784148ad lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760589:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784148ad lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760601:0:15596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784148ad lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760612:0:15596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784148b4 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760620:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784148b4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760626:0:15596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784148b4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760663:0:15596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784148ad lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760671:0:15596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784148ad lrc: 2/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760678:0:15596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784148ad lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760683:0:15596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.760687:0:15596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784148ad lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760694:0:15596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784148ad lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760705:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:1.0:1786002524.760708:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.760711:0:15596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784148ad lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760717:0:15596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af5784148ad lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760728:0:15596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784148b4 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760733:0:15596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784148b4 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760750:0:15596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784148b4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760755:0:15596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.760758:0:15596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784148b4 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760764:0:15596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784148b4 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760771:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x18618557 (ffff9ed245fedb00) 00010000:00010000:1.0:1786002524.760773:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.760776:0:15596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784148b4 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760781:0:15596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af5784148b4 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760803:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af5784148a6 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aac1 expref: 30 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760812:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:1.0:1786002524.760814:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002524.760818:0:15596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af5784148a6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aac1 expref: 30 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.760826:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f400, rc -2) 00000100:00100000:1.0:1786002524.761229:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2413:x1872758530890240:12345-192.168.203.49@tcp:63:ll_sa.0 Request processed in 785us (1267us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002524.761236:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3847 00000100:00100000:1.0:1786002524.802795:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.802883:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530890496 00000100:00100000:0.0:1786002524.802894:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530890496 00000100:00100000:0.0:1786002524.802950:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23861 00000100:00100000:0.0:1786002524.802959:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18406:x1872758530890496:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:0.0:1786002524.802977:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002524.802996:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784148bb lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aadd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803074:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784148c2 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803099:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784148c2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803110:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784148c2 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803120:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784148c9 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803127:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784148c9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803133:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784148c9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803167:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784148c2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803178:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784148c2 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803184:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784148c2 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803189:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784148c2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803195:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.803198:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784148c2 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803205:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784148c2 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803215:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:0.0:1786002524.803218:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.803222:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784148c2 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803228:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af5784148c2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803240:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784148c9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803246:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784148c9 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803251:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784148c9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803256:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002524.803259:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784148c9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803264:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784148c9 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803270:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x18618557 (ffff9ed245fedb00) 00010000:00010000:0.0:1786002524.803272:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002524.803275:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784148c9 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803280:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784148c9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803306:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784148bb lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aadd expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803317:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:0.0:1786002524.803319:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002524.803322:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784148bb lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aadd expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.803333:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35e00, rc 0) 00000100:00100000:0.0:1786002524.803402:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18406:x1872758530890496:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 444us (616us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002524.803408:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23861 00000100:00100000:3.0:1786002524.806119:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.806205:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530890752 00000100:00100000:1.0:1786002524.806214:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530890752 00000100:00100000:1.0:1786002524.806306:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23862 00000100:00100000:1.0:1786002524.806318:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18406:x1872758530890752:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002524.806338:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.806356:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af5784148d0 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aae4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.806434:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784148d7 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.806447:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784148d7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.806477:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784148d7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.806491:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.806501:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ec00/0x7cee4af578414692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841468b expref: 6 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.806509:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.806539:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ec00/0x7cee4af578414692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af57841468b expref: 6 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002524.806555:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560955392:0@lo:104: 00000100:00100000:1.0:1786002524.806597:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002524.806656:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002524.806779:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560955392 00000100:00100000:3.0:1786002524.806783:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560955392 00000100:00100000:3.0:1786002524.806835:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:3.0:1786002524.806843:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6521:x1872758560955392:12345-0@lo:104: 00010000:00010000:3.0:1786002524.806894:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414692 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.806947:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786002524.806953:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6521:x1872758560955392:12345-0@lo:104: Request processed in 111us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002524.806960:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00010000:00010000:3.0:1786002524.807004:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002524.807010:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414692 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.807019:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002524.807024:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578414692 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002524.807034:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578414692 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.807059:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414692 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.807065:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002524.807085:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414692 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.807093:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a400/0x7cee4af57841468b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414692 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.807116:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002524.807118:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002524.807119:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002524.807130:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560955520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002524.807158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002524.807188:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560955520 00000100:00100000:3.0:1786002524.807192:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560955520 00010000:00010000:3.0:1786002524.807206:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ec00/0x7cee4af578414692 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af57841468b expref: 7 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002524.807225:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00000100:00100000:3.0:1786002524.807231:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed345532850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1872758560955520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002524.807240:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1786002524.807901:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560955392:0@lo:104: 00010000:00010000:1.0:1786002524.807921:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002524.810523:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968545 is committed 00010000:00010000:0.0:1786002524.810638:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7ec00/0x7cee4af578414692 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af57841468b expref: 7 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.810657:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x18618557 (ffff9ed245ddc600) 00010000:00010000:0.0:1786002524.810663:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.810672:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.810680:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.810712:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002524.810786:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed345532850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1872758560955520:12345-0@lo:103:ldlm_bl.0 Request processed in 3554us (3626us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002524.810796:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00010000:00010000:1.0:1786002524.810910:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.810919:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811015:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af5784148e5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811025:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af5784148e5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811039:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af5784148e5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002524.811049:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x199:0x0]: returning size 2 00010000:00010000:1.0:1786002524.811124:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784148d7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811132:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784148d7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811138:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784148d7 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811145:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784148d7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811151:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.811154:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784148d7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811161:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784148d7 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811170:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:1.0:1786002524.811172:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.811176:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784148d7 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811181:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e200/0x7cee4af5784148d7 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811190:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811196:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811201:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811205:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.811207:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811212:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811218:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x18618557 (ffff9ed245ddc600) 00010000:00010000:1.0:1786002524.811220:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.811222:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811232:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7e000/0x7cee4af5784148de lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811269:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7f400/0x7cee4af5784148d0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aae4 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811282:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af5784148e5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aae4 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.811290:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9ed245ddc900) 00010000:00010000:1.0:1786002524.811293:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002524.811295:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fa00, rc 0) 00000100:00100000:3.0:1786002524.811437:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560955520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002524.812858:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18406:x1872758530890752:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 6526us (6729us total) trans 4294968546 rc 0/0 00000100:00100000:1.0:1786002524.812867:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23862 00000100:00100000:3.0:1786002524.824447:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.824518:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530890880 00000100:00100000:1.0:1786002524.824527:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530890880 00000100:00100000:1.0:1786002524.824585:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5205 00000100:00100000:1.0:1786002524.824594:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2413:x1872758530890880:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002524.824622:0:14686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.824643:0:14686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000279c0e5e/0x7cee4af5784148f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aaeb expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002524.824666:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c9:0x0] initial LVB size: 2, mtime: 0x6a743c5a, atime: 0x0, ctime: 0x6a743c5a, blocks: 0x8 00010000:00010000:1.0:1786002524.824686:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=885s v=(0 0) 00010000:00010000:1.0:1786002524.824691:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002524.824700:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000279c0e5e/0x7cee4af5784148f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaeb expref: 16 pid: 14686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.824717:0:14686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000279c0e5e/0x7cee4af5784148f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaeb expref: 16 pid: 14686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.824729:0:14686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7ee00, rc 0) 00000100:00100000:1.0:1786002524.824793:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758530890880:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 200us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.824800:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5205 00000100:00100000:3.0:1786002524.833375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.833542:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530891008 00000100:00100000:0.0:1786002524.833551:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530891008 00002000:00100000:0.0:1786002524.833701:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c9:0x0] (0->4095) req@ffff9ed244bb8000 x1872758530891008/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:205/0 lens 488/0 e 0 to 0 dl 1786002535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002524.833713:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244bb8000 with x1872758530891008 ext(0->4095) 00002000:00010000:0.0:1786002524.833718:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244bb8000 00000100:00100000:0.0:1786002524.833760:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:0.0:1786002524.833770:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2410:x1872758530891008:12345-192.168.203.49@tcp:3:cmp.0 00000100:00100000:0.0:1786002524.833950:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2410:x1872758530891008:12345-192.168.203.49@tcp:3:cmp.0 Request processed in 181us (593us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786002524.833957:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00002000:00100000:0.0:1786002524.833962:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9c9:0x0] (0->4095) req@ffff9ed244bb8000 x1872758530891008/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:205/0 lens 488/4536 e 0 to 0 dl 1786002535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002524.833971:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244bb8000 with x1872758530891008 ext(0->4095) 00002000:00010000:0.0:1786002524.833974:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244bb8000 00000100:00100000:3.0:1786002524.843349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.843781:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530891264 00000100:00100000:0.0:1786002524.843791:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530891264 00000100:00100000:0.0:1786002524.843878:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5090 00000100:00100000:0.0:1786002524.843889:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18406:x1872758530891264:12345-192.168.203.49@tcp:35:cmp.0 00000100:00100000:0.0:1786002524.844161:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18406:x1872758530891264:12345-192.168.203.49@tcp:35:cmp.0 Request processed in 273us (819us total) trans 4294968547 rc 0/0 00000100:00100000:0.0:1786002524.844169:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5090 00000100:00100000:3.0:1786002524.872224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.872309:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530891520 00000100:00100000:1.0:1786002524.872319:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530891520 00000100:00100000:1.0:1786002524.872379:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23863 00000100:00100000:1.0:1786002524.872389:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18408:x1872758530891520:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002524.872407:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.872426:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af5784148fa lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aaf2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872492:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414901 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872506:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414901 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872518:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414901 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872530:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414908 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872538:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414908 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872544:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414908 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872580:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414901 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872587:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414901 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872593:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414901 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872600:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414901 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872620:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.872624:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414901 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872630:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414901 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872642:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:1.0:1786002524.872646:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.872650:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414901 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872657:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414901 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872670:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414908 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872675:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414908 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872681:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414908 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872685:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.872687:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414908 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872692:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414908 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872699:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xb62e0cbf (ffff9ed351207600) 00010000:00010000:1.0:1786002524.872701:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.872704:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414908 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872710:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578414908 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872748:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af5784148fa lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaf2 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872758:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:1.0:1786002524.872761:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002524.872765:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af5784148fa lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaf2 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.872774:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f400, rc 0) 00000100:00100000:1.0:1786002524.872829:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18408:x1872758530891520:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 442us (613us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002524.872837:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23863 00000100:00100000:3.0:1786002524.876426:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002524.876510:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530891776 00000100:00100000:2.0:1786002524.876518:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530891776 00000100:00100000:2.0:1786002524.876574:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23864 00000100:00100000:2.0:1786002524.876584:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18408:x1872758530891776:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:2.0:1786002524.876606:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002524.876625:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af57841490f lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aaf9 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.876689:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578414916 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.876702:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578414916 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.876714:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578414916 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.876726:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.876736:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578414557 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414550 expref: 5 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.876754:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.876784:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578414557 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578414550 expref: 5 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002524.876804:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:10360:1872758560955648:0@lo:104: 00000100:00100000:2.0:1786002524.876881:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002524.876914:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a600 going to sleep for 11 seconds 00000100:00100000:1.0:1786002524.876964:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560955648 00000100:00100000:1.0:1786002524.876969:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560955648 00000100:00100000:1.0:1786002524.876992:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1786002524.876998:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10360:x1872758560955648:12345-0@lo:104: 00010000:00010000:1.0:1786002524.877009:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414557 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.877065:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786002524.877072:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:10360:x1872758560955648:12345-0@lo:104: Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.877089:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00010000:00010000:1.0:1786002524.877110:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002524.877116:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414557 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.877125:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002524.877130:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578414557 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002524.877139:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578414557 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.877168:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414557 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.877175:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002524.877194:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414557 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.877201:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34e00/0x7cee4af578414550 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414557 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.877218:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002524.877220:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002524.877221:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002524.877232:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560955776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002524.877260:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002524.877479:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:10360:1872758560955648:0@lo:104: 00010000:00010000:2.0:1786002524.877496:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002524.877554:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560955776 00000100:00100000:3.0:1786002524.877559:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560955776 00010000:00010000:3.0:1786002524.877580:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578414557 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578414550 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002524.877608:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1667 00000100:00100000:3.0:1786002524.877615:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1872758560955776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002524.877624:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1786002524.885943:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968547 is committed 00010000:00010000:3.0:1786002524.887180:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578414557 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578414550 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.887198:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xb62e0cbf (ffff9ed351207300) 00010000:00010000:3.0:1786002524.887203:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.887212:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.887218:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002524.887250:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002524.887329:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560955776:12345-0@lo:103:ldlm_bl.0 Request processed in 9712us (10066us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002524.887339:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1667 00010000:00010000:2.0:1786002524.887439:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887447:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887549:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414924 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x196:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887559:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414924 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887567:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414924 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002524.887578:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x196:0x0]: returning size 2 00000100:00100000:1.0:1786002524.887613:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560955776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002524.887671:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578414916 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887679:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578414916 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887685:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578414916 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887692:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578414916 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887698:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002524.887702:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578414916 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887710:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578414916 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887719:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:2.0:1786002524.887721:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002524.887725:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578414916 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887730:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578414916 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887751:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887757:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887762:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887767:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002524.887769:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887779:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887785:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xb62e0cbf (ffff9ed351207300) 00010000:00010000:2.0:1786002524.887787:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002524.887790:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887795:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af57841491d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887835:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af57841490f lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaf9 expref: 18 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887880:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414924 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaf9 expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002524.887888:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff9ed366e57400) 00010000:00010000:2.0:1786002524.887891:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002524.887893:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a200, rc 0) 00000100:00100000:2.0:1786002524.887944:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18408:x1872758530891776:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 11362us (11526us total) trans 4294968548 rc 0/0 00000100:00100000:2.0:1786002524.887951:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23864 00000100:00100000:3.0:1786002524.898631:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.898705:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530891904 00000100:00100000:1.0:1786002524.898715:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530891904 00000100:00100000:1.0:1786002524.898783:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5206 00000100:00100000:1.0:1786002524.898794:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2410:x1872758530891904:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002524.898812:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.898831:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da9092e7/0x7cee4af578414932 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab00 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002524.898885:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9c9:0x0] initial LVB size: 2, mtime: 0x6a743c5a, atime: 0x0, ctime: 0x6a743c5a, blocks: 0x8 00010000:00010000:1.0:1786002524.898905:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=885s v=(0 0) 00010000:00010000:1.0:1786002524.898909:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002524.898920:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da9092e7/0x7cee4af578414932 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab00 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.898937:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da9092e7/0x7cee4af578414932 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab00 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.898950:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e200, rc 0) 00000100:00100000:1.0:1786002524.899003:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2410:x1872758530891904:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 211us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002524.899010:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5206 00000100:00100000:1.0:1786002524.921937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002524.922068:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530892032 00000100:00100000:2.0:1786002524.922078:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530892032 00002000:00100000:2.0:1786002524.922129:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->4095) req@ffff9ed2455f0a80 x1872758530892032/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:205/0 lens 488/0 e 0 to 0 dl 1786002535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002524.922145:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455f0a80 with x1872758530892032 ext(0->4095) 00002000:00010000:2.0:1786002524.922151:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455f0a80 00000100:00100000:2.0:1786002524.922183:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:2.0:1786002524.922194:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2413:x1872758530892032:12345-192.168.203.49@tcp:3:cmp.0 00000100:00100000:2.0:1786002524.922350:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2413:x1872758530892032:12345-192.168.203.49@tcp:3:cmp.0 Request processed in 157us (420us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786002524.922358:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00002000:00100000:2.0:1786002524.922517:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9c9:0x0] (0->4095) req@ffff9ed2455f0a80 x1872758530892032/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:205/0 lens 488/4536 e 0 to 0 dl 1786002535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002524.922527:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455f0a80 with x1872758530892032 ext(0->4095) 00002000:00010000:2.0:1786002524.922530:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455f0a80 00000100:00100000:3.0:1786002524.929411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002524.929661:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530892288 00000100:00100000:2.0:1786002524.929671:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530892288 00000100:00100000:2.0:1786002524.929728:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5091 00000100:00100000:2.0:1786002524.929749:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18408:x1872758530892288:12345-192.168.203.49@tcp:35:cmp.0 00000100:00100000:2.0:1786002524.930064:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18408:x1872758530892288:12345-192.168.203.49@tcp:35:cmp.0 Request processed in 326us (661us total) trans 4294968549 rc 0/0 00000100:00100000:2.0:1786002524.930071:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5091 00000100:00100000:3.0:1786002524.978322:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002524.978415:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530892416 00000100:00100000:1.0:1786002524.978424:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530892416 00000100:00100000:1.0:1786002524.978481:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3848 00000100:00100000:1.0:1786002524.978491:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2413:x1872758530892416:12345-192.168.203.49@tcp:63:ll_sa.0 00010000:00010000:1.0:1786002524.978538:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.978564:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab07 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978619:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414940 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978632:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414940 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978643:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414940 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978657:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414947 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978664:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414947 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978671:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414947 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978714:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414940 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978749:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414940 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978760:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414940 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978766:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ea00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.978770:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414940 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978778:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414940 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978788:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002524.978791:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.978795:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978801:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978814:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414947 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978820:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414947 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978826:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414947 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978831:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002524.978833:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414947 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978839:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414947 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978884:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9ed245ddc600) 00010000:00010000:1.0:1786002524.978888:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002524.978891:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414947 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978897:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414947 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978921:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414939 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab07 expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978934:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002524.978936:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002524.978939:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab07 expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.978958:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f000, rc -2) 00000100:00100000:1.0:1786002524.979018:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2413:x1872758530892416:12345-192.168.203.49@tcp:63:ll_sa.0 Request processed in 529us (743us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002524.979025:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3848 00000100:00100000:1.0:1786002524.984757:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002524.984831:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530892544 00000100:00100000:3.0:1786002524.984840:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530892544 00000100:00100000:3.0:1786002524.984918:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23865 00000100:00100000:3.0:1786002524.984928:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18409:x1872758530892544:12345-192.168.203.49@tcp:41:rm.0 00000004:00000024:3.0:1786002524.984975:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847018496 avail 7383887872 00000100:00100000:3.0:1786002524.985050:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18409:x1872758530892544:12345-192.168.203.49@tcp:41:rm.0 Request processed in 123us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002524.985058:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23865 00000100:00100000:2.0:1786002524.993290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002524.993377:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530892800 00000100:00100000:0.0:1786002524.993387:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530892800 00000100:00100000:0.0:1786002524.993451:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23866 00000100:00100000:0.0:1786002524.993461:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18409:x1872758530892800:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002524.993521:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002524.993545:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fa00/0x7cee4af5784148e5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aae4 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.993563:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9ed245ddc900) 00010000:00010000:0.0:1786002524.993574:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002524.993617:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.993625:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002524.993634:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002524.993656:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560955904:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1786002524.993700:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002524.993773:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002524.993830:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560955904 00000100:00100000:1.0:1786002524.993834:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560955904 00000100:00100000:1.0:1786002524.993895:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:1.0:1786002524.993902:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6522:x1872758560955904:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002524.993915:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002524.993928:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414955 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841494e expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.993949:0:15596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784146fb lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9fd expref: 28 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.993958:0:15596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414955 lrc: 4/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841494e expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.993978:0:15596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784146fb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9fd expref: 28 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002524.993990:0:15596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784146fb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9fd expref: 28 pid: 14496 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002524.994001:0:15596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560956032:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002524.994051:0:15596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6600 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.005256:0:15596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560956032:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002525.005303:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414955 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841494e expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.005315:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:1.0:1786002525.005319:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002525.005323:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414955 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841494e expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.005333:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f000, rc 0) 00000100:00100000:1.0:1786002525.005426:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560955904:12345-0@lo:101:mdt00_002.0 Request processed in 11523us (11724us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.005435:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:0.0:1786002525.005529:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560955904:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1786002525.005545:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 4/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.005555:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 4/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002525.006238:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002525.006589:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530892928 00000100:00100000:3.0:1786002525.006598:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530892928 00010000:00010000:3.0:1786002525.006641:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784146fb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9fd expref: 29 pid: 14496 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002525.006678:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1668 00000100:00100000:3.0:1786002525.006687:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2413:x1872758530892928:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002525.006701:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002525.006708:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784146fb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9fd expref: 29 pid: 14496 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.006720:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784146fb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9fd expref: 29 pid: 14496 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.006750:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af5784146fb lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9fd expref: 29 pid: 14496 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.006765:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:3.0:1786002525.006770:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414955 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841494e expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.006779:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414955 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af57841494e expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.006787:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414955 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af57841494e expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.006819:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414955 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841494e expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002525.006832:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6507:1872758560956160:0@lo:105: 00000100:00100000:3.0:1786002525.006913:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002525.006944:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7de40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.007188:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560956160 00000100:00100000:1.0:1786002525.007193:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560956160 00000100:00100000:1.0:1786002525.007225:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1786002525.007232:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6507:x1872758560956160:12345-0@lo:105: 00010000:00010000:1.0:1786002525.007242:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 5/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.007251:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 5/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.007268:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 5/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.007281:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 5/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.007288:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.007296:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.007316:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f35e00) 00000100:00100000:1.0:1786002525.007352:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6507:x1872758560956160:12345-0@lo:105: Request processed in 120us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.007358:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00010000:00010000:0.0:1786002525.007442:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.007451:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002525.007471:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:0.0:1786002525.007498:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.007505:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.007514:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002525.007527:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560956288:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1786002525.007552:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002525.007578:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560956288 00000100:00100000:0.0:1786002525.007581:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560956288 00000100:00100000:0.0:1786002525.007615:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:0.0:1786002525.007622:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560956288:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1786002525.007636:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002525.007647:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414963 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841495c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.007664:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 2/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.007673:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414963 lrc: 4/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841495c expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.007686:0:6525:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1786002525.007711:0:6525:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1786002525.007756:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414963 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841495c expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.007764:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x18618557 (ffff9ed245fedb00) 00010000:00010000:0.0:1786002525.007767:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002525.007770:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414963 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841495c expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.007778:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:0.0:1786002525.007804:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:6522:x1872758560956288:12345-0@lo:101:mdt00_002.0 Request processed in 183us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.007812:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00100000:3.0:1786002525.009021:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6507:1872758560956160:0@lo:105: 00010000:00010000:3.0:1786002525.009044:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002525.011775:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:2413:x1872758530892928:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 5079us (5529us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002525.011789:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1668 00000100:00100000:1.0:1786002525.013095:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.013133:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560956288:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002525.013155:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 4/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.013168:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 4/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002525.014576:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983570 is committed 00000001:00080000:0.0:1786002525.014603:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983569 is committed 00000020:00080000:0.0:1786002525.014631:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 406 batchid updated 00010000:00010000:2.0:1786002525.014707:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414493 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014718:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414493 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014726:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414493 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014733:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.014747:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414493 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014756:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414493 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014770:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x84832a57 (ffff9ed245fed400) 00010000:00010000:2.0:1786002525.014773:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002525.014778:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414493 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014784:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414493 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014807:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014814:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014820:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014826:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.014829:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014839:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014879:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153e:0x0].0x0 (ffff9ed245fed000) 00010000:00010000:2.0:1786002525.014882:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1786002525.014885:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014891:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af57841449a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x153e:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014909:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784144fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014915:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784144fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014921:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784144fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014926:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.014929:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784144fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014935:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784144fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014943:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xdcc87686 (ffff9ed351207800) 00010000:00010000:2.0:1786002525.014945:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002525.014948:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784144fc lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014955:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784144fc lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014967:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014973:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014978:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014983:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.014986:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014992:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.014999:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1539:0x0].0x0 (ffff9ed2456efc00) 00010000:00010000:2.0:1786002525.015001:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1786002525.015004:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015009:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414503 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1539:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015022:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414565 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015028:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414565 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015034:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414565 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015039:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.015041:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414565 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015047:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414565 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015053:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xb62e0cbf (ffff9ed351207600) 00010000:00010000:2.0:1786002525.015055:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002525.015058:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414565 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015063:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414565 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1786002525.015158:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 406 00000004:00080000:3.0:1786002525.015216:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed366d7de40 with version 773 00000020:00080000:3.0:1786002525.015234:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 406 cancel update log [0x240000401:0x3:0x0].400: rc = 0 00000020:00080000:3.0:1786002525.015323:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 406 cancel update log [0x200000400:0x3:0x0].401: rc = 0 00000020:00080000:3.0:1786002525.015330:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 406 00000004:00080000:1.0:1786002525.015428:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 773 rpc_version 773 00000020:00100000:1.0:1786002525.015459:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002525.015469:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed37f535f80 x1872758560956544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002525.015492:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560956544:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002525.015556:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002525.015590:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dc6600 going to sleep for 11 seconds 00010000:00010000:2.0:1786002525.015908:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015919:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015925:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015931:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.015934:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015946:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015955:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153d:0x0].0x0 (ffff9ed24559fb00) 00010000:00010000:2.0:1786002525.015957:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1786002525.015960:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015966:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841456c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x153d:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015983:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784145ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015988:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784145ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015994:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784145ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.015998:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.016001:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784145ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.016006:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784145ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.016011:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xbc0ca3a9 (ffff9ed245fedf00) 00010000:00010000:2.0:1786002525.016013:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002525.016016:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784145ce lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.016021:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784145ce lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.016034:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.016040:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.016046:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.016050:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.016053:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.016059:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.016066:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153a:0x0].0x0 (ffff9ed24559f700) 00010000:00010000:2.0:1786002525.016068:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1786002525.016071:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017661:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784145d5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x153a:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017691:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414637 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017698:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414637 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017705:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414637 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017710:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.017714:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414637 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017720:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414637 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017733:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x391d5834 (ffff9ed366e57900) 00010000:00010000:2.0:1786002525.017744:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002525.017748:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414637 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017754:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414637 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017766:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017772:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017777:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017782:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.017784:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017793:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017799:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153b:0x0].0x0 (ffff9ed244f15b00) 00010000:00010000:2.0:1786002525.017801:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1786002525.017804:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017809:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af57841463e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x153b:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017820:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017825:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017830:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017835:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.017837:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017842:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017861:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x18618557 (ffff9ed245fedb00) 00010000:00010000:2.0:1786002525.017863:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002525.017869:0:3630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414963 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841495c expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017881:0:3630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414963 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af57841495c expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017888:0:3630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414963 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af57841495c expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.017924:0:3630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414963 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841495c expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002525.017937:0:3630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3630:1872758560956672:0@lo:105: 00000100:00100000:2.0:1786002525.017981:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.018027:0:3630:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002525.018099:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560956544 00000100:00100000:3.0:1786002525.018106:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560956544 00000100:00100000:3.0:1786002525.018153:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:3.0:1786002525.018161:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:7805:x1872758560956544:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002525.018307:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:7805:x1872758560956544:12345-0@lo:1000:osp_up1-0.0 Request processed in 146us (2751us total) trans 4294968550 rc 0/0 00000100:00100000:3.0:1786002525.018315:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00100000:0.0:1786002525.018557:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560956672 00000100:00100000:0.0:1786002525.018561:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560956672 00000100:00100000:0.0:1786002525.018596:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1786002525.018610:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3630:x1872758560956672:12345-0@lo:105: 00010000:00010000:0.0:1786002525.018621:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 5/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.018630:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 5/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.018639:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 5/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.018646:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 5/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.018654:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.018661:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.018680:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f34c00) 00000100:00100000:0.0:1786002525.018710:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3630:x1872758560956672:12345-0@lo:105: Request processed in 108us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.018716:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00010000:00010000:1.0:1786002525.018870:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.018881:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002525.018903:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00000100:00100000:1.0:1786002525.018940:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560956800:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002525.018971:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002525.018990:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2480 going to sleep for 11 seconds 00000100:00100000:2.0:1786002525.019083:0:7805:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968533 gen 2 00000004:00080000:2.0:1786002525.019091:0:7805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968528 committed transno 4294968533 00000020:00080000:2.0:1786002525.019097:0:7805:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed24362d840 refcount 2 committed 0 result 0 batchid 407 00000020:00080000:2.0:1786002525.019100:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455df700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed366d7d240 00000020:00080000:2.0:1786002525.019103:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebe700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed24362d3c0 00000020:00080000:2.0:1786002525.019106:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].401 00000020:00080000:2.0:1786002525.019108:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed243753e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed244a61000 00000020:00080000:2.0:1786002525.019110:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].402 00000004:00080000:2.0:1786002525.019134:0:7805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968529 committed transno 4294968533 00000020:00080000:2.0:1786002525.019138:0:7805:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2456d89c0 refcount 2 committed 0 result 0 batchid 408 00000020:00080000:2.0:1786002525.019141:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebec00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d3f480 00000020:00080000:2.0:1786002525.019143:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebe600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2456d8d80 00000020:00080000:2.0:1786002525.019146:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].402 00000020:00080000:2.0:1786002525.019148:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebed00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed24553b000 00000020:00080000:2.0:1786002525.019150:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].403 00000004:00080000:2.0:1786002525.019158:0:7805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968530 committed transno 4294968533 00000020:00080000:2.0:1786002525.019161:0:7805:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed36e7ab240 refcount 2 committed 0 result 0 batchid 409 00000020:00080000:2.0:1786002525.019163:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455e6e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245c66240 00000020:00080000:2.0:1786002525.019165:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455e6200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed36e7ab900 00000020:00080000:2.0:1786002525.019167:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].403 00000020:00080000:2.0:1786002525.019169:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455e6500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed243125200 00000020:00080000:2.0:1786002525.019171:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].404 00000004:00080000:2.0:1786002525.019179:0:7805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968531 committed transno 4294968533 00000020:00080000:2.0:1786002525.019182:0:7805:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed245d3fa80 refcount 2 committed 0 result 0 batchid 410 00000020:00080000:2.0:1786002525.019184:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed243753400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed342bf6000 00000020:00080000:2.0:1786002525.019186:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebe000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d3f000 00000020:00080000:2.0:1786002525.019188:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].405 00000020:00080000:2.0:1786002525.019190:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed243f79600 00000020:00080000:2.0:1786002525.019193:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].405 00000004:00080000:2.0:1786002525.019200:0:7805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968532 committed transno 4294968533 00000020:00080000:2.0:1786002525.019203:0:7805:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed245dc6540 refcount 2 committed 0 result 0 batchid 411 00000020:00080000:2.0:1786002525.019205:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed243753b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245dc6300 00000020:00080000:2.0:1786002525.019207:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed243753600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245dc6000 00000020:00080000:2.0:1786002525.019210:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].406 00000020:00080000:2.0:1786002525.019212:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed243753300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2423d5e00 00000020:00080000:2.0:1786002525.019214:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].406 00000004:00080000:2.0:1786002525.019224:0:7805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968533 committed transno 4294968533 00000020:00080000:2.0:1786002525.019227:0:7805:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed245c66a80 refcount 2 committed 0 result 0 batchid 412 00000020:00080000:2.0:1786002525.019230:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455e6100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245c66000 00000020:00080000:2.0:1786002525.019232:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455e6400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245c660c0 00000020:00080000:2.0:1786002525.019235:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].407 00000020:00080000:2.0:1786002525.019237:0:7805:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455e6300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed243d1de00 00000020:00080000:2.0:1786002525.019239:0:7805:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].407 00000100:00100000:2.0:1786002525.019252:0:7805:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed37f535f80 x1872758560956544/t4294968550(4294968550) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1786002541 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786002525.019279:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560956544:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002525.019305:0:3630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3630:1872758560956672:0@lo:105: 00010000:00010000:2.0:1786002525.019318:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.019327:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784146a0 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.019341:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.019348:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.019355:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.019361:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.019364:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.019371:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.019383:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153c:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:2.0:1786002525.019385:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:2.0:1786002525.019388:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.019394:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af5784146a7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x153c:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1786002525.019497:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 412 committed batchid 406 00000020:00080000:3.0:1786002525.019537:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 406 00000100:00100000:0.0:1786002525.020470:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560956800 00000100:00100000:0.0:1786002525.020477:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560956800 00000100:00100000:0.0:1786002525.020519:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:0.0:1786002525.020527:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560956800:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786002525.020614:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560956800:12345-0@lo:1000:mdt00_002.0 Request processed in 87us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.020621:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1786002525.020774:0:6522:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983570 gen 2 00000004:00080000:1.0:1786002525.020780:0:6522:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983570 committed transno 4294983570 00000100:00100000:1.0:1786002525.020795:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560956800:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002525.020844:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560956928:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002525.020899:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002525.020920:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002525.020967:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560956928 00000100:00100000:3.0:1786002525.020971:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560956928 00000100:00100000:3.0:1786002525.021001:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:3.0:1786002525.021008:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560956928:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786002525.021070:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560956928:12345-0@lo:1000:mdt00_002.0 Request processed in 62us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002525.021089:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00100000:0.0:1786002525.025894:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560956928:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786002525.025978:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560957056:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786002525.026030:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002525.026054:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.026347:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560957056 00000100:00100000:1.0:1786002525.026353:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560957056 00000100:00100000:1.0:1786002525.026399:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:1.0:1786002525.026409:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560957056:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002525.026502:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560957056:12345-0@lo:1000:mdt00_002.0 Request processed in 94us (471us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002525.026510:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00100000:0.0:1786002525.026576:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560957056:0@lo:1000:mdt00_002.0 00000004:00080000:0.0:1786002525.026595:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:0.0:1786002525.026604:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.026615:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.026623:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.026649:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786002525.026655:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:0.0:1786002525.026660:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.026668:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.026675:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.026695:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1786002525.026759:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18409:x1872758530892800:12345-192.168.203.49@tcp:36:rm.0 Request processed in 33298us (33475us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786002525.026766:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23866 00010000:00010000:2.0:1786002525.026818:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002525.026826:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.026834:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002525.026840:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002525.026898:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.026924:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.026931:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002525.026945:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.026959:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af57841494e lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414955 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.026974:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002525.026977:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.026983:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002525.026987:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002525.026995:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.027008:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.027014:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002525.027023:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.027030:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34c00/0x7cee4af57841495c lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414963 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.027040:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.027042:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.027043:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002525.027369:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002525.027378:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786002525.027389:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560957184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002525.027418:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002525.027606:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560957312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002525.027636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002525.027833:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560957184 00000100:00100000:0.0:1786002525.027838:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560957184 00000100:00100000:0.0:1786002525.027897:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560957312 00000100:00100000:0.0:1786002525.027900:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560957312 00000100:00100000:0.0:1786002525.027928:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1786002525.027936:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3646:x1872758560957184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002525.027947:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002525.027964:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414955 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841494e expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.027978:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed351207700) 00010000:00010000:0.0:1786002525.027986:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002525.028014:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3646:x1872758560957184:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.028021:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1786002525.028035:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1786002525.028041:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3644:x1872758560957312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002525.028049:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002525.028060:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414963 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841495c expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.028070:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x18618557 (ffff9ed245fedb00) 00010000:00010000:0.0:1786002525.028084:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002525.028108:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758560957312:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.028114:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:1.0:1786002525.028269:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560957184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002525.028728:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560957312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002525.043040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002525.043126:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530893184 00000100:00100000:3.0:1786002525.043136:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530893184 00000100:00100000:3.0:1786002525.043192:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23867 00000100:00100000:3.0:1786002525.043202:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18409:x1872758530893184:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:3.0:1786002525.043252:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002525.043285:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af5784146ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9f6 expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043307:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002525.043318:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002525.043339:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af57841496a lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043351:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af57841496a lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043361:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af57841496a lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043376:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578414971 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043383:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578414971 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043389:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578414971 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043444:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414978 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043453:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414978 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043460:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414978 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002525.043690:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1786002525.043701:0:10360:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 885224852614ns, next at 886224850432ns, rc = 0 00010000:00010000:3.0:1786002525.043754:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af57841497f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043764:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af57841497f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043772:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af57841497f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043781:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af57841497f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043793:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af57841497f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043799:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af57841497f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043824:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002525.043840:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414978 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043883:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414978 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043891:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414978 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043897:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002525.043901:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414978 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043909:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414978 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043917:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:3.0:1786002525.043920:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002525.043923:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414978 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043929:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414978 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043949:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af57841496a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043956:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af57841496a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043962:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af57841496a lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043968:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af57841496a lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043973:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002525.043976:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af57841496a lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043981:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af57841496a lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043988:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:3.0:1786002525.043990:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002525.043993:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af57841496a lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.043999:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af57841496a lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002525.044011:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003af0ce0c reply state 0000000084bee4fb transno 4294968551 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578414971 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.044021:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578414971 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.044027:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x18618557 (ffff9ed24556e000) 00010000:00010000:3.0:1786002525.044030:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002525.044032:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002525.044095:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18409:x1872758530893184:12345-192.168.203.49@tcp:36:rm.0 Request processed in 892us (1062us total) trans 4294968551 rc 0/0 00000100:00100000:3.0:1786002525.044102:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23867 00010000:00010000:2.0:1786002525.044697:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002525.044704:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af57841497f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.044710:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002525.044713:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af57841497f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.044719:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af57841497f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.044729:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x199:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:2.0:1786002525.044732:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002525.044735:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af57841497f lrc: 1/0,0 mode: --/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.044751:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af57841497f lrc: 0/0,0 mode: --/PW res: [0x240000402:0x199:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.044765:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.044767:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.044768:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002525.056991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002525.057075:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530893440 00000100:00100000:1.0:1786002525.057084:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530893440 00000100:00100000:1.0:1786002525.057146:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23868 00000100:00100000:1.0:1786002525.057157:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18409:x1872758530893440:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:1.0:1786002525.057210:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002525.057234:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414813 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa89 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.057252:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff9ed351207900) 00010000:00010000:1.0:1786002525.057270:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002525.057310:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.057319:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.057329:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002525.057349:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560957440:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1786002525.057395:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002525.057429:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002525.057564:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560957440 00000100:00100000:3.0:1786002525.057569:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560957440 00000100:00100000:3.0:1786002525.057602:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:3.0:1786002525.057610:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:6520:x1872758560957440:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786002525.057620:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002525.057635:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af57841498d lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414986 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.057656:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af57841498d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414986 expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.057669:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af57841498d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414986 expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.057676:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:3.0:1786002525.057679:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002525.057681:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2423b4600, rc 0) 00000100:00100000:3.0:1786002525.057731:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:6520:x1872758560957440:12345-0@lo:101:mdt00_000.0 Request processed in 121us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002525.057749:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00000100:00100000:0.0:1786002525.057835:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560957440:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786002525.057890:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841498d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.057901:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841498d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002525.057919:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:0.0:1786002525.057937:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.057945:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.057953:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002525.057964:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560957568:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1786002525.057988:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002525.058003:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002525.058058:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560957568 00000100:00100000:3.0:1786002525.058063:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560957568 00000100:00100000:3.0:1786002525.058101:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1786002525.058108:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6520:x1872758560957568:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786002525.058116:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002525.058127:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841499b lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414994 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.058142:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841499b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414994 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.058152:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841499b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414994 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.058160:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xbc0ca3a9 (ffff9ed24556ef00) 00010000:00010000:3.0:1786002525.058163:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002525.058165:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2423b4000, rc 0) 00000100:00100000:3.0:1786002525.058194:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560957568:12345-0@lo:101:mdt00_000.0 Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002525.058200:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1786002525.058223:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560957568:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786002525.058233:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841499b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.058242:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841499b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002525.058253:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00000100:00100000:3.0:1786002525.058283:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560957696:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002525.058308:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002525.058322:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002525.058336:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560957696 00000100:00100000:3.0:1786002525.058340:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560957696 00000100:00100000:3.0:1786002525.058360:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:3.0:1786002525.058366:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560957696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002525.058424:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560957696:12345-0@lo:1000:mdt00_000.0 Request processed in 58us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002525.058431:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:3.0:1786002525.058458:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560957696:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002525.058507:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560957824:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002525.058530:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002525.058543:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002525.058554:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560957824 00000100:00100000:3.0:1786002525.058557:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560957824 00000100:00100000:3.0:1786002525.058578:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:3.0:1786002525.058584:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560957824:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002525.058651:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560957824:12345-0@lo:1000:mdt00_000.0 Request processed in 67us (120us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002525.058658:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00100000:3.0:1786002525.058683:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560957824:0@lo:1000:mdt00_000.0 00000004:00080000:3.0:1786002525.058697:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:3.0:1786002525.058702:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841498d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.058710:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af57841498d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.058718:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af57841498d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.058732:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002525.058794:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:3.0:1786002525.058799:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841499b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.058806:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af57841499b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.058813:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af57841499b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.058825:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1786002525.058905:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18409:x1872758530893440:12345-192.168.203.49@tcp:36:rm.0 Request processed in 1748us (1920us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002525.058913:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23868 00010000:00010000:2.0:1786002525.059215:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002525.059222:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af57841498d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.059230:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002525.059235:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af57841498d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002525.059249:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af57841498d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.059281:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841498d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.059287:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002525.059311:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841498d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.059319:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414986 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841498d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.059332:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002525.059336:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af57841499b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.059342:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002525.059345:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af57841499b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002525.059353:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af57841499b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.059366:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841499b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.059371:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002525.059386:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841499b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.059393:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578414994 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841499b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.059403:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.059404:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.059406:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002525.059412:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002525.059421:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560958080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002525.059447:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.059484:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560958080 00000100:00100000:2.0:1786002525.059488:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560958080 00000100:00100000:2.0:1786002525.059517:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1786002525.059523:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3647:x1872758560958080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002525.059533:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002525.059547:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af57841499b lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414994 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.059562:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xbc0ca3a9 (ffff9ed24556ef00) 00010000:00010000:2.0:1786002525.059570:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002525.059598:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3647:x1872758560958080:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002525.059604:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1786002525.059630:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560958080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002525.059924:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786002525.059934:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560957952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002525.059960:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.060158:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560957952 00000100:00100000:2.0:1786002525.060163:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560957952 00000100:00100000:2.0:1786002525.060186:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1786002525.060192:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3644:x1872758560957952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002525.060199:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002525.060209:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af57841498d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414986 expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.060221:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:2.0:1786002525.060228:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002525.060254:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758560957952:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002525.060270:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1786002525.060294:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560957952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002525.060437:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002525.065960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002525.066068:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530893696 00000100:00100000:0.0:1786002525.066086:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530893696 00000100:00100000:0.0:1786002525.066139:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23869 00000100:00100000:0.0:1786002525.066148:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18409:x1872758530893696:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002525.066225:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784149a2 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066239:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784149a2 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066251:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784149a2 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066274:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784149a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066281:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784149a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066287:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784149a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066337:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784149b0 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066344:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784149b0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066351:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784149b0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002525.066560:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00010000:00010000:0.0:1786002525.066603:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784149b7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x197:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066612:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784149b7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066620:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784149b7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066636:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784149b7 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066643:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784149b7 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066648:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784149b7 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066666:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002525.066683:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784149b0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066688:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784149b0 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066694:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784149b0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066703:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002525.066707:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784149b0 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066714:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784149b0 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066725:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff9ed3465ad800) 00010000:00010000:0.0:1786002525.066728:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002525.066733:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784149b0 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066750:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af5784149b0 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066768:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784149a2 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066774:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784149a2 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066780:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784149a2 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066785:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784149a2 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066790:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002525.066792:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784149a2 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066801:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784149a2 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066809:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed3465ad000) 00010000:00010000:0.0:1786002525.066811:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002525.066813:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784149a2 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066819:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784149a2 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002525.066831:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002aede82b reply state 00000000c46edac5 transno 4294968552 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784149a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066840:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784149a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.066878:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xbc0ca3a9 (ffff9ed3465ad600) 00010000:00010000:0.0:1786002525.066882:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002525.066884:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002525.066952:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18409:x1872758530893696:12345-192.168.203.49@tcp:36:rm.0 Request processed in 803us (999us total) trans 4294968552 rc 0/0 00000100:00100000:0.0:1786002525.066960:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23869 00010000:00010000:2.0:1786002525.067298:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002525.067305:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784149b7 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.067311:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002525.067314:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784149b7 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.067320:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784149b7 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.067330:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x197:0x0].0x0 (ffff9ed3465ad800) 00010000:00010000:2.0:1786002525.067332:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002525.067335:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784149b7 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.067341:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784149b7 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x197:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.067353:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.067354:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.067356:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002525.075941:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002525.076045:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530893952 00000100:00100000:1.0:1786002525.076054:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530893952 00000100:00100000:1.0:1786002525.076123:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23870 00000100:00100000:1.0:1786002525.076135:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18409:x1872758530893952:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:1.0:1786002525.076190:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002525.076215:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578414852 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa9e expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.076231:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff9ed351207400) 00010000:00010000:1.0:1786002525.076241:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002525.076299:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.076309:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.076318:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002525.076337:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560958208:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1786002525.076386:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002525.076423:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002525.076556:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560958208 00000100:00100000:2.0:1786002525.076560:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560958208 00000100:00100000:2.0:1786002525.076599:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:2.0:1786002525.076607:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:6521:x1872758560958208:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1786002525.076617:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002525.076632:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784149c5 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784149be expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.076655:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784149c5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784149be expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.076668:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784149c5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784149be expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.076675:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed366e57900) 00010000:00010000:2.0:1786002525.076678:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002525.076681:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b000, rc 0) 00000100:00100000:2.0:1786002525.076725:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:6521:x1872758560958208:12345-0@lo:101:mdt00_001.0 Request processed in 118us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002525.076731:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:1.0:1786002525.077015:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560958208:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1786002525.077029:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784149c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.077039:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784149c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002525.077057:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:1.0:1786002525.077089:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.077100:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.077107:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002525.077119:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560958336:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1786002525.077141:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002525.077199:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002525.077970:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560958336 00000100:00100000:0.0:1786002525.077975:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560958336 00000100:00100000:1.0:1786002525.081443:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:1.0:1786002525.081454:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6521:x1872758560958336:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1786002525.081472:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002525.081495:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af5784149d3 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784149cc expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.081522:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af5784149d3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784149cc expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.081535:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af5784149d3 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784149cc expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.081542:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x84832a57 (ffff9ed245ddc900) 00010000:00010000:1.0:1786002525.081545:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002525.081548:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f200, rc 0) 00000100:00100000:1.0:1786002525.081614:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6521:x1872758560958336:12345-0@lo:101:mdt00_001.0 Request processed in 162us (4472us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.081621:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00100000:3.0:1786002525.081696:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560958336:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1786002525.081713:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784149d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.081723:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784149d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002525.081761:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00000100:00100000:3.0:1786002525.081802:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560958464:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002525.081834:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002525.089003:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002525.089213:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560958464 00000100:00100000:0.0:1786002525.089223:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560958464 00000100:00100000:0.0:1786002525.089288:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:0.0:1786002525.089297:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6521:x1872758560958464:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786002525.089390:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6521:x1872758560958464:12345-0@lo:1000:mdt00_001.0 Request processed in 95us (7555us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.089397:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:3.0:1786002525.091234:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560958464:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002525.091316:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560958592:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786002525.091362:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002525.091394:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002525.091516:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560958592 00000100:00100000:0.0:1786002525.091523:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560958592 00000100:00100000:0.0:1786002525.091565:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:0.0:1786002525.091574:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6521:x1872758560958592:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786002525.091651:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6521:x1872758560958592:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (287us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786002525.091659:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:3.0:1786002525.091730:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560958592:0@lo:1000:mdt00_001.0 00000004:00080000:3.0:1786002525.091759:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:3.0:1786002525.091768:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784149c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.091779:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784149c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.091788:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784149c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.091813:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002525.091818:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:3.0:1786002525.091823:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784149d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.091831:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784149d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.091839:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784149d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.091881:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1786002525.091934:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18409:x1872758530893952:12345-192.168.203.49@tcp:36:rm.0 Request processed in 15799us (15999us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002525.091941:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23870 00000100:00100000:3.0:1786002525.094420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00010000:00010000:0.0:1786002525.094507:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786002525.094516:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784149c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.094528:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002525.094534:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784149c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002525.094543:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784149c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.094580:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784149c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.094587:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002525.094616:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784149c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.094628:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7f400/0x7cee4af5784149be lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784149c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.094648:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002525.094652:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784149d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.094658:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ec00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002525.094662:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784149d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002525.094668:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784149d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.094684:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784149d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.094690:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002525.094704:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784149d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.094710:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ec00/0x7cee4af5784149cc lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784149d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.094721:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002525.094723:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002525.094724:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002525.094750:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560958848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002525.094799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002525.094840:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560958848 00000100:00100000:0.0:1786002525.094866:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560958848 00000100:00100000:0.0:1786002525.094906:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1786002525.094913:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3644:x1872758560958848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002525.094925:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002525.094942:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af5784149d3 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784149cc expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.094955:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x84832a57 (ffff9ed245ddc900) 00010000:00010000:0.0:1786002525.094963:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002525.094992:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3644:x1872758560958848:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.094999:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1786002525.095060:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560958848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002525.095161:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560958720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002525.095187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002525.095217:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560958720 00000100:00100000:3.0:1786002525.095221:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560958720 00000100:00100000:3.0:1786002525.095246:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:3.0:1786002525.095251:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3647:x1872758560958720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002525.096154:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002525.096171:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784149c5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784149be expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.096185:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed366e57900) 00010000:00010000:3.0:1786002525.096193:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002525.096229:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758560958720:12345-0@lo:103:ldlm_bl.0 Request processed in 977us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002525.096235:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:3.0:1786002525.096371:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560958720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002525.096444:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002525.096524:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530894208 00000100:00100000:2.0:1786002525.096529:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530894208 00000100:00100000:2.0:1786002525.096605:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23871 00000100:00100000:2.0:1786002525.096614:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18409:x1872758530894208:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:2.0:1786002525.096682:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af5784149da lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.096694:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af5784149da lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.096703:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af5784149da lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.096714:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af5784149e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.096721:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af5784149e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.096727:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af5784149e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.096793:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af5784149e8 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.096801:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af5784149e8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.096808:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af5784149e8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002525.097050:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00010000:00010000:2.0:1786002525.097841:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af5784149ef lrc: 3/0,1 mode: --/PW res: [0x240000402:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097876:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af5784149ef lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097884:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af5784149ef lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097892:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af5784149ef lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097898:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af5784149ef lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097904:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af5784149ef lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097921:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002525.097937:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af5784149e8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097943:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af5784149e8 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097948:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af5784149e8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097954:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.097958:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af5784149e8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097965:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af5784149e8 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097973:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff9ed366e57500) 00010000:00010000:2.0:1786002525.097975:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002525.097979:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af5784149e8 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097984:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af5784149e8 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.097999:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af5784149da lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.098005:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af5784149da lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.098010:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af5784149da lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.098015:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af5784149da lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.098019:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.098021:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af5784149da lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.098027:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af5784149da lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.098033:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed366e57100) 00010000:00010000:2.0:1786002525.098036:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002525.098038:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af5784149da lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.098043:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af5784149da lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002525.098056:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac02673b reply state 000000003e554117 transno 4294968553 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af5784149e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.098067:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af5784149e1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.098073:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x84832a57 (ffff9ed366e57600) 00010000:00010000:0.0:1786002525.098196:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002525.098202:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af5784149ef lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.098208:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ae00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002525.098211:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af5784149ef lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.098217:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af5784149ef lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.098226:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x194:0x0].0x0 (ffff9ed366e57500) 00010000:00010000:0.0:1786002525.098229:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002525.098232:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af5784149ef lrc: 1/0,0 mode: --/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.098237:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af5784149ef lrc: 0/0,0 mode: --/PW res: [0x240000402:0x194:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.098249:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002525.098251:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002525.098252:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.098327:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002525.098330:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002525.098397:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18409:x1872758530894208:12345-192.168.203.49@tcp:36:rm.0 Request processed in 1783us (3983us total) trans 4294968553 rc 0/0 00000100:00100000:2.0:1786002525.098405:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23871 00010000:00010000:3.0:1786002525.098460:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002525.113096:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002525.113270:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530894464 00000100:00100000:2.0:1786002525.113279:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530894464 00000100:00100000:2.0:1786002525.113340:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23872 00000100:00100000:2.0:1786002525.113350:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18409:x1872758530894464:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:2.0:1786002525.113410:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002525.113434:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af5784147bf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa3c expref: 20 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.113452:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff9ed351207000) 00010000:00010000:2.0:1786002525.113461:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002525.113503:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.113512:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.113521:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002525.113547:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560958976:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786002525.113593:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.113648:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1786002525.113887:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560958976 00000100:00100000:0.0:1786002525.113893:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560958976 00000100:00100000:0.0:1786002525.113927:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:0.0:1786002525.113934:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:10360:x1872758560958976:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786002525.113943:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002525.113957:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784149fd lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784149f6 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.113976:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784149fd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784149f6 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.113988:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784149fd lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784149f6 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.113995:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed3465ad000) 00010000:00010000:0.0:1786002525.113998:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002525.114000:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35e00, rc 0) 00000100:00100000:0.0:1786002525.114038:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:10360:x1872758560958976:12345-0@lo:101:mdt00_003.0 Request processed in 104us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.114044:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00100000:2.0:1786002525.114698:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560958976:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002525.114716:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784149fd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.114727:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784149fd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002525.114756:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:2.0:1786002525.114780:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.114788:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.114796:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002525.114810:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560959104:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786002525.114836:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.114887:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a600 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.114957:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560959104 00000100:00100000:1.0:1786002525.114962:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560959104 00000100:00100000:1.0:1786002525.114996:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:1.0:1786002525.115003:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:10360:x1872758560959104:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786002525.115012:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002525.115026:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414a0b lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414a04 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.115042:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414a0b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414a04 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.115052:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414a0b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414a04 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.115059:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xdcc87686 (ffff9ed245ddc900) 00010000:00010000:1.0:1786002525.115061:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002525.115063:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f200, rc 0) 00000100:00100000:1.0:1786002525.115112:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560959104:12345-0@lo:101:mdt00_003.0 Request processed in 109us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.115118:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00100000:2.0:1786002525.115408:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560959104:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002525.115420:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414a0b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.115434:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414a0b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002525.115445:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00000100:00100000:2.0:1786002525.115475:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560959232:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002525.115500:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.115521:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002525.115565:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560959232 00000100:00100000:0.0:1786002525.115570:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560959232 00000100:00100000:0.0:1786002525.115601:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:0.0:1786002525.115608:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560959232:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786002525.115675:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560959232:12345-0@lo:1000:mdt00_003.0 Request processed in 68us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.115682:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:2.0:1786002525.115781:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560959232:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002525.115815:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560959360:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002525.115835:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.115885:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.115927:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560959360 00000100:00100000:1.0:1786002525.115931:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560959360 00000100:00100000:1.0:1786002525.115957:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:1.0:1786002525.115963:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560959360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786002525.116029:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560959360:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (192us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002525.116035:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00100000:2.0:1786002525.116175:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560959360:0@lo:1000:mdt00_003.0 00000004:00080000:2.0:1786002525.116189:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:2.0:1786002525.116193:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784149fd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.116201:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784149fd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.116207:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784149fd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.116227:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002525.116233:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:2.0:1786002525.116236:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414a0b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.116243:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414a0b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.116250:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414a0b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.116269:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786002525.116333:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18409:x1872758530894464:12345-192.168.203.49@tcp:36:rm.0 Request processed in 2982us (3254us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002525.116340:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23872 00010000:00010000:1.0:1786002525.116805:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002525.116811:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784149fd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.116820:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b600 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002525.116825:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784149fd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002525.116833:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784149fd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.116879:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784149fd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.116885:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002525.116911:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784149fd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.116918:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af5784149f6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784149fd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.116934:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002525.116937:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414a0b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.116943:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002525.116946:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414a0b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002525.116958:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414a0b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.116971:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a0b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.116978:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002525.116992:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a0b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.116999:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a800/0x7cee4af578414a04 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a0b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.117008:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002525.117010:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002525.117011:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002525.117018:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786002525.117027:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560959616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002525.117058:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002525.117157:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560959488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002525.117185:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002525.117391:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560959616 00000100:00100000:0.0:1786002525.117397:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560959616 00000100:00100000:0.0:1786002525.117434:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560959488 00000100:00100000:0.0:1786002525.117437:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560959488 00000100:00100000:0.0:1786002525.117468:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:0.0:1786002525.117475:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3647:x1872758560959616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002525.117486:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002525.117502:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414a0b lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414a04 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.117514:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xdcc87686 (ffff9ed245ddc900) 00010000:00010000:0.0:1786002525.117522:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002525.117561:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3647:x1872758560959616:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.117568:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:0.0:1786002525.117583:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1786002525.117590:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3645:x1872758560959488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002525.117597:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002525.117607:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784149fd lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784149f6 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.117623:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed3465ad000) 00010000:00010000:0.0:1786002525.117629:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002525.117656:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758560959488:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.117663:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1786002525.117690:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560959488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002525.117709:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002525.117834:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560959616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002525.122776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002525.122871:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530894720 00000100:00100000:3.0:1786002525.122880:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530894720 00000100:00100000:3.0:1786002525.122928:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23873 00000100:00100000:3.0:1786002525.122938:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18409:x1872758530894720:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:3.0:1786002525.123008:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a12 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123021:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a12 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123031:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a12 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123045:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4600/0x7cee4af578414a19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123052:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4600/0x7cee4af578414a19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123058:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4600/0x7cee4af578414a19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123123:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a20 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123132:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a20 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123139:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a20 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002525.123362:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1786002525.123372:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 885304523930ns, next at 886304521755ns, rc = 0 00010000:00010000:3.0:1786002525.123415:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a27 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x195:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123424:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a27 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123432:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a27 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123439:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a27 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123446:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a27 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123451:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a27 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123466:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002525.123481:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a20 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123487:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a20 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123493:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a20 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123498:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002525.123503:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a20 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123510:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a20 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123520:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff9ed24556ed00) 00010000:00010000:3.0:1786002525.123524:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002525.123529:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a20 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123535:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a20 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123557:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a12 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123564:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a12 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123569:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a12 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123575:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a12 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123580:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002525.123582:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a12 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123588:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a12 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123599:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed24556e800) 00010000:00010000:3.0:1786002525.123601:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002525.123604:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a12 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123610:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a12 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002525.123626:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a79a430 reply state 000000000bfa6aa2 transno 4294968554 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4600/0x7cee4af578414a19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123636:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4600/0x7cee4af578414a19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.123642:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xdcc87686 (ffff9ed24556ec00) 00010000:00010000:3.0:1786002525.123644:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002525.123646:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002525.123710:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:18409:x1872758530894720:12345-192.168.203.49@tcp:36:rm.0 Request processed in 772us (941us total) trans 4294968554 rc 0/0 00000100:00100000:3.0:1786002525.123718:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23873 00010000:00010000:2.0:1786002525.124057:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002525.124064:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a27 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.124082:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002525.124086:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a27 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.124093:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a27 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.124103:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x195:0x0].0x0 (ffff9ed24556ed00) 00010000:00010000:2.0:1786002525.124105:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002525.124108:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a27 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.124113:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a27 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.124129:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.124131:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.124132:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002525.132754:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002525.132829:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530894976 00000100:00100000:2.0:1786002525.132838:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530894976 00000100:00100000:2.0:1786002525.132914:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23874 00000100:00100000:2.0:1786002525.132924:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:18409:x1872758530894976:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:2.0:1786002525.132976:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002525.132998:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414924 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x196:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaf9 expref: 21 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.133015:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff9ed366e57400) 00010000:00010000:2.0:1786002525.133024:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002525.133066:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.133075:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.133095:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002525.133115:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560959744:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002525.133158:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.133209:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1786002525.133497:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560959744 00000100:00100000:0.0:1786002525.133502:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560959744 00000100:00100000:0.0:1786002525.133538:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:0.0:1786002525.133547:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:14496:x1872758560959744:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1786002525.133556:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002525.133570:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414a35 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414a2e expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.133593:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414a35 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414a2e expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.133605:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414a35 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414a2e expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.133611:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed3465ad000) 00010000:00010000:0.0:1786002525.133614:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002525.133616:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35e00, rc 0) 00000100:00100000:0.0:1786002525.133664:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:14496:x1872758560959744:12345-0@lo:101:mdt00_004.0 Request processed in 119us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.133670:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00100000:2.0:1786002525.133789:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560959744:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002525.133803:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414a35 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.133814:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414a35 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002525.133832:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:2.0:1786002525.133887:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.133894:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.133900:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002525.133911:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560959872:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002525.133935:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.133963:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.134012:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560959872 00000100:00100000:1.0:1786002525.134016:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560959872 00000100:00100000:1.0:1786002525.134048:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1786002525.134055:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:14496:x1872758560959872:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1786002525.134064:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002525.134088:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414a43 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414a3c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.134110:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414a43 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414a3c expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.134120:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414a43 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414a3c expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.134127:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xb62e0cbf (ffff9ed245ddc600) 00010000:00010000:1.0:1786002525.134129:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002525.134132:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7ec00, rc 0) 00000100:00100000:1.0:1786002525.134167:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560959872:12345-0@lo:101:mdt00_004.0 Request processed in 113us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.134173:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:2.0:1786002525.134360:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560959872:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002525.134372:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414a43 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.134380:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414a43 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002525.134390:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00000100:00100000:2.0:1786002525.134420:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560960000:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1786002525.134448:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.134471:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a180 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.134604:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560960000 00000100:00100000:1.0:1786002525.134609:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560960000 00000100:00100000:1.0:1786002525.134639:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:1.0:1786002525.134646:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560960000:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1786002525.134718:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560960000:12345-0@lo:1000:mdt00_004.0 Request processed in 73us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.134725:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00100000:2.0:1786002525.134796:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560960000:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1786002525.134835:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560960128:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1786002525.134894:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.134919:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a180 going to sleep for 11 seconds 00000100:00100000:3.0:1786002525.134983:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560960128 00000100:00100000:3.0:1786002525.134987:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560960128 00000100:00100000:3.0:1786002525.135018:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:3.0:1786002525.135024:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560960128:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002525.135110:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560960128:12345-0@lo:1000:mdt00_004.0 Request processed in 85us (214us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002525.135117:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1786002525.135223:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560960128:0@lo:1000:mdt00_004.0 00000004:00080000:2.0:1786002525.135240:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:2.0:1786002525.135246:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414a35 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135254:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414a35 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135273:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414a35 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135296:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002525.135301:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:2.0:1786002525.135305:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414a43 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135314:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414a43 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135321:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414a43 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135334:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1786002525.135358:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002525.135364:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414a35 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135372:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002525.135377:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414a35 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002525.135384:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414a35 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135406:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a35 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135412:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002525.135430:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a35 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135436:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af578414a2e lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a35 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135451:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002525.135454:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414a43 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135460:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002525.135463:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414a43 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002525.135482:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414a43 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135500:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a43 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135506:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002525.135524:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a43 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135532:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b800/0x7cee4af578414a3c lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a43 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135543:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.135545:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.135547:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002525.135554:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002525.135563:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560960384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002525.135610:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.135642:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560960256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002525.135665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.135695:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560960384 00000100:00100000:2.0:1786002525.135699:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560960384 00000100:00100000:2.0:1786002525.135722:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560960256 00000100:00100000:2.0:1786002525.135725:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560960256 00000100:00100000:2.0:1786002525.135761:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1786002525.135768:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3645:x1872758560960384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002525.135777:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002525.135790:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414a43 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414a3c expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135808:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0xb62e0cbf (ffff9ed245ddc600) 00010000:00010000:2.0:1786002525.135816:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002525.135841:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3645:x1872758560960384:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002525.135872:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1786002525.135885:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1786002525.135892:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3647:x1872758560960256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002525.135899:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002525.135908:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414a35 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414a2e expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.135919:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed3465ad000) 00010000:00010000:2.0:1786002525.135925:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002525.135948:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758560960256:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002525.135954:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1786002525.135978:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560960256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002525.135995:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560960384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002525.136032:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18409:x1872758530894976:12345-192.168.203.49@tcp:36:rm.0 Request processed in 3108us (3296us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002525.136039:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23874 00010000:00010000:3.0:1786002525.138182:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002525.138480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002525.138570:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530895232 00000100:00100000:3.0:1786002525.138577:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530895232 00000100:00100000:3.0:1786002525.138629:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23875 00000100:00100000:3.0:1786002525.138639:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18409:x1872758530895232:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:3.0:1786002525.138708:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a4a lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.138722:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a4a lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.138732:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a4a lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.138756:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.138764:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.138771:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.138821:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a58 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x196:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.138828:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a58 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.138836:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a58 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002525.139057:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00010000:00010000:3.0:1786002525.139361:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af578414a5f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x196:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139372:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af578414a5f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139379:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af578414a5f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139386:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af578414a5f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139392:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af578414a5f lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139398:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af578414a5f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139418:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002525.139436:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a58 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139442:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a58 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139448:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a58 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139453:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002525.139456:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a58 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139463:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a58 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139484:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff9ed24556e500) 00010000:00010000:3.0:1786002525.139487:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002525.139491:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a58 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139496:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414a58 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x196:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139518:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a4a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139524:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a4a lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139530:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a4a lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139536:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a4a lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139541:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002525.139543:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a4a lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139548:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a4a lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139555:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed24556e800) 00010000:00010000:3.0:1786002525.139558:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002525.139561:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a4a lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139566:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578414a4a lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002525.139582:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000038f34c3 reply state 00000000067cbaec transno 4294968555 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139591:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a51 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.139596:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xb62e0cbf (ffff9ed24556ea00) 00010000:00010000:3.0:1786002525.139598:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002525.139600:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002525.139700:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002525.139706:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af578414a5f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.139715:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002525.139718:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af578414a5f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.139724:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af578414a5f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.139732:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x196:0x0].0x0 (ffff9ed24556e500) 00010000:00010000:2.0:1786002525.139749:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002525.139752:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af578414a5f lrc: 1/0,0 mode: --/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.139758:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229400/0x7cee4af578414a5f lrc: 0/0,0 mode: --/PW res: [0x240000402:0x196:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.139771:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.139773:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.139774:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002525.139803:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18409:x1872758530895232:12345-192.168.203.49@tcp:36:rm.0 Request processed in 1164us (1334us total) trans 4294968555 rc 0/0 00000100:00100000:3.0:1786002525.139810:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23875 00000100:00100000:0.0:1786002525.151480:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002525.151572:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530895488 00000100:00100000:1.0:1786002525.151581:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530895488 00000100:00100000:1.0:1786002525.151638:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23876 00000100:00100000:1.0:1786002525.151649:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18409:x1872758530895488:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:1.0:1786002525.151700:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002525.151722:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245e7fe00/0x7cee4af578414891 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x198:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aab3 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.151753:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002525.151763:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002525.151803:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.151811:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.151820:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002525.151839:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560960512:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1786002525.151914:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002525.151955:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2540 going to sleep for 11 seconds 00000100:00100000:0.0:1786002525.152003:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560960512 00000100:00100000:0.0:1786002525.152007:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560960512 00000100:00100000:0.0:1786002525.152040:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:0.0:1786002525.152048:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6522:x1872758560960512:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1786002525.152057:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002525.152071:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414a6d lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414a66 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.152103:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414a6d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414a66 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.152116:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414a6d lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414a66 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.152122:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed3465adf00) 00010000:00010000:0.0:1786002525.152125:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002525.152127:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35c00, rc 0) 00000100:00100000:0.0:1786002525.152162:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6522:x1872758560960512:12345-0@lo:101:mdt00_002.0 Request processed in 116us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.152169:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00100000:1.0:1786002525.152416:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560960512:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002525.152430:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414a6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.152441:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414a6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002525.152456:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:1.0:1786002525.152474:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.152481:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.152489:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002525.152500:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560960640:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1786002525.152523:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002525.152551:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.152565:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560960640 00000100:00100000:1.0:1786002525.152568:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560960640 00000100:00100000:1.0:1786002525.152600:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:1.0:1786002525.152608:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6522:x1872758560960640:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002525.152615:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002525.152627:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414a7b lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414a74 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.152641:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414a7b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414a74 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.152650:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414a7b lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414a74 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.152658:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x391d5834 (ffff9ed245e35200) 00010000:00010000:1.0:1786002525.152661:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002525.152663:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f000, rc 0) 00000100:00100000:1.0:1786002525.152693:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560960640:12345-0@lo:101:mdt00_002.0 Request processed in 86us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.152699:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00100000:1.0:1786002525.152723:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560960640:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002525.152745:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414a7b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.152760:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414a7b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002525.152771:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00000100:00100000:1.0:1786002525.152800:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560960768:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002525.152828:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002525.152843:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.152877:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560960768 00000100:00100000:1.0:1786002525.152880:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560960768 00000100:00100000:1.0:1786002525.152901:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:1.0:1786002525.152907:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b57b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560960768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002525.152962:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b57b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560960768:12345-0@lo:1000:mdt00_002.0 Request processed in 55us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.152968:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00100000:1.0:1786002525.154032:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560960768:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002525.154220:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560960896:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002525.154251:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002525.154361:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002525.159333:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560960896 00000100:00100000:0.0:1786002525.159346:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560960896 00000100:00100000:1.0:1786002525.162089:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:1.0:1786002525.162104:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560960896:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002525.162249:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560960896:12345-0@lo:1000:mdt00_002.0 Request processed in 148us (7997us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002525.162257:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00100000:2.0:1786002525.162335:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560960896:0@lo:1000:mdt00_002.0 00000004:00080000:2.0:1786002525.162369:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:2.0:1786002525.162378:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414a6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.162388:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414a6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.162396:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414a6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.162425:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002525.162431:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:2.0:1786002525.162435:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414a7b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.162442:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414a7b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.162448:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414a7b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.162466:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786002525.162524:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:18409:x1872758530895488:12345-192.168.203.49@tcp:36:rm.0 Request processed in 10875us (11060us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002525.162531:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23876 00010000:00010000:0.0:1786002525.164000:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786002525.164008:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414a6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.164022:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ea00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002525.164027:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414a6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002525.164036:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414a6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.164075:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.164081:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002525.164113:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.164120:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7ea00/0x7cee4af578414a66 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.164140:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002525.164143:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414a7b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.164149:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002525.164153:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414a7b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002525.164160:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414a7b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.164180:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a7b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.164186:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002525.164200:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a7b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.164207:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245e7e000/0x7cee4af578414a74 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414a7b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.164217:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002525.164219:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002525.164220:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002525.164227:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786002525.164241:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560961024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002525.164292:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002525.164343:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002525.164352:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560961152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002525.164375:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002525.164404:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560961024 00000100:00100000:0.0:1786002525.164410:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560961024 00000100:00100000:0.0:1786002525.164455:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560961152 00000100:00100000:0.0:1786002525.164459:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560961152 00000100:00100000:0.0:1786002525.164481:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:0.0:1786002525.164488:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3644:x1872758560961024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002525.164499:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002525.164516:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414a6d lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414a66 expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.164531:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed3465adf00) 00010000:00010000:0.0:1786002525.164538:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002525.164570:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3644:x1872758560961024:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.164577:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:0.0:1786002525.164590:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:0.0:1786002525.164596:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3647:x1872758560961152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002525.164603:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002525.164612:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414a7b lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd5:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414a74 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.164622:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x391d5834 (ffff9ed245e35200) 00010000:00010000:0.0:1786002525.164627:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002525.164651:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758560961152:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.164657:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00100000:0.0:1786002525.164711:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560961024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002525.164729:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560961152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002525.168427:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002525.168634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002525.168699:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530895744 00000100:00100000:2.0:1786002525.168708:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530895744 00000100:00100000:2.0:1786002525.168775:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23877 00000100:00100000:2.0:1786002525.168785:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:18409:x1872758530895744:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:2.0:1786002525.168881:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578414a82 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.168896:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578414a82 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.168906:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578414a82 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.168920:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414a89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.168927:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.168933:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.168983:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414a90 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x198:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.168991:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414a90 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.168997:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414a90 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002525.169223:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00010000:00010000:2.0:1786002525.169366:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414a97 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x198:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169375:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414a97 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169383:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414a97 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169390:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414a97 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169396:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414a97 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169402:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414a97 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169418:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002525.169433:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414a90 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169439:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414a90 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169445:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414a90 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169450:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.169454:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414a90 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169460:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414a90 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169471:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff9ed366e57400) 00010000:00010000:2.0:1786002525.169474:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002525.169477:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414a90 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169483:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af578414a90 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x198:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169500:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578414a82 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169510:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578414a82 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169515:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578414a82 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169519:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578414a82 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169523:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002525.169526:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578414a82 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169532:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578414a82 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169538:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed366e57f00) 00010000:00010000:2.0:1786002525.169540:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002525.169542:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578414a82 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169547:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578414a82 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002525.169560:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cccba404 reply state 000000002b8c5d0b transno 4294968556 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169570:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414a89 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.169576:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x391d5834 (ffff9ed366e57800) 00010000:00010000:2.0:1786002525.169578:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002525.169581:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002525.169640:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:18409:x1872758530895744:12345-192.168.203.49@tcp:36:rm.0 Request processed in 857us (1010us total) trans 4294968556 rc 0/0 00000100:00100000:2.0:1786002525.169647:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23877 00010000:00010000:3.0:1786002525.171323:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002525.171333:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414a97 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.171344:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002525.171348:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414a97 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.171356:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414a97 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.171370:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x198:0x0].0x0 (ffff9ed366e57400) 00010000:00010000:3.0:1786002525.171374:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002525.171378:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414a97 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.171383:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a600/0x7cee4af578414a97 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x198:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.171400:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002525.171402:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002525.171404:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002525.177615:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002525.177655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002525.177725:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530895872 00000100:00100000:2.0:1786002525.177734:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530895872 00000100:00100000:2.0:1786002525.177802:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1481 00000100:00100000:2.0:1786002525.177811:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758530895872:12345-192.168.203.49@tcp:103:rm.0 00010000:00010000:2.0:1786002525.177826:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002525.177884:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784143f9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a994 expref: 10 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.177906:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed245fed300) 00010000:00010000:2.0:1786002525.177917:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002525.177963:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758530895872:12345-192.168.203.49@tcp:103:rm.0 Request processed in 152us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002525.177970:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1481 00000100:00100000:1.0:1786002525.178032:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530896128 00000100:00100000:1.0:1786002525.178038:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530896128 00000100:00100000:1.0:1786002525.178084:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5092 00000100:00100000:1.0:1786002525.178092:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:18409:x1872758530896128:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:1.0:1786002525.178275:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18409:x1872758530896128:12345-192.168.203.49@tcp:35:rm.0 Request processed in 183us (617us total) trans 4294968557 rc 0/0 00000100:00100000:1.0:1786002525.178282:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5092 00000100:00100000:2.0:1786002525.192836:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002525.192956:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530896384 00000100:00100000:3.0:1786002525.192966:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530896384 00000100:00100000:3.0:1786002525.193021:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23878 00000100:00100000:3.0:1786002525.193032:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18409:x1872758530896384:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:3.0:1786002525.193097:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786002525.193122:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578414709 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x193:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa04 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.193147:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229800/0x7cee4af5784146df lrc: 0/0,0 mode: --/PR res: [0x240000402:0x193:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a9ef expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.193157:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed245fedc00) 00010000:00010000:3.0:1786002525.193167:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002525.193207:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.193215:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.193225:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002525.193245:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560961280:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1786002525.193300:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002525.193354:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.193625:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560961280 00000100:00100000:1.0:1786002525.193630:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560961280 00000100:00100000:1.0:1786002525.193667:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:1.0:1786002525.193676:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:10360:x1872758560961280:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786002525.193686:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002525.193699:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af578414aa5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414a9e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.193722:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784143dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a98d expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.193732:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af578414aa5 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414a9e expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.193766:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784143dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a98d expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.193779:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784143dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a98d expref: 8 pid: 6521 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002525.193790:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6525:1872758560961408:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002525.193882:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.200678:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6525:1872758560961408:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002525.200715:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af578414aa5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414a9e expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.200728:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002525.200731:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002525.200746:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af578414aa5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414a9e expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.200757:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fe00, rc 0) 00000100:00100000:1.0:1786002525.200926:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:10360:x1872758560961280:12345-0@lo:101:mdt00_003.0 Request processed in 7250us (7624us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.200934:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000100:00100000:3.0:1786002525.202759:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560961280:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002525.202783:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.202795:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002525.207608:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002525.209955:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530896512 00000100:00100000:1.0:1786002525.209967:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530896512 00010000:00010000:1.0:1786002525.210008:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784143dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a98d expref: 9 pid: 6521 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002525.210047:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1669 00000100:00100000:1.0:1786002525.210058:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758530896512:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002525.210072:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002525.210371:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784143dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a98d expref: 9 pid: 6521 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.210385:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784143dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a98d expref: 9 pid: 6521 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.210411:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784143dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3a98d expref: 9 pid: 6521 timeout: 985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.210427:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002525.210434:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af578414aa5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414a9e expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.210444:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af578414aa5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578414a9e expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.210453:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af578414aa5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578414a9e expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.210486:0:10399:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af578414aa5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414a9e expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002525.210501:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:10399:1872758560961536:0@lo:105: 00000100:00100000:1.0:1786002525.210558:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002525.210601:0:10399:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002525.211214:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560961536 00000100:00100000:0.0:1786002525.211220:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560961536 00000100:00100000:0.0:1786002525.211329:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1786002525.211340:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10399:x1872758560961536:12345-0@lo:105: 00010000:00010000:0.0:1786002525.211353:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.211363:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.211373:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.211380:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.211387:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.211395:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.212340:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed35a229000) 00000100:00100000:0.0:1786002525.212404:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10399:x1872758560961536:12345-0@lo:105: Request processed in 1064us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.212412:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1786002525.212565:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:10399:1872758560961536:0@lo:105: 00010000:00010000:1.0:1786002525.212582:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002525.212623:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758530896512:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 2566us (5022us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.212631:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1669 00010000:00010000:2.0:1786002525.216643:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.216662:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002525.216690:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1786002525.216733:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a200/0x7cee4af578414aac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.216756:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a200/0x7cee4af578414aac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.216769:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a200/0x7cee4af578414aac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002525.216792:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560961664:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786002525.217149:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.217228:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002525.229380:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560961664 00000100:00100000:3.0:1786002525.229394:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560961664 00000100:00100000:3.0:1786002525.234684:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:3.0:1786002525.234700:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:10360:x1872758560961664:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002525.234721:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002525.234756:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578414ab3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414aac expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.234787:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578414ab3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414aac expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.234802:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578414ab3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414aac expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.234811:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9ed24556e200) 00010000:00010000:3.0:1786002525.234814:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002525.234818:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229800, rc 0) 00000100:00100000:3.0:1786002525.234909:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560961664:12345-0@lo:101:mdt00_003.0 Request processed in 212us (18060us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002525.234915:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00100000:0.0:1786002525.235103:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560961664:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1786002525.235122:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a200/0x7cee4af578414aac lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414ab3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.235133:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a200/0x7cee4af578414aac lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414ab3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002525.235154:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1786002525.235209:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560961792:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786002525.235246:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002525.235806:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3821ffcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.236783:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560961792 00000100:00100000:1.0:1786002525.236793:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560961792 00000100:00100000:1.0:1786002525.236844:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:1.0:1786002525.236879:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560961792:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786002525.236963:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560961792:12345-0@lo:1000:mdt00_003.0 Request processed in 86us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.236970:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:2.0:1786002525.237149:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560961792:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002525.237334:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560961920:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002525.237368:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.237392:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002525.237437:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560961920 00000100:00100000:3.0:1786002525.237441:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560961920 00000100:00100000:3.0:1786002525.237486:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:3.0:1786002525.237494:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560961920:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002525.237591:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560961920:12345-0@lo:1000:mdt00_003.0 Request processed in 97us (221us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002525.237791:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:2.0:1786002525.237915:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560961920:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1786002525.237967:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 3/0,1 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.237977:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 3/0,1 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.237987:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 3/0,1 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002525.238000:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560962048:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786002525.238024:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.238045:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a240 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.238101:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560962048 00000100:00100000:1.0:1786002525.238105:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560962048 00000100:00100000:1.0:1786002525.238130:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:1.0:1786002525.238137:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560962048:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786002525.238146:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002525.238161:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ac1 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414aba expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.238192:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ac1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414aba expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.238204:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ac1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414aba expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.238212:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed245e35000) 00010000:00010000:1.0:1786002525.238215:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002525.238218:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fa00, rc 0) 00000100:00100000:1.0:1786002525.238256:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:10360:x1872758560962048:12345-0@lo:101:mdt00_003.0 Request processed in 119us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002525.238425:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560962048:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002525.238439:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414ac1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.238449:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414ac1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.238488:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578414ac8 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.238497:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578414ac8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.238505:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578414ac8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.238522:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578414acf lrc: 3/0,1 mode: --/EX res: [0x240000400:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.238530:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578414acf lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.238536:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578414acf lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.238554:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.238561:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.238568:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002525.238584:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560962176:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786002525.238618:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002525.238633:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a240 going to sleep for 11 seconds 00000100:00100000:1.0:1786002525.238825:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000100:00100000:1.0:1786002525.238840:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560962176 00000100:00100000:1.0:1786002525.238844:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560962176 00000100:00100000:1.0:1786002525.238899:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:1.0:1786002525.238906:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:10360:x1872758560962176:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786002525.238915:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002525.238926:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414add lrc: 2/0,0 mode: --/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414ad6 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.238941:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414add lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414ad6 expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.238950:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414add lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414ad6 expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.238957:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed245e35c00) 00010000:00010000:1.0:1786002525.238960:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002525.238962:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f000, rc 0) 00000100:00100000:1.0:1786002525.238989:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:10360:x1872758560962176:12345-0@lo:101:mdt00_003.0 Request processed in 83us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.238994:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000100:00100000:2.0:1786002525.239356:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560962176:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002525.239368:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414add expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.239378:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414add expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002525.248404:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560962304:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1786002525.248481:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002525.248567:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed347d3dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1786002525.251333:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560962304 00000100:00100000:2.0:1786002525.251345:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560962304 00000100:00100000:0.0:1786002525.255859:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:0.0:1786002525.255874:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:10360:x1872758560962304:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1786002525.259929:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:10360:x1872758560962304:12345-0@lo:403:mdt00_003.0 Request processed in 4051us (11439us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.259941:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00100000:0.0:1786002525.260042:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560962304:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1786002525.261587:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].414, 960 off619704 00000040:00080000:0.0:1786002525.261845:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].414, 1040 off668952 00000004:00080000:0.0:1786002525.261952:0:10360:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed347d3dc00 with version 792 00000004:00080000:3.0:1786002525.266377:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 792 rpc_version 792 00000020:00100000:3.0:1786002525.266425:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002525.266435:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed366d6f100 x1872758560962560/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2624/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002525.266459:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560962560:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002525.266524:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002525.266567:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786002525.266678:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560962560 00000100:00100000:0.0:1786002525.266686:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560962560 00000100:00100000:0.0:1786002525.266749:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:0.0:1786002525.266758:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:7466:x1872758560962560:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002525.267218:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:7466:x1872758560962560:12345-0@lo:1000:osp_up0-1.0 Request processed in 460us (692us total) trans 4294983571 rc 0/0 00000100:00100000:0.0:1786002525.267226:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00000100:00100000:3.0:1786002525.267545:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560962560:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1786002525.267618:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x193:0x0]: returning size 4096 00010000:00010000:0.0:1786002525.267638:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578414acf lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267648:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578414acf lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267657:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578414acf lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267664:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002525.267668:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578414acf lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267676:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578414acf lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267690:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x0 (ffff9ed366e57400) 00010000:00010000:0.0:1786002525.267693:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002525.267697:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578414acf lrc: 2/0,0 mode: --/EX res: [0x240000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267704:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578414acf lrc: 0/0,0 mode: --/EX res: [0x240000400:0xd2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267723:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414add expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267731:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414add expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267753:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414add expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267819:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786002525.267828:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd5:0x0] 00010000:00010000:0.0:1786002525.267836:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578414ac8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267843:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578414ac8 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267881:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578414ac8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267886:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ae00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002525.267890:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578414ac8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267895:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578414ac8 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267904:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed366e57300) 00010000:00010000:0.0:1786002525.267906:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002525.267910:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578414ac8 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267916:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af578414ac8 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267929:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414ac1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267937:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414ac1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.267944:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414ac1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.269159:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002525.269168:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414add expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.269185:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002525.269190:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414add expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002525.269203:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414add expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.269236:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414add expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.269243:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002525.269670:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 1/0,0 mode: --/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414add expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.269679:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b200/0x7cee4af578414ad6 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414add expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.269695:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002525.269699:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414ac1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.269705:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b600 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002525.269709:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414ac1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002525.269715:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414ac1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.269732:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 4/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414ac1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.269749:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002525.269766:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 3/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414ac1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.269774:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002525.269775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002525.269777:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002525.269792:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560962816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002525.269839:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002525.269901:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560962816 00000100:00100000:1.0:1786002525.269906:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560962816 00000100:00100000:1.0:1786002525.269943:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:1.0:1786002525.269950:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+14:3644:x1872758560962816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002525.269961:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002525.269976:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ac1 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414aba expref: 14 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.269988:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x193:0x0].0x0 (ffff9ed245e35000) 00010000:00010000:1.0:1786002525.269995:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002525.270022:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3644:x1872758560962816:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002525.270028:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:1.0:1786002525.270063:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560962816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002525.270157:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002525.270167:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560962688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002525.270203:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002525.270230:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560962688 00000100:00100000:3.0:1786002525.270234:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560962688 00000100:00100000:3.0:1786002525.270272:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:3.0:1786002525.270279:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3646:x1872758560962688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002525.270288:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002525.270299:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414add lrc: 0/0,0 mode: --/EX res: [0x200000400:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414ad6 expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.270310:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd5:0x0].0x0 (ffff9ed245e35c00) 00010000:00010000:3.0:1786002525.270316:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002525.270341:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3646:x1872758560962688:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002525.270347:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:3.0:1786002525.270372:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560962688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002525.271207:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1786002525.271216:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b600/0x7cee4af578414aba lrc: 0/0,0 mode: --/EX res: [0x240000402:0x193:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414ac1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002525.271243:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1786002525.273189:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.273204:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.273217:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.274940:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002525.274953:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002525.274965:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002525.274971:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002525.274980:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.275104:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.275112:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002525.275145:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002525.275157:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.275159:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002525.275162:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002525.275240:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786002525.275268:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560962944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002525.275328:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002525.275370:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560962944 00000100:00100000:0.0:1786002525.275377:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560962944 00000100:00100000:0.0:1786002525.275421:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:0.0:1786002525.275431:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3644:x1872758560962944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002525.275443:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002525.275460:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af578414aa5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414a9e expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002525.275477:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002525.275481:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002525.275512:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3644:x1872758560962944:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002525.275519:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:0.0:1786002525.275559:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560962944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002525.276746:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786002525.276755:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229000/0x7cee4af578414a9e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414aa5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002525.276774:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1786002525.276780:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a200/0x7cee4af578414aac lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414ab3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002525.276788:0:10360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a200/0x7cee4af578414aac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414ab3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002525.276890:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:18409:x1872758530896384:12345-192.168.203.49@tcp:36:rm.0 Request processed in 83857us (84062us total) trans 4294968558 rc 0/0 00000100:00100000:1.0:1786002525.276898:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23878 00010000:00010000:3.0:1786002525.286421:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002526.058394:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560963072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002526.058454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002526.058549:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560963072 00000100:00100000:3.0:1786002526.058556:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560963072 00000100:00100000:3.0:1786002526.058604:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:3.0:1786002526.058614:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1872758560963072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002526.058649:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445093376 avail 1298853888 00000100:00100000:3.0:1786002526.058693:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1872758560963072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002526.058704:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00000100:00100000:2.0:1786002526.058819:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560963072:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1786002526.126010:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002526.609135:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002526.609215:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530896640 00000100:00100000:2.0:1786002526.609225:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530896640 00000100:00100000:2.0:1786002526.609304:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23879 00000100:00100000:2.0:1786002526.609314:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:18421:x1872758530896640:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002526.609331:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002526.609349:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414ae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.609402:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414aeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.609413:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414aeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.609423:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414aeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002526.609461:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:2.0:1786002526.609465:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786002526.609481:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414aeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.609501:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af578414ae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab3f expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.609517:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414aeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab3f expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.609524:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002526.609527:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786002526.609530:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a400, rc 0) 00000100:00100000:2.0:1786002526.609590:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18421:x1872758530896640:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 269us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002526.609597:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23879 00000100:00080000:3.0:1786002526.609936:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002526.630041:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002526.630077:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002526.630138:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530896896 00000100:00100000:1.0:1786002526.630147:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530896896 00000100:00100000:1.0:1786002526.630216:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3884 00000100:00100000:1.0:1786002526.630225:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758530896896:12345-192.168.203.49@tcp:63:ll_sa.0 00010000:00010000:1.0:1786002526.630256:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002526.630273:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414af2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab4d expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630319:0:15596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414af9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630331:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630340:0:15596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630353:0:15596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630359:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630364:0:15596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630405:0:15596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630410:0:15596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414af9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630415:0:15596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414af9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630421:0:15596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002526.630424:0:15596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414af9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630430:0:15596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414af9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630439:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002526.630443:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002526.630447:0:15596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414af9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630452:0:15596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414af9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630461:0:15596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630466:0:15596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630471:0:15596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630475:0:15596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ec00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002526.630478:0:15596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630482:0:15596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630487:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x861f4748 (ffff9ed245e35000) 00010000:00010000:1.0:1786002526.630490:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002526.630492:0:15596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630496:0:15596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630518:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414af2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab4d expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630526:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002526.630528:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002526.630531:0:15596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414af2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab4d expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.630538:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f200, rc -2) 00000100:00100000:1.0:1786002526.630619:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758530896896:12345-192.168.203.49@tcp:63:ll_sa.0 Request processed in 395us (541us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002526.630625:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3884 00000100:00100000:3.0:1786002526.630748:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530896768 00000100:00100000:3.0:1786002526.630753:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530896768 00000100:00100000:3.0:1786002526.630788:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23880 00000100:00100000:3.0:1786002526.630796:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18421:x1872758530896768:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002526.630805:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002526.630814:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414b07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab46 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630868:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630878:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630886:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630897:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630903:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630909:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630936:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b0e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630943:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b0e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630948:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630954:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630959:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002526.630962:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630969:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b0e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630977:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002526.630979:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002526.630982:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b0e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.630987:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.631001:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.631006:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.631012:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.631017:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002526.631020:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.631026:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.631033:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9ed24556e700) 00010000:00010000:3.0:1786002526.631035:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002526.631038:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.631043:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.631068:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414b07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab46 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.631075:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002526.631077:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002526.631081:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414b07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab46 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.631088:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228800, rc 0) 00000100:00100000:3.0:1786002526.631128:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18421:x1872758530896768:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 334us (1096us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002526.631133:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23880 00000100:00100000:0.0:1786002526.665228:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002526.665298:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530897152 00000100:00100000:1.0:1786002526.665308:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530897152 00000100:00100000:1.0:1786002526.665370:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23881 00000100:00100000:1.0:1786002526.665381:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18421:x1872758530897152:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:1.0:1786002526.665432:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002526.665456:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414aeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab3f expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.665473:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002526.665477:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002526.665538:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b1c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.665551:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.665561:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.665574:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.665582:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.665588:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:02000000:1.0:1786002526.665698:0:10360:0:(lod_object.c:2112:lod_mdt_alloc_specific()) *** cfs_fail_loc=189, val=0*** 00010000:00010000:1.0:1786002526.668023:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414b2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668038:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414b2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668048:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414b2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668065:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414b31 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668072:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414b31 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668079:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414b31 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002526.668088:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004018a90a reply state 00000000f04d8a3b transno 4294983572 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414b31 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668099:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414b31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668107:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:1.0:1786002526.668110:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002526.668113:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1786002526.668120:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004018a90a reply state 00000000f04d8a3b transno 4294983572 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414b2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668128:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414b2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668134:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9ed245e35900) 00010000:00010000:1.0:1786002526.668137:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002526.668138:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1786002526.668142:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153f:0x0]: returning size 4096 00010000:00010000:1.0:1786002526.668150:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b1c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668157:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b1c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668163:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b1c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668171:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b1c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668178:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002526.668182:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b1c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668190:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b1c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668204:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002526.668206:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002526.668210:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b1c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668216:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b1c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002526.668227:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004018a90a reply state 00000000f04d8a3b transno 4294983572 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668235:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.668242:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9ed245e35000) 00010000:00010000:1.0:1786002526.668244:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002526.668246:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1786002526.668325:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:18421:x1872758530897152:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 2943us (3102us total) trans 4294983572 rc 0/0 00000100:00100000:1.0:1786002526.668334:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23881 00000100:00100000:3.0:1786002526.675058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002526.678174:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530897280 00000100:00100000:1.0:1786002526.678186:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530897280 00000100:00100000:1.0:1786002526.678249:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23882 00000100:00100000:1.0:1786002526.678259:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:18233:x1872758530897280:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002526.678280:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002526.678298:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af578414b38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab54 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.678353:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414b3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.678365:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414b3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.678375:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414b3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002526.678410:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:1.0:1786002526.678413:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786002526.678428:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414b3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.678447:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af578414b38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab54 expref: 12 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.678464:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414b3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab54 expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.678471:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002526.678474:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786002526.678477:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f000, rc 0) 00000100:00100000:1.0:1786002526.678540:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:18233:x1872758530897280:12345-192.168.203.49@tcp:101:bash.0 Request processed in 282us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002526.678546:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23882 00000100:00100000:1.0:1786002526.682050:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002526.682191:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530897408 00000100:00100000:2.0:1786002526.682199:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530897408 00000100:00100000:2.0:1786002526.682247:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23883 00000100:00100000:2.0:1786002526.682256:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:18233:x1872758530897408:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002526.682274:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002526.682290:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578414b46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab5b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682339:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414b4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682351:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414b4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682363:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414b4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682373:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414b54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682379:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414b54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682385:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414b54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682446:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414b5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682453:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682458:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002526.682518:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153f:0x0]: returning size 4096 00000004:00200000:2.0:1786002526.682523:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1786002526.682538:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682548:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414b4d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682554:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414b4d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682559:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414b4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682564:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414b4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682569:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002526.682572:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414b4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682579:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414b4d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682589:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002526.682593:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002526.682597:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414b4d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682603:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414b4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682615:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414b54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682621:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414b54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682627:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414b54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682632:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002526.682635:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414b54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682641:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414b54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682647:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9ed245e35000) 00010000:00010000:2.0:1786002526.682650:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002526.682653:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414b54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682659:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414b54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682682:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578414b46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab5b expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682698:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab5b expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.682706:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9ed245e35900) 00010000:00010000:2.0:1786002526.682708:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786002526.682710:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b600, rc 0) 00000100:00100000:2.0:1786002526.682774:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18233:x1872758530897408:12345-192.168.203.49@tcp:101:bash.0 Request processed in 519us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002526.682781:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23883 00000100:00100000:2.0:1786002526.695654:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002526.695743:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530897536 00000100:00100000:0.0:1786002526.695752:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530897536 00000100:00100000:0.0:1786002526.695814:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23884 00000100:00100000:0.0:1786002526.695824:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18233:x1872758530897536:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002526.695873:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002526.695894:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578414b62 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab62 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.695949:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414b69 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.695962:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414b69 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.695973:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414b69 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002526.696017:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd6:0x0]: returning size 4096 00000004:00200000:0.0:1786002526.696021:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1786002526.696053:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578414b62 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab62 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.696071:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414b69 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab62 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.696079:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:0.0:1786002526.696082:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002526.696085:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35000, rc 0) 00000100:00100000:0.0:1786002526.696142:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:18233:x1872758530897536:12345-192.168.203.49@tcp:101:bash.0 Request processed in 320us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002526.696152:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23884 00000100:00100000:3.0:1786002526.708220:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002526.708247:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530897792 00000100:00100000:3.0:1786002526.708256:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530897792 00000100:00100000:3.0:1786002526.708331:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23885 00000100:00100000:3.0:1786002526.708339:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:18233:x1872758530897792:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002526.708357:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002526.708359:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786002526.708380:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578414b69 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab62 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.708394:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:3.0:1786002526.708397:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002526.708408:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414b70 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab69 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.708512:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b77 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.708523:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b77 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.708530:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b77 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.708541:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b7e lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.708547:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b7e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.708552:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b7e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002526.713977:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ca:0x0], index 1: 0 00010000:00010000:3.0:1786002526.714122:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414b85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714137:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414b85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714147:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414b85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714177:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b77 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714184:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b77 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714190:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b77 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714198:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b77 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714204:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002526.714208:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b77 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714215:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b77 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714226:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:3.0:1786002526.714229:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002526.714234:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b77 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714240:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578414b77 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002526.714257:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000694d5f03 reply state 00000000e6f542b6 transno 4294983573 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b7e lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714266:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714272:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xdcc87686 (ffff9ed24556e700) 00010000:00010000:3.0:1786002526.714274:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002526.714277:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002526.714306:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414b70 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab69 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714318:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414b85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab69 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.714326:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9ed24556e800) 00010000:00010000:3.0:1786002526.714329:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002526.714331:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229a00, rc 0) 00000100:00100000:3.0:1786002526.714384:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18233:x1872758530897792:12345-192.168.203.49@tcp:101:bash.0 Request processed in 6046us (6170us total) trans 4294983573 rc 0/0 00000100:00100000:3.0:1786002526.714392:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23885 00000100:00100000:2.0:1786002526.753257:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002526.761422:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530897920 00000100:00100000:1.0:1786002526.761436:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530897920 00000100:00100000:1.0:1786002526.761497:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5207 00000100:00100000:1.0:1786002526.761508:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18233:x1872758530897920:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002526.761526:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002526.761547:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab70 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002526.761571:0:14665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002526.761592:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=886s v=(0 0) 00010000:00010000:1.0:1786002526.761597:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002526.761607:0:14665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 16 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.761624:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 16 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.761637:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fe00, rc 0) 00000100:00100000:1.0:1786002526.761695:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18233:x1872758530897920:12345-192.168.203.49@tcp:101:bash.0 Request processed in 190us (8447us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002526.761702:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5207 00000100:00080000:3.0:1786002526.767202:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002526.809594:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002526.809718:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530898176 00000100:00100000:3.0:1786002526.809736:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530898176 00000100:00100000:3.0:1786002526.809789:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5093 00000100:00100000:3.0:1786002526.809799:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18233:x1872758530898176:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:3.0:1786002526.810082:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18233:x1872758530898176:12345-192.168.203.49@tcp:35:bash.0 Request processed in 283us (497us total) trans 4294983574 rc 0/0 00000100:00100000:3.0:1786002526.810090:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5093 00000100:00100000:3.0:1786002526.819383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002526.819763:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530898432 00000100:00100000:1.0:1786002526.819774:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530898432 00000100:00100000:1.0:1786002526.819832:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23886 00000100:00100000:1.0:1786002526.819843:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18233:x1872758530898432:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002526.819892:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002526.819912:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b9a lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab77 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820004:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ba1 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820018:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820031:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820045:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414ba8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820052:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820059:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002526.820325:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cb:0x0], index 0: 0 00010000:00010000:1.0:1786002526.820445:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414baf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820454:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820462:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820491:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ba1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820499:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ba1 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820505:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ba1 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820512:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ba1 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820519:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002526.820523:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ba1 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820532:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ba1 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820544:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:1.0:1786002526.820547:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002526.820551:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ba1 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820557:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578414ba1 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002526.820569:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be37b0d8 reply state 00000000870e1faa transno 4294983575 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820579:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820585:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xbc0ca3a9 (ffff9ed245e35b00) 00010000:00010000:1.0:1786002526.820588:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002526.820590:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002526.820611:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578414b9a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab77 expref: 19 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820630:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414baf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab77 expref: 18 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.820638:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:1.0:1786002526.820641:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002526.820643:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ce00, rc 0) 00000100:00100000:1.0:1786002526.820693:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18233:x1872758530898432:12345-192.168.203.49@tcp:101:bash.0 Request processed in 852us (1318us total) trans 4294983575 rc 0/0 00000100:00100000:1.0:1786002526.820701:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23886 00000100:00100000:2.0:1786002526.831825:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002526.831929:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530898560 00000100:00100000:1.0:1786002526.831939:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530898560 00000100:00100000:1.0:1786002526.832006:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5208 00000100:00100000:1.0:1786002526.832018:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18233:x1872758530898560:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002526.832034:0:14687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002526.832054:0:14687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000515dfc57/0x7cee4af578414bbd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab7e expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002526.832076:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002526.832097:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=887s v=(0 0) 00010000:00010000:1.0:1786002526.832101:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002526.832111:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000515dfc57/0x7cee4af578414bbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab7e expref: 17 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.832129:0:14687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000515dfc57/0x7cee4af578414bbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab7e expref: 17 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786002526.832131:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786002526.832151:0:14687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d000, rc 0) 00000100:00100000:1.0:1786002526.832208:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18233:x1872758530898560:12345-192.168.203.49@tcp:101:bash.0 Request processed in 192us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002526.832215:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5208 00000100:00100000:2.0:1786002526.838888:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002526.838970:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530898816 00000100:00100000:0.0:1786002526.838979:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530898816 00000100:00100000:0.0:1786002526.839027:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5094 00000100:00100000:0.0:1786002526.839036:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18233:x1872758530898816:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:0.0:1786002526.839283:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18233:x1872758530898816:12345-192.168.203.49@tcp:35:bash.0 Request processed in 246us (444us total) trans 4294983576 rc 0/0 00000100:00100000:0.0:1786002526.839290:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5094 00000100:00100000:3.0:1786002526.847551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002526.847789:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530899072 00000100:00100000:2.0:1786002526.847799:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530899072 00000100:00100000:3.0:1786002526.847894:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23887 00000100:00100000:3.0:1786002526.847906:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18233:x1872758530899072:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002526.847933:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002526.848304:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578414bc4 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab85 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848405:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414bcb lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848419:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414bcb lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848431:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414bcb lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848445:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414bd2 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848453:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848459:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002526.848745:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cb:0x0], index 1: 0 00010000:00010000:0.0:1786002526.848898:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578414bd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848907:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578414bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848915:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578414bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848947:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414bcb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848955:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414bcb lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848961:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414bcb lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848967:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414bcb lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848973:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002526.848976:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414bcb lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848983:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414bcb lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.848994:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:0.0:1786002526.848997:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002526.849001:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414bcb lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.849008:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414bcb lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002526.849019:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000020620d0 reply state 00000000012733ca transno 4294983577 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.849028:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414bd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.849036:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x391d5834 (ffff9ed3465adf00) 00010000:00010000:0.0:1786002526.849039:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002526.849041:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002526.849077:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578414bc4 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab85 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.849092:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578414bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab85 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002526.849100:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff9ed3465ad300) 00010000:00010000:0.0:1786002526.849103:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002526.849105:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35a00, rc 0) 00000100:00100000:0.0:1786002526.849171:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:18233:x1872758530899072:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1267us (1628us total) trans 4294983577 rc 0/0 00000100:00100000:3.0:1786002526.854973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002526.858815:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530899200 00000100:00100000:1.0:1786002526.858828:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530899200 00000100:00100000:1.0:1786002526.858927:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5209 00000100:00100000:1.0:1786002526.858938:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18233:x1872758530899200:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002526.858954:0:14685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002526.858974:0:14685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cd0d33f/0x7cee4af578414be7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab8c expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002526.858997:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002526.859019:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=887s v=(0 0) 00010000:00010000:1.0:1786002526.859025:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002526.859034:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd0d33f/0x7cee4af578414be7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab8c expref: 17 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.859052:0:14685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000cd0d33f/0x7cee4af578414be7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab8c expref: 17 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002526.859065:0:14685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8da00, rc 0) 00000100:00100000:1.0:1786002526.859132:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18233:x1872758530899200:12345-192.168.203.49@tcp:101:bash.0 Request processed in 195us (4165us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002526.859144:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5209 00000100:00100000:0.0:1786002526.866423:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23887 00000100:00100000:3.0:1786002526.871456:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002526.871588:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530899456 00000100:00100000:1.0:1786002526.871598:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530899456 00000100:00100000:1.0:1786002526.871652:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5095 00000100:00100000:1.0:1786002526.871663:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:18233:x1872758530899456:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:1.0:1786002526.871995:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18233:x1872758530899456:12345-192.168.203.49@tcp:35:bash.0 Request processed in 332us (547us total) trans 4294983578 rc 0/0 00000100:00100000:1.0:1786002526.872003:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5095 00000100:00100000:3.0:1786002526.878444:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002526.878544:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530899712 00000100:00100000:2.0:1786002526.878552:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530899712 00000100:00100000:2.0:1786002526.878612:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23888 00000100:00100000:2.0:1786002526.878623:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18233:x1872758530899712:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002526.878646:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002526.878665:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414bee lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab93 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.878786:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414bf5 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.878804:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.878815:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.878829:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414bfc lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.878835:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414bfc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.878841:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414bfc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002526.879158:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cc:0x0], index 0: 0 00010000:00010000:2.0:1786002526.879280:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578414c03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879289:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578414c03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879296:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578414c03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879326:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414bf5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879332:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414bf5 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879338:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414bf5 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879345:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414bf5 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879351:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002526.879355:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414bf5 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879362:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414bf5 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879371:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:2.0:1786002526.879374:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002526.879379:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414bf5 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879385:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414bf5 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002526.879399:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e738a4e3 reply state 00000000f1d69b8b transno 4294983579 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414bfc lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879408:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414bfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879414:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x18618557 (ffff9ed366e57500) 00010000:00010000:2.0:1786002526.879417:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002526.879419:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002526.879443:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414bee lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab93 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879457:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578414c03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab93 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.879465:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff9ed366e57900) 00010000:00010000:2.0:1786002526.879467:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002526.879469:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a800, rc 0) 00000100:00100000:2.0:1786002526.879530:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:18233:x1872758530899712:12345-192.168.203.49@tcp:101:bash.0 Request processed in 909us (1096us total) trans 4294983579 rc 0/0 00000100:00100000:2.0:1786002526.879538:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23888 00000100:00100000:2.0:1786002526.888002:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002526.888079:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530899840 00000100:00100000:3.0:1786002526.888088:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530899840 00000100:00100000:3.0:1786002526.888145:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5210 00000100:00100000:3.0:1786002526.888155:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18233:x1872758530899840:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002526.888173:0:8764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002526.888192:0:8764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de79215f/0x7cee4af578414c11 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ab9a expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002526.888212:0:8764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002526.888233:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=887s v=(0 0) 00010000:00010000:3.0:1786002526.888237:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002526.888246:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de79215f/0x7cee4af578414c11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab9a expref: 18 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.888259:0:8764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de79215f/0x7cee4af578414c11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab9a expref: 18 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.888269:0:8764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228800, rc 0) 00000100:00100000:3.0:1786002526.888329:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18233:x1872758530899840:12345-192.168.203.49@tcp:101:bash.0 Request processed in 176us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002526.888336:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5210 00000100:00100000:2.0:1786002526.906895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002526.906997:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530900096 00000100:00100000:0.0:1786002526.907006:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530900096 00000100:00100000:0.0:1786002526.907061:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5096 00000100:00100000:0.0:1786002526.907072:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:18233:x1872758530900096:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:0.0:1786002526.907398:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18233:x1872758530900096:12345-192.168.203.49@tcp:35:bash.0 Request processed in 326us (511us total) trans 4294983580 rc 0/0 00000100:00100000:0.0:1786002526.907406:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5096 00000100:00100000:0.0:1786002526.919234:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002526.919372:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530900352 00000100:00100000:2.0:1786002526.919382:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530900352 00000100:00100000:2.0:1786002526.919443:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23889 00000100:00100000:2.0:1786002526.919453:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18233:x1872758530900352:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002526.919475:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002526.919494:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414c18 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aba1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.919586:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414c1f lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.919600:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414c1f lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.919611:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414c1f lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.919625:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414c26 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.919638:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414c26 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.919645:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414c26 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002526.919973:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cc:0x0], index 1: 0 00010000:00010000:2.0:1786002526.920210:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578414c2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920220:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578414c2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920228:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578414c2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920269:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414c1f lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920277:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414c1f lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920283:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414c1f lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920290:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414c1f lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920297:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ac00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002526.920301:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414c1f lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920313:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414c1f lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920325:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:2.0:1786002526.920328:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002526.920333:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414c1f lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920340:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414c1f lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002526.920354:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000510d3fa9 reply state 00000000b10f7b33 transno 4294983581 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414c26 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920364:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414c26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920371:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xb62e0cbf (ffff9ed366e57100) 00010000:00010000:2.0:1786002526.920373:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002526.920375:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002526.920398:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414c18 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba1 expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920412:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578414c2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba1 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002526.920420:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff9ed366e57e00) 00010000:00010000:2.0:1786002526.920423:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002526.920425:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2ae00, rc 0) 00000100:00100000:2.0:1786002526.920479:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:18233:x1872758530900352:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1027us (1253us total) trans 4294983581 rc 0/0 00000100:00100000:2.0:1786002526.920487:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23889 00000100:00100000:2.0:1786002526.928904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002526.929058:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530900480 00000100:00100000:3.0:1786002526.929068:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530900480 00000100:00100000:3.0:1786002526.929123:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5211 00000100:00100000:3.0:1786002526.929133:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18233:x1872758530900480:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002526.929151:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002526.929172:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aba8 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002526.929196:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002526.929216:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=887s v=(0 0) 00010000:00010000:3.0:1786002526.929221:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002526.929229:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 18 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.929245:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 18 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.929262:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228c00, rc 0) 00000100:00100000:3.0:1786002526.929308:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18233:x1872758530900480:12345-192.168.203.49@tcp:101:bash.0 Request processed in 177us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002526.929314:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5211 00000100:00100000:0.0:1786002526.933423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002526.933495:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530900736 00000100:00100000:3.0:1786002526.933505:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530900736 00000100:00100000:3.0:1786002526.933556:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5097 00000100:00100000:3.0:1786002526.933566:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:18233:x1872758530900736:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:3.0:1786002526.933888:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:18233:x1872758530900736:12345-192.168.203.49@tcp:35:bash.0 Request processed in 321us (472us total) trans 4294983582 rc 0/0 00000100:00100000:3.0:1786002526.933896:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5097 00000100:00100000:0.0:1786002526.943137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002526.943267:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530900992 00000100:00100000:3.0:1786002526.943276:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530900992 00000100:00100000:3.0:1786002526.943341:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23890 00000100:00100000:3.0:1786002526.943351:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:18233:x1872758530900992:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002526.943375:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002526.943395:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414c42 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3abaf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.943491:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414c49 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.943505:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414c49 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.943516:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414c49 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.943531:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578414c50 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.943538:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578414c50 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.943544:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578414c50 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002526.943909:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cd:0x0], index 0: 0 00010000:00010000:3.0:1786002526.944027:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414c57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944037:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414c57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944044:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414c57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944087:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414c49 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944095:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414c49 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944102:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414c49 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944108:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414c49 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944114:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002526.944119:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414c49 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944126:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414c49 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944137:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:3.0:1786002526.944140:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002526.944144:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414c49 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944152:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af578414c49 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002526.944169:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4217126 reply state 00000000054fc8a4 transno 4294983583 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578414c50 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944179:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578414c50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944185:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x84832a57 (ffff9ed24556ed00) 00010000:00010000:3.0:1786002526.944187:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002526.944189:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002526.944212:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414c42 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abaf expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944227:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414c57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abaf expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.944234:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:3.0:1786002526.944237:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002526.944239:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229000, rc 0) 00000100:00100000:3.0:1786002526.944291:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:18233:x1872758530900992:12345-192.168.203.49@tcp:101:bash.0 Request processed in 941us (1163us total) trans 4294983583 rc 0/0 00000100:00100000:3.0:1786002526.944298:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23890 00000100:00100000:2.0:1786002526.959132:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002526.959254:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530901120 00000100:00100000:3.0:1786002526.959263:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530901120 00000100:00100000:3.0:1786002526.959310:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5212 00000100:00100000:3.0:1786002526.959319:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18233:x1872758530901120:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002526.959337:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002526.959356:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3abb6 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002526.959378:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002526.959399:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=887s v=(0 0) 00010000:00010000:3.0:1786002526.959404:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002526.959413:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.959428:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002526.959441:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228200, rc 0) 00000100:00100000:3.0:1786002526.959501:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18233:x1872758530901120:12345-192.168.203.49@tcp:101:bash.0 Request processed in 182us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002526.959508:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5212 00000100:00100000:0.0:1786002526.964227:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002526.964398:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530901376 00000100:00100000:1.0:1786002526.964407:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530901376 00000100:00100000:1.0:1786002526.964461:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5098 00000100:00100000:1.0:1786002526.964471:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:18233:x1872758530901376:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:1.0:1786002526.965020:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:18233:x1872758530901376:12345-192.168.203.49@tcp:35:bash.0 Request processed in 535us (785us total) trans 4294983584 rc 0/0 00000100:00100000:1.0:1786002526.965040:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5098 00000100:00100000:2.0:1786002527.000642:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.000754:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530901632 00000100:00100000:1.0:1786002527.000763:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530901632 00000100:00100000:1.0:1786002527.000825:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23891 00000100:00100000:1.0:1786002527.000835:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:18422:x1872758530901632:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002527.000892:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.000912:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414c6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3abbd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002527.001043:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153f:0x0]: returning size 4096 00010000:00010000:1.0:1786002527.001135:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414c6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abbd expref: 38 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.001150:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002527.001153:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002527.001158:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578414c6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abbd expref: 38 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.001172:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d400, rc 0) 00000100:00100000:1.0:1786002527.001219:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:18422:x1872758530901632:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 386us (586us total) trans 4294983585 rc 301/301 00000100:00100000:1.0:1786002527.001226:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23891 00000100:00100000:0.0:1786002527.006558:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.006635:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530901760 00000100:00100000:2.0:1786002527.006644:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530901760 00000100:00100000:2.0:1786002527.006698:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5099 00000100:00100000:2.0:1786002527.006709:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:18422:x1872758530901760:12345-192.168.203.49@tcp:33:lfs.0 00000004:00200000:2.0:1786002527.006881:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153f:0x0]: returning size 4096 00000004:00200000:2.0:1786002527.006886:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:2.0:1786002527.006952:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:18422:x1872758530901760:12345-192.168.203.49@tcp:33:lfs.0 Request processed in 245us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.006961:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5099 00000100:00100000:0.0:1786002527.011487:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.011682:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530902016 00000100:00100000:1.0:1786002527.011691:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530902016 00000100:00100000:1.0:1786002527.011762:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5100 00000100:00100000:1.0:1786002527.011773:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:18422:x1872758530902016:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1786002527.012004:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+38:18422:x1872758530902016:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 232us (536us total) trans 4294983586 rc 0/0 00000100:00100000:1.0:1786002527.012011:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5100 00000100:00100000:0.0:1786002527.039633:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.039828:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530902272 00000100:00100000:2.0:1786002527.039838:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530902272 00000100:00100000:2.0:1786002527.039923:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23892 00000100:00100000:2.0:1786002527.039935:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+38:18423:x1872758530902272:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002527.039958:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002527.039977:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414c7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3abc4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.040118:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414c81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.040131:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414c81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x153f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.040141:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414c81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x153f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002527.040151:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x153f:0x0]: returning size 4096 00010000:00010000:2.0:1786002527.040237:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578414c7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abc4 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.040254:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414c81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x153f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abc4 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.040264:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9ed245e35900) 00010000:00010000:2.0:1786002527.040266:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786002527.040270:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b200, rc 0) 00000100:00100000:2.0:1786002527.040329:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:18423:x1872758530902272:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 397us (704us total) trans 4294983587 rc 0/0 00000100:00100000:2.0:1786002527.040337:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23892 00000100:00100000:0.0:1786002527.046437:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.046475:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.046551:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530902656 00000100:00100000:2.0:1786002527.046561:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530902656 00000100:00100000:2.0:1786002527.046618:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5101 00000100:00100000:2.0:1786002527.046628:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:18423:x1872758530902656:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:2.0:1786002527.046880:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+41:18423:x1872758530902656:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 251us (402us total) trans 4294983588 rc 0/0 00000100:00100000:2.0:1786002527.046888:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5101 00000100:00100000:3.0:1786002527.047042:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530902400 00000100:00100000:3.0:1786002527.047047:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530902400 00000100:00100000:3.0:1786002527.047099:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1485 00000100:00100000:3.0:1786002527.047107:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+41:2411:x1872758530902400:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:3.0:1786002527.047117:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002527.047139:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578414b3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab54 expref: 41 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.047155:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002527.047161:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002527.047182:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:2411:x1872758530902400:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 76us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.047189:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1485 00000100:00100000:0.0:1786002527.060818:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.060909:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.060987:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530903040 00000100:00100000:1.0:1786002527.060997:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530903040 00000100:00100000:1.0:1786002527.061076:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:1.0:1786002527.061087:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:18423:x1872758530903040:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:1.0:1786002527.061183:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.061194:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.061208:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.061227:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963200:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1786002527.061273:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.061331:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3455459c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.061350:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560963200 00000100:00100000:1.0:1786002527.061354:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560963200 00000100:00100000:1.0:1786002527.061385:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:1.0:1786002527.061392:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6535:x1872758560963200:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002527.061404:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.061418:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414c96 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414c8f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.061441:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414c96 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414c8f expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.061454:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414c96 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414c8f expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.061462:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed245e35100) 00010000:00010000:1.0:1786002527.061465:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.061468:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ca00, rc 0) 00000100:00100000:1.0:1786002527.061507:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:6535:x1872758560963200:12345-0@lo:101:mdt_io00_002.0 Request processed in 115us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.061513:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00000100:00100000:1.0:1786002527.061554:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963200:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002527.061568:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414c96 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.061578:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414c96 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002527.061595:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000004:00080000:1.0:1786002527.061607:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1786002527.061636:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963328:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.061665:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.061680:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.061692:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560963328 00000100:00100000:1.0:1786002527.061696:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560963328 00000100:00100000:1.0:1786002527.061717:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:1.0:1786002527.061735:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:6535:x1872758560963328:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.061804:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:6535:x1872758560963328:12345-0@lo:1000:mdt_io00_002.0 Request processed in 80us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.061811:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000100:00100000:1.0:1786002527.061835:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963328:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.061904:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963456:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.061928:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.061947:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.061958:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560963456 00000100:00100000:1.0:1786002527.061961:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560963456 00000100:00100000:1.0:1786002527.061982:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:1.0:1786002527.061988:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:6535:x1872758560963456:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.062035:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:6535:x1872758560963456:12345-0@lo:1000:mdt_io00_002.0 Request processed in 47us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.062041:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00100000:1.0:1786002527.062066:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963456:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.062098:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963584:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.062120:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.062133:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.062144:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560963584 00000100:00100000:1.0:1786002527.062147:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560963584 00000100:00100000:1.0:1786002527.062166:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:1.0:1786002527.062172:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:6535:x1872758560963584:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.062249:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:6535:x1872758560963584:12345-0@lo:1000:mdt_io00_002.0 Request processed in 77us (127us total) trans 0 rc 1/1 00000100:00100000:1.0:1786002527.062254:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00100000:1.0:1786002527.062276:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963584:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.062326:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963712:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.062348:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.062361:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.062373:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560963712 00000100:00100000:1.0:1786002527.062376:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560963712 00000100:00100000:1.0:1786002527.062397:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:1.0:1786002527.062404:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6535:x1872758560963712:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.062452:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6535:x1872758560963712:12345-0@lo:1000:mdt_io00_002.0 Request processed in 48us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.062458:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00000100:00100000:1.0:1786002527.062483:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963712:0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1786002527.062517:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.062525:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.062532:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.062543:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963840:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1786002527.062566:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.062579:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3455459c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.062590:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560963840 00000100:00100000:1.0:1786002527.062593:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560963840 00000100:00100000:1.0:1786002527.062612:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:1.0:1786002527.062618:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:6535:x1872758560963840:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002527.062627:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.062638:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414ca4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414c9d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.062656:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414ca4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414c9d expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.062666:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414ca4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414c9d expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.062673:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002527.062675:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.062678:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c200, rc 0) 00000100:00100000:1.0:1786002527.062706:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6535:x1872758560963840:12345-0@lo:101:mdt_io00_002.0 Request processed in 88us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.062711:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00100000:1.0:1786002527.062748:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963840:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002527.062758:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414ca4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.062767:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414ca4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002527.062779:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1786002527.062798:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.062804:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.062811:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.062822:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963968:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1786002527.062866:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.062885:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3455459c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.062896:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560963968 00000100:00100000:1.0:1786002527.062899:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560963968 00000100:00100000:1.0:1786002527.062920:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:1.0:1786002527.062926:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6535:x1872758560963968:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002527.062933:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.062942:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578414cb2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414cab expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.062956:0:15596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.062964:0:15596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578414cb2 lrc: 4/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414cab expref: 14 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.062976:0:15596:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1786002527.063001:0:15596:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1786002527.063030:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578414cb2 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414cab expref: 14 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.063036:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9ed245e35000) 00010000:00010000:1.0:1786002527.063038:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.063042:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578414cb2 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414cab expref: 14 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.063049:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d200, rc 0) 00000100:00100000:1.0:1786002527.063076:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560963968:12345-0@lo:101:mdt_io00_002.0 Request processed in 150us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.063081:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00100000:1.0:1786002527.063106:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560963968:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002527.063114:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.063126:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786002527.063334:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786002527.063435:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530902784 00000100:00100000:2.0:1786002527.063440:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530902784 00000100:00100000:2.0:1786002527.063484:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1486 00000100:00100000:2.0:1786002527.063492:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af74450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:2410:x1872758530902784:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:2.0:1786002527.063502:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786002527.063519:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414c81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x153f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abc4 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.063535:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414b5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x153f:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab5b expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.063543:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9ed245e35900) 00010000:00010000:2.0:1786002527.063547:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002527.063592:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af74450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+38:2410:x1872758530902784:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 100us (2682us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.063598:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1486 00000001:00080000:0.0:1786002527.076732:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983588 is committed 00000001:00080000:0.0:1786002527.076768:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983571 is committed 00000020:00080000:0.0:1786002527.076772:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 412 batchid updated 00010000:00010000:1.0:1786002527.078887:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.078903:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.078911:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.078917:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ec00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002527.078921:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.078928:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.078944:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9ed245e35000) 00010000:00010000:1.0:1786002527.078948:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.078956:0:3631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578414cb2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414cab expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.078968:0:3631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578414cb2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578414cab expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.078977:0:3631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578414cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578414cab expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.079020:0:3631:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578414cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414cab expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.079035:0:3631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3631:1872758560964096:0@lo:105: 00000100:00100000:1.0:1786002527.079100:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.079161:0:3631:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3455459c0 going to sleep for 11 seconds 00000020:00080000:3.0:1786002527.079177:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 412 00000004:00080000:3.0:1786002527.079235:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245dcfb40 with version 774 00000020:00080000:3.0:1786002527.079263:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 407 cancel update log [0x240000401:0x3:0x0].401: rc = 0 00000020:00080000:3.0:1786002527.079351:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 407 cancel update log [0x200000400:0x3:0x0].402: rc = 0 00000004:00080000:3.0:1786002527.079378:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245dcfa80 with version 775 00000020:00080000:3.0:1786002527.079381:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 408 cancel update log [0x240000401:0x3:0x0].402: rc = 0 00000020:00080000:3.0:1786002527.079401:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 408 cancel update log [0x200000400:0x3:0x0].403: rc = 0 00000004:00080000:3.0:1786002527.079420:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245dcff00 with version 776 00000020:00080000:3.0:1786002527.079423:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 409 cancel update log [0x240000401:0x3:0x0].403: rc = 0 00000020:00080000:3.0:1786002527.079441:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 409 cancel update log [0x200000400:0x3:0x0].404: rc = 0 00000004:00080000:3.0:1786002527.079459:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed3821ffcc0 with version 777 00000020:00080000:3.0:1786002527.079462:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 410 cancel update log [0x240000401:0x3:0x0].405: rc = 0 00000020:00080000:3.0:1786002527.079478:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 410 cancel update log [0x200000400:0x3:0x0].405: rc = 0 00000004:00080000:3.0:1786002527.079496:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed353790540 with version 778 00000020:00080000:3.0:1786002527.079499:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 411 cancel update log [0x240000401:0x3:0x0].406: rc = 0 00000020:00080000:3.0:1786002527.079515:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 411 cancel update log [0x200000400:0x3:0x0].406: rc = 0 00000004:00080000:3.0:1786002527.079532:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245d3f0c0 with version 779 00000020:00080000:3.0:1786002527.079534:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 412 cancel update log [0x240000401:0x3:0x0].407: rc = 0 00000020:00080000:3.0:1786002527.079550:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 412 cancel update log [0x200000400:0x3:0x0].407: rc = 0 00000020:00080000:3.0:1786002527.079556:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 412 00000004:00080000:1.0:1786002527.079793:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 774 rpc_version 774 00000020:00100000:1.0:1786002527.079817:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002527.079824:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed3433f7800 x1872758560964352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002527.079894:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560964352:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002527.079932:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.079965:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545540 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.079992:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560964096 00000100:00100000:2.0:1786002527.080001:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560964096 00000100:00100000:3.0:1786002527.080058:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560964352 00000100:00100000:2.0:1786002527.080063:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1786002527.080072:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560964352 00000100:00100000:2.0:1786002527.080075:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3631:x1872758560964096:12345-0@lo:105: 00010000:00010000:2.0:1786002527.080089:0:17237:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080100:0:17237:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080110:0:17237:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.080114:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:3.0:1786002527.080125:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1872758560964352:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1786002527.080126:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080138:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080147:0:17237:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080168:0:17237:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245c8c400) 00000100:00100000:2.0:1786002527.080215:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3631:x1872758560964096:12345-0@lo:105: Request processed in 143us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.080225:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:2.0:1786002527.080279:0:3631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3631:1872758560964096:0@lo:105: 00010000:00010000:2.0:1786002527.080310:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080319:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578414b23 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080333:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414b2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080339:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414b2a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080345:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414b2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080351:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.080355:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414b2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080364:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414b2a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080375:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9ed245e35900) 00010000:00010000:2.0:1786002527.080377:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.080380:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414b2a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080386:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578414b2a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x153f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080400:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414b31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080406:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414b31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080411:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414b31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080415:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.080418:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414b31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080423:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414b31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080430:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:2.0:1786002527.080432:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.080435:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414b31 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080443:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578414b31 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080458:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080463:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080468:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080472:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.080475:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080480:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080486:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xdcc87686 (ffff9ed24556e700) 00010000:00010000:2.0:1786002527.080488:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.080491:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b7e lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080496:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414b7e lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080515:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080522:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414ba8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080528:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080533:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ea00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.080535:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080541:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414ba8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080548:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xbc0ca3a9 (ffff9ed245e35b00) 00010000:00010000:2.0:1786002527.080551:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.080553:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414ba8 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080559:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af578414ba8 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080571:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414bd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080576:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414bd2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080582:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414bd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080586:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.080589:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414bd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080597:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414bd2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080603:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x391d5834 (ffff9ed3465adf00) 00010000:00010000:2.0:1786002527.080605:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.080608:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414bd2 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080613:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414bd2 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080626:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414bfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080632:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414bfc lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080638:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414bfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080643:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.080646:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414bfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080653:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414bfc lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080660:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x18618557 (ffff9ed366e57500) 00010000:00010000:2.0:1786002527.080662:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.080664:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414bfc lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080670:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af578414bfc lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080683:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414c26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080689:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414c26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080695:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414c26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080700:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.080702:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414c26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080708:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414c26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080715:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xb62e0cbf (ffff9ed366e57100) 00010000:00010000:2.0:1786002527.080717:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.080720:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414c26 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080737:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414c26 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080758:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578414c50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080765:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578414c50 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080772:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578414c50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080777:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.080780:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578414c50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080785:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578414c50 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080792:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x84832a57 (ffff9ed24556ed00) 00010000:00010000:2.0:1786002527.080794:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.080797:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578414c50 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.080802:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af578414c50 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.082248:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.082263:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002527.082286:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1786002527.082337:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af578414cb9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.082344:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af578414cb9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.082355:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af578414cb9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.082375:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560964480:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1786002527.085557:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560964352:12345-0@lo:1000:osp_up1-0.0 Request processed in 5426us (5617us total) trans 4294968559 rc 0/0 00000100:00100000:3.0:1786002527.085571:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1786002527.092507:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f7800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560964352:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786002527.092525:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 775 rpc_version 775 00000020:00100000:2.0:1786002527.092553:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002527.092560:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2454cb480 x1872758560964736/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002527.092581:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560964736:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002527.092639:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.092729:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.093451:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.098944:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.100541:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560964736 00000100:00100000:0.0:1786002527.100554:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560964736 00000100:00100000:0.0:1786002527.100797:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560964480 00000100:00100000:0.0:1786002527.100802:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560964480 00000100:00100000:3.0:1786002527.100881:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:3.0:1786002527.100895:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560964736:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002527.100985:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:0.0:1786002527.100993:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:6535:x1872758560964480:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1786002527.101005:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002527.101026:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414cc0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414cb9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.101051:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414cc0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414cb9 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.101066:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414cc0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414cb9 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.101073:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002527.101077:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1786002527.101080:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35200, rc 0) 00000100:00100000:3.0:1786002527.101085:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560964736:12345-0@lo:1000:osp_up1-0.0 Request processed in 191us (8443us total) trans 4294968560 rc 0/0 00000100:00100000:3.0:1786002527.101094:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:0.0:1786002527.101122:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560964480:12345-0@lo:101:mdt_io00_002.0 Request processed in 129us (7672us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.101129:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000100:00100000:1.0:1786002527.101384:0:6535:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983571 gen 2 00000004:00080000:1.0:1786002527.101391:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983571 committed transno 4294983571 00000100:00100000:1.0:1786002527.101413:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560964480:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002527.101429:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af578414cb9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414cc0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.101440:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af578414cb9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414cc0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002527.101456:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x153f:0x0] 00000100:00100000:1.0:1786002527.101493:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560964864:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.101524:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.101549:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545900 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.101630:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560964864 00000100:00100000:3.0:1786002527.101635:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560964864 00000100:00100000:3.0:1786002527.101674:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:3.0:1786002527.101680:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560964864:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.101779:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560964864:12345-0@lo:1000:mdt_io00_002.0 Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.101788:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:1.0:1786002527.102403:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560964864:0@lo:1000:mdt_io00_002.0 00000004:00080000:1.0:1786002527.102425:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x153f:0x0] 00000100:00100000:1.0:1786002527.102451:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560964992:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.102477:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.102491:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545900 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.102541:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560964992 00000100:00100000:0.0:1786002527.102546:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560964992 00000100:00100000:0.0:1786002527.102575:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:0.0:1786002527.102582:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560964992:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.102660:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560964992:12345-0@lo:1000:mdt_io00_002.0 Request processed in 78us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.102666:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000100:00100000:1.0:1786002527.102820:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560964992:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.103463:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cb480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560964736:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786002527.103477:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 776 rpc_version 776 00000020:00100000:2.0:1786002527.103495:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002527.103501:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2454cad80 x1872758560965248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002527.103517:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560965248:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002527.103541:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560965376:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1786002527.103552:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.103570:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.103585:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.103607:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.103620:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560965248 00000100:00100000:2.0:1786002527.103625:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560965248 00000100:00100000:2.0:1786002527.103661:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560965376 00000100:00100000:2.0:1786002527.103664:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560965376 00000100:00100000:2.0:1786002527.103690:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:2.0:1786002527.103696:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560965248:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002527.103779:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:3.0:1786002527.103789:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560965376:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1786002527.103831:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560965248:12345-0@lo:1000:osp_up1-0.0 Request processed in 134us (278us total) trans 4294968561 rc 0/0 00000100:00100000:2.0:1786002527.103839:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00000100:00100000:2.0:1786002527.103886:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560965248:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786002527.103907:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 777 rpc_version 777 00000020:00100000:2.0:1786002527.103917:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002527.103921:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2454cbb80 x1872758560965632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002527.103932:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560965632:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002527.103954:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.103980:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.103990:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560965632 00000100:00100000:2.0:1786002527.103992:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560965632 00000100:00100000:2.0:1786002527.104008:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:2.0:1786002527.104012:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560965632:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002527.104077:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560965632:12345-0@lo:1000:osp_up1-0.0 Request processed in 63us (121us total) trans 4294968562 rc 0/0 00000100:00100000:2.0:1786002527.104083:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00100000:2.0:1786002527.104106:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560965632:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786002527.104127:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 778 rpc_version 778 00000020:00100000:2.0:1786002527.104136:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002527.104141:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2454cb100 x1872758560965888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002527.104150:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cb100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560965888:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002527.104171:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.104183:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.104192:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560965888 00000100:00100000:2.0:1786002527.104195:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560965888 00000100:00100000:2.0:1786002527.104209:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:2.0:1786002527.104214:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560965888:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002527.104286:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7805:x1872758560965888:12345-0@lo:1000:osp_up1-0.0 Request processed in 71us (113us total) trans 4294968563 rc 0/0 00000100:00100000:2.0:1786002527.104292:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00000100:00100000:2.0:1786002527.104377:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cb100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560965888:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1786002527.104384:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 779 rpc_version 779 00000020:00100000:2.0:1786002527.104394:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1786002527.104398:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed366d6f100 x1872758560966144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786002527.104408:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560966144:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002527.104432:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.104445:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.104455:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560966144 00000100:00100000:2.0:1786002527.104458:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560966144 00000100:00100000:2.0:1786002527.104477:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:2.0:1786002527.104485:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:7805:x1872758560966144:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002527.104557:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:7805:x1872758560966144:12345-0@lo:1000:osp_up1-0.0 Request processed in 73us (124us total) trans 4294968564 rc 0/0 00000100:00100000:2.0:1786002527.104562:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00100000:2.0:1786002527.104586:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560966144:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002527.106021:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560965376:12345-0@lo:403:mdt_io00_002.0 Request processed in 2228us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.106030:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00000100:00100000:2.0:1786002527.107775:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560965376:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1786002527.108615:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560966272:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.108672:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.108699:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.109044:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560966272 00000100:00100000:0.0:1786002527.109052:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560966272 00000100:00100000:0.0:1786002527.109104:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:0.0:1786002527.109113:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560966272:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.109194:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560966272:12345-0@lo:1000:mdt_io00_002.0 Request processed in 81us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.109201:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00100000:2.0:1786002527.109447:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560966272:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.109488:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd5180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560966400:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.109511:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.109537:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.110966:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560966400 00000100:00100000:1.0:1786002527.110976:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560966400 00000100:00100000:1.0:1786002527.111033:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:1.0:1786002527.111043:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560966400:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.111149:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560966400:12345-0@lo:1000:mdt_io00_002.0 Request processed in 106us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.111156:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00100000:2.0:1786002527.111405:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd5180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560966400:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.114419:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560966528:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1786002527.114486:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.114523:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.114592:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560966528 00000100:00100000:1.0:1786002527.114599:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560966528 00000100:00100000:1.0:1786002527.114973:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:1.0:1786002527.114984:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560966528:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1786002527.116619:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560966528:12345-0@lo:403:mdt_io00_002.0 Request processed in 1632us (2127us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.116628:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00100000:3.0:1786002527.116740:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560966528:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1786002527.117401:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560966656:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.117434:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.135572:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.140023:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560966656 00000100:00100000:0.0:1786002527.140036:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560966656 00000100:00100000:0.0:1786002527.140113:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:0.0:1786002527.140124:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560966656:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.140250:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560966656:12345-0@lo:1000:mdt_io00_002.0 Request processed in 128us (22814us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.140259:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:3.0:1786002527.142431:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560966656:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.142505:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560966784:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.142545:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.142576:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.142655:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560966784 00000100:00100000:0.0:1786002527.142661:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560966784 00000100:00100000:0.0:1786002527.142695:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:0.0:1786002527.142702:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560966784:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.142790:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560966784:12345-0@lo:1000:mdt_io00_002.0 Request processed in 87us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.142797:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:3.0:1786002527.147087:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560966784:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.147159:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560966912:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.147212:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.147245:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.147354:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560966912 00000100:00100000:0.0:1786002527.147359:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560966912 00000100:00100000:0.0:1786002527.147398:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:0.0:1786002527.147406:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560966912:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.147489:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560966912:12345-0@lo:1000:mdt_io00_002.0 Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.147496:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00100000:3.0:1786002527.147599:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560966912:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.147627:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560967040:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.147657:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.147677:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.147912:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560967040 00000100:00100000:0.0:1786002527.147916:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560967040 00000100:00100000:0.0:1786002527.147949:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:0.0:1786002527.147956:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560967040:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.148012:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560967040:12345-0@lo:1000:mdt_io00_002.0 Request processed in 56us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.148018:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:3.0:1786002527.148084:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560967040:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.148113:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560967168:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.148136:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.148156:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.148213:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560967168 00000100:00100000:1.0:1786002527.148218:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560967168 00000100:00100000:1.0:1786002527.148250:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:1.0:1786002527.148257:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560967168:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.148306:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560967168:12345-0@lo:1000:mdt_io00_002.0 Request processed in 50us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.148313:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000100:00100000:3.0:1786002527.148377:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560967168:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.148962:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560967296:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1786002527.148993:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.149005:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.149095:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560967296 00000100:00100000:1.0:1786002527.149100:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560967296 00000100:00100000:1.0:1786002527.149130:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:1.0:1786002527.149138:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560967296:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1786002527.150679:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560967296:12345-0@lo:403:mdt_io00_002.0 Request processed in 1538us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.150688:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:3.0:1786002527.150991:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560967296:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1786002527.151559:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560967424:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.151589:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.151605:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.151678:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560967424 00000100:00100000:0.0:1786002527.151683:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560967424 00000100:00100000:0.0:1786002527.151715:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:0.0:1786002527.151731:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560967424:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.151784:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560967424:12345-0@lo:1000:mdt_io00_002.0 Request processed in 62us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.151790:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00010000:00010000:2.0:1786002527.152180:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002527.152275:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560967424:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.152335:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560967552:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.152358:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.152415:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.157059:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560967552 00000100:00100000:0.0:1786002527.157071:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560967552 00000100:00100000:0.0:1786002527.157130:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:0.0:1786002527.157140:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560967552:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.157253:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560967552:12345-0@lo:1000:mdt_io00_002.0 Request processed in 115us (4893us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.157260:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00000100:00100000:3.0:1786002527.159555:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560967552:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.159631:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560967680:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.159696:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.159760:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a840 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.159925:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560967680 00000100:00100000:0.0:1786002527.159932:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560967680 00000100:00100000:0.0:1786002527.159978:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:0.0:1786002527.159986:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560967680:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.160056:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:6535:x1872758560967680:12345-0@lo:1000:mdt_io00_002.0 Request processed in 71us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.160064:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00100000:3.0:1786002527.161208:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560967680:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1786002527.162011:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].415, 2464 off622168 00000040:00080000:3.0:1786002527.162065:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].415, 2544 off671496 00000004:00080000:3.0:1786002527.162071:0:6535:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245c66a80 with version 793 00000004:00080000:0.0:1786002527.163639:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 793 rpc_version 793 00000020:00100000:0.0:1786002527.163689:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002527.163697:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed37bc52680 x1872758560967936/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002527.163731:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560967936:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002527.163805:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.163874:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d463c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.163941:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560967936 00000100:00100000:2.0:1786002527.163947:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560967936 00000100:00100000:2.0:1786002527.163996:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:2.0:1786002527.164005:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:7466:x1872758560967936:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002527.164507:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+15:7466:x1872758560967936:12345-0@lo:1000:osp_up0-1.0 Request processed in 501us (700us total) trans 4294983589 rc 0/0 00000100:00100000:2.0:1786002527.164515:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00100000:3.0:1786002527.164813:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560967936:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1786002527.164908:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414cc7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.164924:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.164936:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.164955:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.164963:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.164970:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.164996:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.165003:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.165012:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.165025:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc53480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560968064:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1786002527.165052:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.165077:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46180 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.165154:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560968064 00000100:00100000:2.0:1786002527.165159:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560968064 00000100:00100000:2.0:1786002527.165185:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:2.0:1786002527.165192:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:6535:x1872758560968064:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1786002527.165204:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002527.165219:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414cdc lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414cd5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165236:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414cdc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414cd5 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165248:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414cdc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414cd5 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165256:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed366e57100) 00010000:00010000:2.0:1786002527.165260:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.165263:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b000, rc 0) 00000100:00100000:2.0:1786002527.165294:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:6535:x1872758560968064:12345-0@lo:101:mdt_io00_002.0 Request processed in 102us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.165299:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:2.0:1786002527.165324:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc53480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6535:1872758560968064:0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1786002527.165335:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414cdc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165345:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414cdc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002527.165367:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7dae3ff reply state 00000000d746eef4 transno 4294968565 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165377:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165383:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456ef100) 00010000:00010000:2.0:1786002527.165386:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002527.165388:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002527.165393:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414cdc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165400:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414cdc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002527.165409:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00000004:00010000:2.0:1786002527.165419:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7dae3ff reply state 00000000d746eef4 transno 4294968565 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165425:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414cc7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165431:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed2456ef800) 00010000:00010000:2.0:1786002527.165433:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002527.165435:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1786002527.165442:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x153f:0x0] 00010000:00010000:2.0:1786002527.165448:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af578414cb9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414cc0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165455:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af578414cb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414cc0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002527.165462:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1786002527.165469:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414ca4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165476:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414ca4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165483:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414ca4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165496:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002527.165499:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1786002527.165503:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165510:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002527.165519:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1786002527.165523:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414c96 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165529:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414c96 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165535:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414c96 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165551:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1786002527.165574:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002527.165579:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414ca4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165587:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8de00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002527.165592:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414ca4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002527.165600:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414ca4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165620:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414ca4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.165625:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002527.165643:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414ca4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.165742:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002527.165748:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414c96 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.165754:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002527.165758:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414c96 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002527.165765:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414c96 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.165784:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414c96 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.165790:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002527.165804:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414c96 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.165810:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8d400/0x7cee4af578414c8f lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414c96 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.165824:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002527.165826:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002527.165827:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002527.165838:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560968320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002527.165887:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.165922:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560968320 00000100:00100000:3.0:1786002527.165926:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560968320 00000100:00100000:3.0:1786002527.165956:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1786002527.165963:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+16:3644:x1872758560968320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002527.165971:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002527.165985:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578414c96 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414c8f expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.165996:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed245e35100) 00010000:00010000:3.0:1786002527.166001:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002527.166025:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+15:3644:x1872758560968320:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.166031:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1786002527.166056:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560968320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002527.166343:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786002527.166353:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560968192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002527.166381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786002527.166470:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8de00/0x7cee4af578414c9d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414ca4 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.166481:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002527.166483:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002527.166484:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002527.166557:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:18423:x1872758530903040:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 105471us (105746us total) trans 4294968565 rc 0/0 00000100:00100000:2.0:1786002527.166567:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:3.0:1786002527.166608:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560968192 00000100:00100000:3.0:1786002527.166612:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560968192 00000100:00100000:3.0:1786002527.166640:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:3.0:1786002527.166657:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+15:3646:x1872758560968192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002527.166664:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002527.166674:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578414ca4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414c9d expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.166690:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002527.166693:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002527.166734:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+14:3646:x1872758560968192:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.166739:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:2.0:1786002527.166819:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560968192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002527.176957:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.177109:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530903168 00000100:00100000:2.0:1786002527.177117:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530903168 00000100:00100000:2.0:1786002527.177172:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23893 00000100:00100000:2.0:1786002527.177182:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18423:x1872758530903168:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002527.177204:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002527.177222:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414ce3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3abcb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.177276:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414cea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.177293:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414cea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.177320:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414cea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002527.177368:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:2.0:1786002527.177374:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786002527.177390:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414cea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.177410:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414ce3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abcb expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.177433:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414cea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abcb expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.177443:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002527.177446:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786002527.177449:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b200, rc 0) 00000100:00100000:2.0:1786002527.177502:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18423:x1872758530903168:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 321us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.177508:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23893 00000100:00100000:2.0:1786002527.183958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.184058:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530903424 00000100:00100000:1.0:1786002527.184067:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530903424 00000100:00100000:1.0:1786002527.184120:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23894 00000100:00100000:1.0:1786002527.184130:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18423:x1872758530903424:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002527.184148:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.184168:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414cf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3abd2 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.184235:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414cf8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.184248:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.184259:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.184269:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.184293:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578414cb2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414cab expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.184300:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.184327:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578414cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578414cab expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.184359:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d30380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560968448:0@lo:104: 00000100:00100000:1.0:1786002527.184403:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.184451:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545900 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.184789:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786002527.184801:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560968448 00000100:00100000:0.0:1786002527.184804:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560968448 00000100:00100000:0.0:1786002527.184836:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:0.0:1786002527.184844:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc4d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:14496:x1872758560968448:12345-0@lo:104: 00010000:00010000:0.0:1786002527.184889:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.184943:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786002527.184948:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc4d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:14496:x1872758560968448:12345-0@lo:104: Request processed in 107us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.184955:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1786002527.185087:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d30380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560968448:0@lo:104: 00010000:00010000:3.0:1786002527.185091:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002527.185100:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.185104:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.185116:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002527.185123:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002527.185132:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.185156:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.185161:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002527.185202:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.185209:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8c400/0x7cee4af578414cab lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414cb2 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.185224:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002527.185226:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002527.185227:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002527.186296:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002527.186313:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560968576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002527.186351:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.186431:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560968576 00000100:00100000:3.0:1786002527.186437:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560968576 00010000:00010000:3.0:1786002527.186459:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578414cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578414cab expref: 14 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.186496:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:3.0:1786002527.186504:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+14:3644:x1872758560968576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002527.186514:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1786002527.193443:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983589 is committed 00010000:00010000:3.0:1786002527.196116:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af578414cb2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578414cab expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.196140:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9ed245e35000) 00010000:00010000:3.0:1786002527.196146:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.196156:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.196163:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.196201:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002527.196236:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.196247:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.196294:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3644:x1872758560968576:12345-0@lo:103:ldlm_bl.0 Request processed in 9788us (9939us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.196305:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00100000:1.0:1786002527.196370:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d30700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560968704:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1786002527.196407:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.196439:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.196512:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560968576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002527.196597:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560968704 00000100:00100000:3.0:1786002527.196603:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560968704 00000100:00100000:3.0:1786002527.196640:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:3.0:1786002527.196655:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:14496:x1872758560968704:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002527.196736:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+12:14496:x1872758560968704:12345-0@lo:1000:mdt00_004.0 Request processed in 87us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.196742:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00100000:1.0:1786002527.196881:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d30700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14496:1872758560968704:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1786002527.196921:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578414d06 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.196932:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578414d06 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.196940:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578414d06 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.196954:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414cf8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.196960:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414cf8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.196965:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.196971:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.196977:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002527.196980:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.196987:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414cf8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.196996:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002527.196998:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.197002:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414cf8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.197007:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414cf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.197017:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.197023:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.197030:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.197035:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002527.197038:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.197043:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.197050:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9ed245e35000) 00010000:00010000:1.0:1786002527.197052:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.197055:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.197070:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414cff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.197109:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414cf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abd2 expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.197124:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578414d06 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abd2 expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.197131:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed245e35200) 00010000:00010000:1.0:1786002527.197133:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002527.197135:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c400, rc 0) 00000100:00100000:1.0:1786002527.197222:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18423:x1872758530903424:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 13093us (13273us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.197233:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23894 00000100:00100000:3.0:1786002527.203025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.203128:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530903680 00000100:00100000:0.0:1786002527.203137:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530903680 00000100:00100000:0.0:1786002527.203194:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23895 00000100:00100000:0.0:1786002527.203205:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:18423:x1872758530903680:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1786002527.203228:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002527.203246:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578414d0d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3abd9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002527.203388:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19a:0x0]: returning size 4096 00010000:00010000:0.0:1786002527.203468:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578414d0d lrc: 1/0,0 mode: --/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abd9 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.203487:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed2456ef800) 00010000:00010000:0.0:1786002527.203490:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002527.203495:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578414d0d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abd9 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.203506:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:0.0:1786002527.203566:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18423:x1872758530903680:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 362us (548us total) trans 4294968566 rc 301/301 00000100:00100000:0.0:1786002527.203573:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23895 00000100:00100000:1.0:1786002527.207943:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.208062:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530903808 00000100:00100000:2.0:1786002527.208070:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530903808 00000100:00100000:2.0:1786002527.208124:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23896 00000100:00100000:2.0:1786002527.208134:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18423:x1872758530903808:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002527.208157:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002527.208176:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af578414d1b lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3abe0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.208248:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578414d22 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.208261:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578414d22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.208272:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578414d22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002527.208315:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xd3:0x0]: returning size 4096 00000004:00200000:2.0:1786002527.208320:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:2.0:1786002527.208352:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af578414d1b lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abe0 expref: 28 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.208376:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578414d22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abe0 expref: 27 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.208387:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456ef100) 00010000:00010000:2.0:1786002527.208390:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002527.208393:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2be00, rc 0) 00000100:00100000:2.0:1786002527.208440:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:18423:x1872758530903808:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 308us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.208446:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23896 00000100:00100000:3.0:1786002527.222353:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.222435:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530903936 00000100:00100000:1.0:1786002527.222443:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530903936 00000100:00100000:1.0:1786002527.222498:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23897 00000100:00100000:1.0:1786002527.222509:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18423:x1872758530903936:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002527.222529:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.222548:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414d29 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3abe7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.222599:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414d30 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.222613:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414cdc lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414cd5 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.222621:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414d30 lrc: 4/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.222665:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414cdc lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578414cd5 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.222681:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560968832:0@lo:104: 00000100:00100000:1.0:1786002527.222735:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.222776:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545900 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.222875:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560968832 00000100:00100000:2.0:1786002527.222880:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560968832 00000100:00100000:2.0:1786002527.222909:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:2.0:1786002527.222917:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:14496:x1872758560968832:12345-0@lo:104: 00010000:00010000:2.0:1786002527.222929:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414cdc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.222985:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786002527.222990:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:14496:x1872758560968832:12345-0@lo:104: Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.222997:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00010000:00010000:3.0:1786002527.223066:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002527.223073:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414cdc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.223080:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002527.223085:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578414cdc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002527.223093:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578414cdc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.223114:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414cdc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.223120:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002527.223146:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414cdc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.223154:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35600/0x7cee4af578414cd5 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414cdc expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.223171:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002527.223173:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002527.223175:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002527.223182:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786002527.223192:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560968960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002527.223220:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.223248:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560968960 00000100:00100000:3.0:1786002527.223252:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560968960 00010000:00010000:3.0:1786002527.223267:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414cdc lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578414cd5 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.223289:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671 00000100:00100000:3.0:1786002527.223295:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3647:x1872758560968960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002527.223305:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786002527.223382:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14496:1872758560968832:0@lo:104: 00010000:00010000:3.0:1786002527.223398:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414d30 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.229060:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414cdc lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578414cd5 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.229079:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed366e57100) 00010000:00010000:3.0:1786002527.229086:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414d30 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.229094:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414d30 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.229100:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414d30 lrc: 4/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.229131:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002527.229204:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3647:x1872758560968960:12345-0@lo:103:ldlm_bl.0 Request processed in 5907us (5981us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.229213:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671 00010000:00010000:1.0:1786002527.229283:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414d30 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.229295:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414d30 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002527.229341:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd6:0x0]: returning size 4096 00000004:00200000:1.0:1786002527.229346:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:1.0:1786002527.229385:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414d29 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abe7 expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.229399:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414d30 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abe7 expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.229407:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed366e57100) 00010000:00010000:1.0:1786002527.229409:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002527.229412:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8dc00, rc 0) 00000100:00100000:1.0:1786002527.229462:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18423:x1872758530903936:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 6955us (7117us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.229468:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23897 00000100:00100000:2.0:1786002527.229663:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560968960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002527.234354:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.234434:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530904064 00000100:00100000:2.0:1786002527.234443:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530904064 00000100:00100000:2.0:1786002527.234498:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23898 00000100:00100000:2.0:1786002527.234509:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:18423:x1872758530904064:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002527.234528:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002527.234550:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af578414d37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3abee expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.234609:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af578414d3e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.234633:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af578414d3e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.234681:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af578414d3e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002527.234779:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19a:0x0]: returning size 4096 00000004:00200000:2.0:1786002527.234791:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:2.0:1786002527.234810:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af578414d3e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.234833:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b600/0x7cee4af578414d37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abee expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.234888:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af578414d3e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abee expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.234903:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed2456ef800) 00010000:00010000:2.0:1786002527.234906:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002527.234911:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b400, rc 0) 00000100:00100000:2.0:1786002527.234962:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18423:x1872758530904064:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 455us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.234969:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23898 00000100:00100000:3.0:1786002527.250090:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.250189:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530904192 00000100:00100000:2.0:1786002527.250199:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530904192 00000100:00100000:2.0:1786002527.250257:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5102 00000100:00100000:2.0:1786002527.250268:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18423:x1872758530904192:12345-192.168.203.49@tcp:37:lfs.0 00000100:00100000:2.0:1786002527.254391:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18423:x1872758530904192:12345-192.168.203.49@tcp:37:lfs.0 Request processed in 4117us (4303us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.254404:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5102 00000100:00100000:0.0:1786002527.262410:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.262500:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530904320 00000100:00100000:1.0:1786002527.262510:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530904320 00000100:00100000:1.0:1786002527.262561:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5103 00000100:00100000:1.0:1786002527.262570:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18423:x1872758530904320:12345-192.168.203.49@tcp:37:lfs.0 00000100:00100000:1.0:1786002527.267512:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18423:x1872758530904320:12345-192.168.203.49@tcp:37:lfs.0 Request processed in 4935us (5105us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.267524:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5103 00000100:00100000:2.0:1786002527.286407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.286485:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530904448 00000100:00100000:0.0:1786002527.286495:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530904448 00000100:00100000:0.0:1786002527.286555:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23899 00000100:00100000:0.0:1786002527.286565:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18423:x1872758530904448:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:0.0:1786002527.286637:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d45 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286664:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d45 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286677:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d45 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286691:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414d4c lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286698:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414d4c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286706:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414d4c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286760:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414d53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286773:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414d53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286779:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414d53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002527.286823:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414d53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286880:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d45 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286901:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d45 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286907:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d45 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286914:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d45 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286921:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002527.286925:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d45 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286932:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d45 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286944:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed366e57100) 00010000:00010000:0.0:1786002527.286947:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.286952:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d45 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286958:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d45 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286971:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414d4c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286977:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414d4c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286984:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414d4c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286989:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002527.286992:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414d4c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.286999:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414d4c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.287006:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x84832a57 (ffff9ed2456ef500) 00010000:00010000:0.0:1786002527.287009:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.287012:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414d4c lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.287018:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414d4c lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.287036:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414d53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.287042:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414d53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.287047:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414d53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.287052:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002527.287055:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414d53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.287061:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414d53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.287212:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:0.0:1786002527.287215:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.287218:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414d53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.287224:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578414d53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.287297:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18423:x1872758530904448:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 733us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.287305:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23899 00000100:00100000:0.0:1786002527.292892:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.293017:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530904704 00000100:00100000:1.0:1786002527.293025:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530904704 00000100:00100000:1.0:1786002527.293092:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23900 00000100:00100000:1.0:1786002527.293102:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18423:x1872758530904704:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002527.293121:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.293141:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414d5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3abf5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.293248:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414d61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.293264:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414d61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.293275:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414d61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002527.293286:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1545:0x0]: returning size 3 00010000:00010000:1.0:1786002527.293397:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414d5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1545:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abf5 expref: 20 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.293413:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414d61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abf5 expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.293423:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:1.0:1786002527.293426:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786002527.293430:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c000, rc 0) 00000100:00100000:1.0:1786002527.293486:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18423:x1872758530904704:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 385us (642us total) trans 4294983590 rc 0/0 00000100:00100000:1.0:1786002527.293492:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23900 00000100:00100000:2.0:1786002527.297701:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.298312:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530904832 00000100:00100000:1.0:1786002527.298323:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530904832 00000100:00100000:1.0:1786002527.298380:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5213 00000100:00100000:1.0:1786002527.298390:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758530904832:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:1.0:1786002527.298432:0:14678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.298452:0:14678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.298460:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002527.298464:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786002527.298468:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.298502:0:14678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.298515:0:14678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 19 pid: 8436 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.298529:0:14678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14678:1872758560969088:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002527.298595:0:14678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.319734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.319754:0:14678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14678:1872758560969088:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002527.319781:0:14678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.319901:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530904960 00000100:00100000:2.0:1786002527.319908:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530904960 00002000:00100000:2.0:1786002527.319964:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cd:0x0] (0->2) req@ffff9ed37bad0700 x1872758530904960/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:208/0 lens 496/0 e 0 to 0 dl 1786002538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002527.319975:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37bad0700 with x1872758530904960 ext(0->2) 00010000:00010000:2.0:1786002527.319981:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 20 pid: 8436 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.319995:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 20 pid: 8436 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002527.320002:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed37bad0700 00000100:00100000:2.0:1786002527.320025:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 6 00000100:00100000:2.0:1786002527.320035:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758530904960:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:2.0:1786002527.321470:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:2413:x1872758530904960:12345-192.168.203.49@tcp:4:bash.0 Request processed in 1432us (1747us total) trans 4294969888 rc 0/0 00000100:00100000:2.0:1786002527.321479:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 6 00002000:00100000:2.0:1786002527.321487:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cd:0x0] (0->2) req@ffff9ed37bad0700 x1872758530904960/t4294969888(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:208/0 lens 496/448 e 0 to 0 dl 1786002538 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002527.321496:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37bad0700 with x1872758530904960 ext(0->2) 00010000:00010000:2.0:1786002527.321503:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 22 pid: 8436 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.321517:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 22 pid: 8436 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002527.321525:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ed37bad0700 00000100:00100000:0.0:1786002527.337206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.339342:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530905088 00000100:00100000:1.0:1786002527.339353:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530905088 00010000:00010000:1.0:1786002527.339394:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 22 pid: 8436 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.339442:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1672 00000100:00100000:1.0:1786002527.339452:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:2411:x1872758530905088:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002527.339466:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786002527.339482:0:10399:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb size from disk: 0 -> 3 00002000:00010000:1.0:1786002527.339485:0:10399:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb mtime from disk: 0 -> 1786002526 00002000:00010000:1.0:1786002527.339487:0:10399:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb ctime from disk: 0 -> 1786002526 00002000:00010000:1.0:1786002527.339489:0:10399:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9cd:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1786002527.339496:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 22 pid: 8436 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.339511:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 22 pid: 8436 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.339534:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1e5a3a5/0x7cee4af578414c65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abb6 expref: 22 pid: 8436 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.339551:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786002527.339556:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786002527.339562:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.339577:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.339613:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002527.339671:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2411:x1872758530905088:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 219us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.339679:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1672 00010000:00010000:2.0:1786002527.340364:0:14678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.340376:0:14678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.340394:0:14678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.340436:0:14678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.340444:0:14678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.340451:0:14678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002527.340456:0:14678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.340466:0:14678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.340479:0:14678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.340492:0:14678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce8c6497/0x7cee4af578414d6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.340548:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758530904832:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 42159us (42856us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.340557:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5213 00000100:00100000:0.0:1786002527.348069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.348125:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.348158:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.348393:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.348425:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530905728 00000100:00100000:0.0:1786002527.348434:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530905728 00000100:00100000:0.0:1786002527.348481:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:0.0:1786002527.348491:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18423:x1872758530905728:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:0.0:1786002527.348536:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002527.348562:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414c57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1545:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abaf expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.348585:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:0.0:1786002527.348589:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002527.348612:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d76 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.348624:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d76 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.348634:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d76 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002527.348663:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x19a:0x0] 00000100:00100000:0.0:1786002527.348713:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560969216:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002527.348768:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.348791:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46900 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.348811:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560969216 00000100:00100000:0.0:1786002527.348815:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560969216 00000100:00100000:0.0:1786002527.348841:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:0.0:1786002527.348878:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:6533:x1872758560969216:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002527.348970:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:6533:x1872758560969216:12345-0@lo:1000:mdt_io00_000.0 Request processed in 122us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.348978:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00000100:00100000:0.0:1786002527.349014:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560969216:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002527.349648:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560969344:0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1786002527.349679:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.349697:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46600 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.349709:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560969344 00000100:00100000:0.0:1786002527.349713:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560969344 00000100:00100000:0.0:1786002527.349746:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00100000:0.0:1786002527.349752:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:6533:x1872758560969344:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1786002527.352071:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530905216 00000100:00100000:2.0:1786002527.352081:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530905216 00000100:00100000:2.0:1786002527.353018:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530905344 00000100:00100000:2.0:1786002527.353024:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530905344 00000100:00100000:2.0:1786002527.353043:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530905472 00000100:00100000:2.0:1786002527.353046:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530905472 00000100:00100000:2.0:1786002527.353066:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1489 00000100:00100000:2.0:1786002527.353076:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2412:x1872758530905216:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:2.0:1786002527.353088:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002527.353789:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af578414d3e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abee expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.353811:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed2456ef800) 00010000:00010000:2.0:1786002527.353816:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002527.353974:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1490 00000100:00100000:1.0:1786002527.353985:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af75850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758530905344:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:1.0:1786002527.353995:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002527.354007:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414d30 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abe7 expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.354024:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed366e57100) 00010000:00010000:1.0:1786002527.354031:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002527.354337:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:2412:x1872758530905216:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 1261us (6275us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.354344:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1489 00000100:00100000:2.0:1786002527.354361:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1491 00000100:00100000:2.0:1786002527.354367:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:2412:x1872758530905472:12345-192.168.203.49@tcp:103:lfs.0 00010000:00010000:2.0:1786002527.354374:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002527.354385:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578414d22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abe0 expref: 27 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.354394:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456ef100) 00010000:00010000:2.0:1786002527.354397:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002527.354423:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:2412:x1872758530905472:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 56us (6265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.354428:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1491 00000100:00100000:3.0:1786002527.358079:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560969344:0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1786002527.358813:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560969472:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.361790:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.361825:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.361864:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560969472 00000100:00100000:3.0:1786002527.361870:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560969472 00000100:00100000:3.0:1786002527.361911:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:3.0:1786002527.362082:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560969472:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.362343:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af75850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2412:x1872758530905344:12345-192.168.203.49@tcp:103:lfs.0 Request processed in 8357us (14224us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.362352:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1490 00000100:00100000:3.0:1786002527.362664:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560969472:12345-0@lo:1000:mdt_io00_000.0 Request processed in 745us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.362671:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:0.0:1786002527.364064:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:6533:x1872758560969344:12345-0@lo:403:mdt_io00_000.0 Request processed in 14306us (14378us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.364074:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00000100:00100000:2.0:1786002527.365279:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560969472:0@lo:1000:mdt_io00_000.0 00010000:00010000:2.0:1786002527.365357:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.365367:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.365376:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.365393:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560969600:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1786002527.365758:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.365819:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.370916:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560969600 00000100:00100000:1.0:1786002527.370985:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560969600 00000100:00100000:0.0:1786002527.371138:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:0.0:1786002527.371149:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:6533:x1872758560969600:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002527.371169:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002527.372709:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af578414d84 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414d7d expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.372751:0:15596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 2/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.372769:0:15596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af578414d84 lrc: 4/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414d7d expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.372792:0:15596:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1786002527.372823:0:15596:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:0.0:1786002527.372876:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af578414d84 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414d7d expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.372893:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456ef100) 00010000:00010000:0.0:1786002527.372896:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.372900:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af578414d84 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414d7d expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.372906:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34800, rc 0) 00000100:00100000:0.0:1786002527.372993:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560969600:12345-0@lo:101:mdt_io00_000.0 Request processed in 1846us (7235us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.373000:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00100000:3.0:1786002527.373141:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560969600:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1786002527.374093:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 4/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.374104:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 4/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378079:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578414971 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378095:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578414971 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378103:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578414971 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378109:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.378123:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578414971 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378138:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414cc7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378153:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578414971 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378156:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414cc7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378182:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x18618557 (ffff9ed24556e000) 00010000:00010000:2.0:1786002527.378186:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.378191:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578414971 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378198:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578414971 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378223:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414cc7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378229:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784149a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378231:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002527.378237:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414cc7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378240:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784149a9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378247:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784149a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378254:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002527.378259:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414cc7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378260:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784149a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378273:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed2456ef800) 00010000:00010000:3.0:1786002527.378275:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002527.378279:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414cc7 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378285:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578414cc7 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378301:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378306:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378313:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378318:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002527.378321:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378327:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378338:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456ef100) 00010000:00010000:3.0:1786002527.378340:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002527.378347:0:3631:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af578414d84 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414d7d expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378360:0:3631:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af578414d84 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578414d7d expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378369:0:3631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af578414d84 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578414d7d expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.378405:0:3631:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af578414d84 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414d7d expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378412:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784149a9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378423:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xbc0ca3a9 (ffff9ed3465ad600) 00000100:00100000:3.0:1786002527.378433:0:3631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3631:1872758560969728:0@lo:105: 00010000:00010000:2.0:1786002527.378442:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.378445:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784149a9 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378450:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784149a9 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378465:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af5784149e1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378471:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af5784149e1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378478:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af5784149e1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378484:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2bc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.378488:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af5784149e1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378493:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af5784149e1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.378497:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786002527.378511:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x84832a57 (ffff9ed366e57600) 00010000:00010000:2.0:1786002527.378514:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.378517:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af5784149e1 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378524:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af5784149e1 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378544:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4600/0x7cee4af578414a19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.378547:0:3631:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f000 going to sleep for 11 seconds 00010000:00010000:2.0:1786002527.378555:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4600/0x7cee4af578414a19 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378561:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4600/0x7cee4af578414a19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378567:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.378570:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4600/0x7cee4af578414a19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378576:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4600/0x7cee4af578414a19 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378583:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xdcc87686 (ffff9ed24556ec00) 00010000:00010000:2.0:1786002527.378586:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.378589:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4600/0x7cee4af578414a19 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378594:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4600/0x7cee4af578414a19 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378609:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a51 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378614:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a51 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378620:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a51 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378624:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.378627:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a51 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378632:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a51 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378639:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0xb62e0cbf (ffff9ed24556ea00) 00010000:00010000:2.0:1786002527.378642:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.378644:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a51 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378662:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4000/0x7cee4af578414a51 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378676:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414a89 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378682:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414a89 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378687:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414a89 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378693:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.378695:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414a89 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378701:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414a89 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378707:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd2:0x0].0x391d5834 (ffff9ed366e57800) 00010000:00010000:2.0:1786002527.378709:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.378712:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414a89 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.378717:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ba00/0x7cee4af578414a89 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.378807:0:7451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af578414cb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414cc0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002527.378820:0:7451:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af578414cb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414cc0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.378883:0:7451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af578414cb9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414cc0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.378890:0:7451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002527.378909:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af578414cb9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414cc0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.378932:0:7451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a200/0x7cee4af578414aac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414ab3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002527.378939:0:7451:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a200/0x7cee4af578414aac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414ab3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.378955:0:7451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a200/0x7cee4af578414aac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414ab3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.378961:0:7451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002527.378976:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a200/0x7cee4af578414aac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414ab3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002527.378988:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968566 is committed 00000001:00080000:1.0:1786002527.378999:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968564 is committed 00000020:00080000:1.0:1786002527.379012:0:7451:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed347d3de40 refcount 2 committed 0 result 0 batchid 417 00000020:00080000:1.0:1786002527.379016:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455e6000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed347d3dc00 00000020:00080000:1.0:1786002527.379019:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].414 00000020:00080000:1.0:1786002527.379022:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455e6900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245657200 00000020:00080000:1.0:1786002527.379025:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].414 00000004:00080000:1.0:1786002527.379037:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 4 committed 00000004:00080000:1.0:1786002527.379046:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 4 committed 00000100:00100000:1.0:1786002527.379068:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560969984:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1786002527.379100:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.379313:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786002527.379314:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786002527.379323:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560970112:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786002527.379329:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560969856:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1786002527.379361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.379371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1786002527.379390:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 417 committed batchid 416 00000100:00100000:3.0:1786002527.379417:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560969984 00000020:00080000:1.0:1786002527.379496:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 416 00000100:00100000:0.0:1786002527.379575:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560969728 00000100:00100000:0.0:1786002527.379582:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560969728 00000100:00100000:0.0:1786002527.379628:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1786002527.379638:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:3631:x1872758560969728:12345-0@lo:105: 00010000:00010000:0.0:1786002527.379650:0:17237:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 5/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.379657:0:17237:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 5/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.379664:0:17237:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 5/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.379672:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 5/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.379677:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.379684:0:17237:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 6/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.379707:0:17237:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed243d2a000) 00000100:00100000:0.0:1786002527.379760:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:3631:x1872758560969728:12345-0@lo:105: Request processed in 123us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.379766:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1786002527.379982:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560970112 00000100:00100000:2.0:1786002527.379986:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560970112 00000100:00100000:2.0:1786002527.380025:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5214 00000100:00100000:3.0:1786002527.380027:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560969984 00000100:00100000:2.0:1786002527.380036:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758560970112:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1786002527.380045:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.380057:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1786002527.380059:0:14676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2505 count 1 00010000:00010000:2.0:1786002527.380080:0:14676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.380098:0:14676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000279c0e5e/0x7cee4af5784148f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaeb expref: 19 pid: 14686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.380106:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1786002527.380110:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00000004:00080000:3.0:1786002527.380144:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:3.0:1786002527.380313:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.380322:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.380329:0:14676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.380334:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.380355:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560970368:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1786002527.380365:0:14676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000279c0e5e/0x7cee4af5784148f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaeb expref: 19 pid: 14686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.380380:0:14676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000279c0e5e/0x7cee4af5784148f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaeb expref: 19 pid: 14686 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.380389:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.380400:0:14676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14676:1872758560970496:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002527.380411:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.380515:0:14676:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2900 going to sleep for 11 seconds 00000100:00080000:2.0:1786002527.380528:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002527.380538:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002527.380547:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560970240:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1786002527.380574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.380600:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560970240 00000100:00100000:2.0:1786002527.380603:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560970240 00000100:00100000:2.0:1786002527.380632:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5215 00000100:00100000:2.0:1786002527.380639:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560970240:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1786002527.381391:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2503 count 1 00010000:00010000:2.0:1786002527.381465:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.381480:0:14685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af5784147cd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa43 expref: 17 pid: 14686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.381487:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c7:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1786002527.381491:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002527.381496:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.381517:0:14685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af5784147cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa43 expref: 17 pid: 14686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.381527:0:14685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af5784147cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa43 expref: 17 pid: 14686 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.381538:0:14685:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14685:1872758560970624:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002527.381576:0:14685:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2480 going to sleep for 11 seconds 00000100:00080000:2.0:1786002527.381591:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002527.381600:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560969856 00000100:00100000:2.0:1786002527.381604:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560969856 00000100:00100000:2.0:1786002527.381644:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:2.0:1786002527.382031:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3646:x1872758560969856:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1786002527.382043:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002527.382070:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414cc0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x153f:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414cb9 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.382086:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x153f:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:2.0:1786002527.382096:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002527.382138:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3646:x1872758560969856:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 110us (2768us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.382144:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:0.0:1786002527.388990:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560969856:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1786002527.389075:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1786002527.389084:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3644:x1872758560969984:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1786002527.389098:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002527.389128:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578414ab3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf5d6a2c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414aac expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.389150:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf5d6a2c1 (ffff9ed24556e200) 00010000:00010000:0.0:1786002527.389164:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002527.389386:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758560969984:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 302us (10284us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.389393:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1786002527.389426:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560970368 00000100:00100000:0.0:1786002527.389432:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560970368 00000100:00100000:0.0:1786002527.389455:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:0.0:1786002527.389461:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6533:x1872758560970368:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002527.389476:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002527.389494:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414da0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414d92 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.389517:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414da0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414d92 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.389530:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414da0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414d92 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.389537:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x84832a57 (ffff9ed2456efa00) 00010000:00010000:0.0:1786002527.389540:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.389542:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35800, rc 0) 00000100:00100000:0.0:1786002527.389579:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560970368:12345-0@lo:101:mdt_io00_000.0 Request processed in 118us (9194us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.389585:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00100000:3.0:1786002527.391808:0:6533:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968564 gen 2 00000004:00080000:3.0:1786002527.391817:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968550 committed transno 4294968564 00000004:00080000:3.0:1786002527.391837:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968559 committed transno 4294968564 00000100:00100000:2.0:1786002527.395714:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560969984:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1786002527.395769:0:3631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3631:1872758560969728:0@lo:105: 00010000:00010000:2.0:1786002527.395788:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.395799:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578414cce lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6535 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002527.404385:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968560 committed transno 4294968564 00000004:00080000:3.0:1786002527.404409:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968561 committed transno 4294968564 00000004:00080000:3.0:1786002527.404636:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968562 committed transno 4294968564 00000004:00080000:3.0:1786002527.404650:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968563 committed transno 4294968564 00000004:00080000:3.0:1786002527.404658:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968564 committed transno 4294968564 00000100:00100000:3.0:1786002527.404676:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560970368:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1786002527.405218:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414da0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.405234:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414da0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002527.405323:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:3.0:1786002527.405350:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414da7 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.405362:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414da7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.405370:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414da7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.405382:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414dae lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.405389:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414dae lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.405395:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414dae lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.406302:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.406571:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414d61 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abf5 expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.407316:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.407357:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414d61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abf5 expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.407373:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414d61 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abf5 expref: 17 pid: 14496 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.407387:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6533:1872758560970752:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002527.407503:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.408407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.408465:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.408487:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530905856 00000100:00100000:2.0:1786002527.408494:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530905856 00010000:00010000:2.0:1786002527.408525:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000279c0e5e/0x7cee4af5784148f3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaeb expref: 20 pid: 14686 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.408554:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530905984 00000100:00100000:2.0:1786002527.408557:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530905984 00010000:00010000:2.0:1786002527.408571:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af5784147cd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa43 expref: 18 pid: 14686 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.408596:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1673 00000100:00100000:2.0:1786002527.408604:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758530905856:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002527.408616:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002527.408621:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000279c0e5e/0x7cee4af5784148f3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaeb expref: 20 pid: 14686 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.408634:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000279c0e5e/0x7cee4af5784148f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaeb expref: 20 pid: 14686 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.408670:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002527.408677:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002527.408681:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.408689:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.408702:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002527.408741:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758530905856:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 137us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.408747:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1673 00000100:00100000:2.0:1786002527.408761:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1674 00000100:00100000:2.0:1786002527.408767:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2412:x1872758530905984:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002527.408774:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002527.408779:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af5784147cd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa43 expref: 18 pid: 14686 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.408790:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af5784147cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa43 expref: 18 pid: 14686 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.408802:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002527.408805:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002527.408809:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.408816:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.408827:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002527.408844:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2412:x1872758530905984:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 77us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.408872:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1674 00010000:00010000:0.0:1786002527.409055:0:14685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b0f245d/0x7cee4af5784147cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa43 expref: 17 pid: 14686 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.409069:0:14685:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14685:1872758560970624:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002527.409085:0:14685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.409099:0:14685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.409106:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.409125:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.409132:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.409148:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786002527.409286:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3647:x1872758560970240:12345-0@lo:6:osp-syn-1-1.0 Request processed in 28647us (28711us total) trans 4294969885 rc 0/0 00000100:00100000:0.0:1786002527.409294:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5215 00010000:00010000:0.0:1786002527.409311:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002527.409317:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.409324:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002527.409328:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.409342:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.409359:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.409377:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bc6d0e0/0x7cee4af578414d99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.409392:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002527.409393:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002527.409395:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786002527.409422:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37137df80/2, rc 0, transno 4294969885 00000100:00100000:0.0:1786002527.409432:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560970240:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1786002527.412585:0:6533:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@0000000069b1a3fa x1872758560970752) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414d61 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abf5 expref: 17 pid: 14496 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.412608:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414d61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abf5 expref: 17 pid: 14496 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.412631:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414d61 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1545:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abf5 expref: 17 pid: 14496 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.412648:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6533:1872758560970752:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002527.412669:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:3.0:1786002527.412675:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.412684:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.412691:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.412727:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.412735:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.412741:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.412885:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560970880:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.412926:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.412944:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.413203:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560970880 00000100:00100000:2.0:1786002527.413210:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560970880 00000100:00100000:2.0:1786002527.413254:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:2.0:1786002527.413264:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560970880:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002527.413380:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560970880:12345-0@lo:1000:mdt_io00_000.0 Request processed in 117us (452us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002527.413387:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00010000:00010000:1.0:1786002527.414456:0:14676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000279c0e5e/0x7cee4af5784148f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaeb expref: 19 pid: 14686 timeout: 987 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.414475:0:14676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14676:1872758560970496:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002527.414493:0:14676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.414502:0:14676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.414509:0:14676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.414519:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560970880:0@lo:1000:mdt_io00_000.0 00010000:00010000:1.0:1786002527.414520:0:14676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.414533:0:14676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.414551:0:14676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786002527.414586:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560971008:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.414618:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.414646:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.414717:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3644:x1872758560970112:12345-0@lo:6:osp-syn-0-1.0 Request processed in 34683us (35356us total) trans 4294969889 rc 0/0 00000100:00100000:1.0:1786002527.414734:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5214 00000100:00100000:0.0:1786002527.414785:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560971008 00000100:00100000:0.0:1786002527.414790:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560971008 00000100:00100000:0.0:1786002527.414825:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:0.0:1786002527.414833:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560971008:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002527.414905:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560971008:12345-0@lo:1000:mdt_io00_000.0 Request processed in 73us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.414912:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00010000:00010000:2.0:1786002527.415074:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002527.415081:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.415090:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2be00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002527.415094:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.415103:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.415137:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.415145:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fe2e49e/0x7cee4af578414d8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.415163:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002527.415165:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002527.415168:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786002527.415195:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be7b80/2, rc 0, transno 4294969889 00000100:00100000:3.0:1786002527.415213:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560970112:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786002527.415233:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560971008:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.415325:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560971136:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.415347:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.415367:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.415762:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560971136 00000100:00100000:2.0:1786002527.415767:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560971136 00000100:00100000:2.0:1786002527.415801:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:2.0:1786002527.415809:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560971136:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002527.415905:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560971136:12345-0@lo:1000:mdt_io00_000.0 Request processed in 97us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.415912:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:1.0:1786002527.415977:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560971136:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.416044:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560971264:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.416071:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.416094:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545840 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.416149:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560971264 00000100:00100000:0.0:1786002527.416154:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560971264 00000100:00100000:0.0:1786002527.416189:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1786002527.416197:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560971264:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002527.416256:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560971264:12345-0@lo:1000:mdt_io00_000.0 Request processed in 60us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.416263:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:3.0:1786002527.416507:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560971264:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.416570:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560971392:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.416659:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.417150:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.419368:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560971392 00000100:00100000:2.0:1786002527.419379:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560971392 00000100:00080000:0.0:1786002527.419499:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002527.419583:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:2.0:1786002527.419594:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6533:x1872758560971392:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002527.419731:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6533:x1872758560971392:12345-0@lo:1000:mdt_io00_000.0 Request processed in 130us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.419739:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00000100:00100000:3.0:1786002527.419833:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560971392:0@lo:1000:mdt_io00_000.0 00000040:00080000:3.0:1786002527.420213:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].408, 1264 off609544 00000040:00080000:3.0:1786002527.420261:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].408, 1344 off660736 00000100:00100000:3.0:1786002527.420295:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560971520:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.420330:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.424541:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f000 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.427756:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560971520 00000100:00100000:1.0:1786002527.427769:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560971520 00000100:00100000:1.0:1786002527.427836:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:1.0:1786002527.427859:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6533:x1872758560971520:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.428042:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560971520:12345-0@lo:1000:mdt_io00_000.0 Request processed in 196us (7711us total) trans 4294969890 rc 0/0 00000100:00100000:1.0:1786002527.428049:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00000100:00100000:3.0:1786002527.428234:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560971520:0@lo:1000:mdt_io00_000.0 00000004:00080000:3.0:1786002527.428308:0:6533:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed345545300 with version 780 00000004:00080000:1.0:1786002527.431953:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 780 rpc_version 780 00000020:00100000:1.0:1786002527.432002:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002527.432012:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244bbbb80 x1872758560971776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3344/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002527.432048:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560971776:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002527.432114:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.432152:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545900 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.432168:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560971776 00000100:00100000:3.0:1786002527.432176:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560971776 00000100:00100000:3.0:1786002527.432228:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:3.0:1786002527.432237:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b57a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560971776:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002527.432827:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b57a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560971776:12345-0@lo:1000:osp_up1-0.0 Request processed in 589us (710us total) trans 4294968567 rc 0/0 00000100:00100000:3.0:1786002527.432836:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00000100:00100000:1.0:1786002527.433055:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560971776:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1786002527.433132:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c174385 reply state 00000000ab44ec70 transno 4294983591 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433157:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433166:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:2.0:1786002527.433169:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1786002527.433173:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002527.433182:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414da7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433188:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414da7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433194:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414da7 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433201:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414da7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433208:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.433212:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414da7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433220:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414da7 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433229:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:2.0:1786002527.433232:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.433235:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414da7 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433242:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414da7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002527.433264:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c174385 reply state 00000000ab44ec70 transno 4294983591 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414dae lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433273:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414dae lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433278:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x84832a57 (ffff9ed24556ed00) 00010000:00010000:2.0:1786002527.433280:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002527.433282:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1786002527.433287:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:2.0:1786002527.433293:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433301:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433307:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433330:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002527.433335:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:2.0:1786002527.433340:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414da0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433347:0:6533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414da0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002527.433358:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x19a:0x0] 00010000:00010000:2.0:1786002527.433365:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d76 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433371:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d76 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433376:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d76 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433381:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.433384:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d76 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433389:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d76 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433396:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed2456ef500) 00010000:00010000:2.0:1786002527.433399:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.433401:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d76 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.433407:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414d76 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.433480:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18423:x1872758530905728:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 84988us (85085us total) trans 4294983591 rc 0/0 00000100:00100000:2.0:1786002527.433489:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00010000:00010000:1.0:1786002527.433551:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002527.433558:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.433566:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002527.433570:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002527.433577:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.433603:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.433609:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002527.433640:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.433659:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2a000/0x7cee4af578414d7d lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414d84 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.433673:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002527.433675:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002527.433676:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002527.433772:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560971904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002527.433806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.433932:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560971904 00000100:00100000:1.0:1786002527.433938:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560971904 00000100:00100000:1.0:1786002527.433978:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1786002527.433987:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3647:x1872758560971904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002527.433998:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002527.434016:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af578414d84 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414d7d expref: 8 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.434027:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456ef100) 00010000:00010000:1.0:1786002527.434034:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002527.434064:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1872758560971904:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.434071:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1786002527.434099:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560971904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002527.444404:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.444482:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530906112 00000100:00100000:1.0:1786002527.444491:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530906112 00000100:00100000:1.0:1786002527.444547:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23901 00000100:00100000:1.0:1786002527.444557:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18423:x1872758530906112:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:1.0:1786002527.444632:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414dbc lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444656:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414dbc lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444667:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414dbc lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444680:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dc3 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444687:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444694:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444761:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414dca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444771:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414dca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444778:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414dca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002527.444822:0:10360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414dca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444835:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414dbc lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444841:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414dbc lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444873:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414dbc lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444880:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414dbc lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444886:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002527.444890:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414dbc lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444898:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414dbc lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444909:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456c9f00) 00010000:00010000:1.0:1786002527.444912:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.444916:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414dbc lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444922:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414dbc lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444938:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444945:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dc3 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444951:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444956:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002527.444958:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444965:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dc3 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444972:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xdcc87686 (ffff9ed2456c9700) 00010000:00010000:1.0:1786002527.444974:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.444978:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dc3 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444983:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dc3 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444993:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414dca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.444999:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414dca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.445004:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414dca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.445009:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002527.445012:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414dca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.445018:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414dca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.445025:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9ed24556e800) 00010000:00010000:1.0:1786002527.445028:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.445031:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414dca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.445037:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578414dca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.445094:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18423:x1872758530906112:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 538us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.445102:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23901 00000100:00100000:0.0:1786002527.456387:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.459304:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530906368 00000100:00100000:2.0:1786002527.459318:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530906368 00000100:00100000:0.0:1786002527.462773:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23902 00000100:00100000:0.0:1786002527.462790:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18423:x1872758530906368:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1786002527.462811:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002527.462832:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414dd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3abfc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.462967:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414dd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.462982:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.462993:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414dd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002527.463004:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1540:0x0]: returning size 2 00010000:00010000:0.0:1786002527.463103:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414dd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1540:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abfc expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.463122:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abfc expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.463130:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9ed24556e800) 00010000:00010000:0.0:1786002527.463132:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786002527.463136:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34e00, rc 0) 00000100:00100000:0.0:1786002527.464868:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18423:x1872758530906368:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 2058us (8464us total) trans 4294983592 rc 0/0 00000100:00100000:0.0:1786002527.464882:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23902 00000100:00100000:0.0:1786002527.469344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.469410:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530906496 00000100:00100000:1.0:1786002527.469419:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530906496 00000100:00100000:1.0:1786002527.469474:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5216 00000100:00100000:1.0:1786002527.469485:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758530906496:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:1.0:1786002527.469528:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.469548:0:14686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 17 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.469557:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9ca:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786002527.469575:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786002527.469579:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.469611:0:14686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 17 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.469638:0:14686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 17 pid: 14665 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.469653:0:14686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14686:1872758560972032:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002527.469736:0:14686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.471591:0:14686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14686:1872758560972032:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002527.471617:0:14686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.479113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.479239:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530906624 00000100:00100000:2.0:1786002527.479249:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530906624 00002000:00100000:2.0:1786002527.479293:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->1) req@ffff9ed2423f9f80 x1872758530906624/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:208/0 lens 496/0 e 0 to 0 dl 1786002538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002527.479305:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2423f9f80 with x1872758530906624 ext(0->1) 00010000:00010000:2.0:1786002527.479313:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 18 pid: 14665 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.479330:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 18 pid: 14665 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002527.479339:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ed2423f9f80 00000100:00100000:2.0:1786002527.479369:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 7 00000100:00100000:2.0:1786002527.479378:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2411:x1872758530906624:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:2.0:1786002527.480039:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2411:x1872758530906624:12345-192.168.203.49@tcp:4:bash.0 Request processed in 659us (932us total) trans 4294969886 rc 0/0 00000100:00100000:2.0:1786002527.480049:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 7 00002000:00100000:2.0:1786002527.480056:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->1) req@ffff9ed2423f9f80 x1872758530906624/t4294969886(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:208/0 lens 496/448 e 0 to 0 dl 1786002538 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002527.480120:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2423f9f80 with x1872758530906624 ext(0->1) 00010000:00010000:2.0:1786002527.480128:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 20 pid: 14665 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.480143:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 20 pid: 14665 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002527.480157:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ed2423f9f80 00000100:00100000:1.0:1786002527.487741:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.488357:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530906752 00000100:00100000:0.0:1786002527.488367:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530906752 00010000:00010000:0.0:1786002527.488402:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 20 pid: 14665 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.488439:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1675 00000100:00100000:0.0:1786002527.488448:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758530906752:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002527.488462:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786002527.488476:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:0.0:1786002527.488479:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb mtime from disk: 0 -> 1786002526 00002000:00010000:0.0:1786002527.488481:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb ctime from disk: 0 -> 1786002526 00002000:00010000:0.0:1786002527.488483:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9ca:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1786002527.488489:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 20 pid: 14665 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.488501:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 20 pid: 14665 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.488520:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077713507/0x7cee4af578414b93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab70 expref: 20 pid: 14665 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.488534:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786002527.488538:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786002527.488544:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.488551:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.488598:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002527.488662:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758530906752:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 215us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.488668:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1675 00010000:00010000:1.0:1786002527.488760:0:14686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.488769:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.488788:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.488800:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.488808:0:14686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.488815:0:14686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002527.488819:0:14686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.488828:0:14686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.488841:0:14686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.488887:0:14686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af578414de6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.488932:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2413:x1872758530906496:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 19449us (19594us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.488941:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5216 00000100:00100000:0.0:1786002527.508223:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.508290:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530907008 00000100:00100000:2.0:1786002527.508300:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530907008 00000100:00100000:2.0:1786002527.508397:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:2.0:1786002527.508415:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18423:x1872758530907008:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:2.0:1786002527.508462:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002527.508486:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414b85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1540:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab69 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.508510:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9ed24556e800) 00010000:00010000:2.0:1786002527.508514:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002527.508538:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414ded lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.508550:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414ded lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.508559:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414ded lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002527.508577:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x19a:0x0] 00000100:00100000:2.0:1786002527.508625:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560972160:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.508744:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.508777:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2540 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.508906:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560972160 00000100:00100000:3.0:1786002527.508912:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560972160 00000100:00100000:2.0:1786002527.508977:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:2.0:1786002527.508987:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560972160:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.509072:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560972160:12345-0@lo:1000:mdt_io00_002.0 Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.509079:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00000100:00100000:3.0:1786002527.509410:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560972160:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.514239:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560972288:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1786002527.514358:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.514396:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545900 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.514996:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560972288 00000100:00100000:3.0:1786002527.515002:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560972288 00000100:00100000:3.0:1786002527.515044:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:3.0:1786002527.515052:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560972288:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1786002527.521975:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560972288:12345-0@lo:403:mdt_io00_002.0 Request processed in 6914us (7608us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.521991:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00100000:3.0:1786002527.529784:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560972288:0@lo:403:mdt_io00_002.0 00010000:00010000:2.0:1786002527.531210:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.531221:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.531233:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.531313:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560972416:0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1786002527.531365:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.531456:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.534273:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560972416 00000100:00100000:1.0:1786002527.534286:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560972416 00000100:00100000:1.0:1786002527.534366:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:1.0:1786002527.534377:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6535:x1872758560972416:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002527.534396:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.534562:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dfb lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414df4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.534592:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dfb lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414df4 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.534606:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dfb lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414df4 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.534614:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456c9700) 00010000:00010000:1.0:1786002527.534617:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.534620:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8dc00, rc 0) 00000100:00100000:1.0:1786002527.534704:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6535:x1872758560972416:12345-0@lo:101:mdt_io00_002.0 Request processed in 330us (3338us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.534711:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00100000:3.0:1786002527.534817:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560972416:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1786002527.534836:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414dfb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.534862:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414dfb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002527.534884:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:3.0:1786002527.534914:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.534922:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.534931:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.534948:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560972544:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1786002527.534979:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.535346:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3821ffcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.536930:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560972544 00000100:00100000:0.0:1786002527.536938:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560972544 00000100:00100000:0.0:1786002527.536998:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00000100:00100000:0.0:1786002527.537006:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:6535:x1872758560972544:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1786002527.537019:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002527.537036:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578414e09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414e02 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.537060:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578414e09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414e02 expref: 9 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.537071:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578414e09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414e02 expref: 9 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.537079:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xdcc87686 (ffff9ed2456efd00) 00010000:00010000:0.0:1786002527.537082:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.537086:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34c00, rc 0) 00000100:00100000:0.0:1786002527.537140:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560972544:12345-0@lo:101:mdt_io00_002.0 Request processed in 134us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.537147:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00000100:00100000:3.0:1786002527.537328:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560972544:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1786002527.537343:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414e09 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.537352:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414e09 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002527.537372:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:3.0:1786002527.537390:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e10 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.537398:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e10 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.537405:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e10 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.537413:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414e17 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.537418:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414e17 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.537424:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414e17 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.537466:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.537478:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414dd8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abfc expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.537486:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.538334:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abfc expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.538350:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414dd8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abfc expref: 19 pid: 6522 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.538363:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6535:1872758560972672:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002527.538435:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d29c0 going to sleep for 11 seconds 00010000:00010000:0.0:1786002527.540706:0:6535:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@0000000004fd4251 x1872758560972672) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414dd8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abfc expref: 19 pid: 6522 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.540738:0:6535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414dd8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abfc expref: 19 pid: 6522 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.540758:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414dd8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1540:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abfc expref: 19 pid: 6522 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.540793:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6535:1872758560972672:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002527.540808:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9ed24556e800) 00010000:00010000:0.0:1786002527.540813:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.540822:0:6535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.540828:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.540884:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.540897:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.540907:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.541025:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560972800:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.541077:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.541094:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46840 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.541204:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560972800 00000100:00100000:1.0:1786002527.541211:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560972800 00000100:00100000:1.0:1786002527.541259:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:1.0:1786002527.541267:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560972800:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.541375:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560972800:12345-0@lo:1000:mdt_io00_002.0 Request processed in 108us (297us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002527.541382:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00100000:0.0:1786002527.541580:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560972800:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.541618:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560972928:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.541642:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.541671:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46840 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.542131:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560972928 00000100:00100000:1.0:1786002527.542136:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560972928 00000100:00100000:1.0:1786002527.542169:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:1.0:1786002527.542176:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560972928:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.542242:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560972928:12345-0@lo:1000:mdt_io00_002.0 Request processed in 58us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.542248:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00000100:00100000:0.0:1786002527.542471:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560972928:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.542556:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560973056:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.542580:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.542600:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46840 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.542658:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560973056 00000100:00100000:2.0:1786002527.542663:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560973056 00000100:00100000:2.0:1786002527.542709:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:2.0:1786002527.542717:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560973056:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.542787:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560973056:12345-0@lo:1000:mdt_io00_002.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.542793:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00000100:00100000:0.0:1786002527.542917:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560973056:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.542991:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560973184:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.543015:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.543026:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d463c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.543085:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560973184 00000100:00100000:2.0:1786002527.543089:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560973184 00000100:00100000:2.0:1786002527.543138:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:2.0:1786002527.543145:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6535:x1872758560973184:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.543214:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6535:x1872758560973184:12345-0@lo:1000:mdt_io00_002.0 Request processed in 69us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.543222:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00100000:3.0:1786002527.543259:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560973184:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1786002527.543685:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].409, 1264 off610808 00000040:00080000:3.0:1786002527.543749:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].409, 1344 off662080 00000100:00100000:3.0:1786002527.543771:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560973312:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.543797:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.543819:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.544166:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560973312 00000100:00100000:1.0:1786002527.544170:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560973312 00000100:00100000:1.0:1786002527.544202:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:1.0:1786002527.544208:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:6535:x1872758560973312:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.544469:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560973312:12345-0@lo:1000:mdt_io00_002.0 Request processed in 209us (619us total) trans 4294969887 rc 0/0 00000100:00100000:1.0:1786002527.544477:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00100000:3.0:1786002527.544541:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560973312:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1786002527.544549:0:6535:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245d46600 with version 781 00000004:00080000:1.0:1786002527.544644:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 781 rpc_version 781 00000020:00100000:1.0:1786002527.544665:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002527.544671:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244bbb100 x1872758560973568/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002527.544685:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560973568:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002527.544780:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.544834:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3455456c0 going to sleep for 11 seconds 00000100:00080000:0.0:1786002527.545024:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002527.549034:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560973568 00000100:00100000:3.0:1786002527.549047:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560973568 00000100:00100000:3.0:1786002527.549147:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:3.0:1786002527.549166:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560973568:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002527.549574:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560973568:12345-0@lo:1000:osp_up1-0.0 Request processed in 417us (4793us total) trans 4294968568 rc 0/0 00000100:00100000:3.0:1786002527.549590:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00000100:00100000:0.0:1786002527.549810:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560973568:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1786002527.549919:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c69acd9b reply state 000000001bcb89bb transno 4294983593 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.549938:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.549948:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9ed24556e800) 00010000:00010000:0.0:1786002527.549951:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1786002527.549954:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002527.549962:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e10 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.549969:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e10 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.549976:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e10 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.549983:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e10 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.549989:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002527.549993:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e10 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550001:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e10 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550010:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:0.0:1786002527.550042:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.550046:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e10 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550053:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e10 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002527.550079:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c69acd9b reply state 000000001bcb89bb transno 4294983593 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414e17 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550088:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414e17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550099:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xdcc87686 (ffff9ed24556ea00) 00010000:00010000:0.0:1786002527.550101:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002527.550103:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1786002527.550107:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:0.0:1786002527.550113:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414dfb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550121:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414dfb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550129:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414dfb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550151:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786002527.550154:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:0.0:1786002527.550161:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414e09 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550169:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414e09 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002527.550181:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x19a:0x0] 00010000:00010000:0.0:1786002527.550187:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414ded lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550193:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414ded lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550200:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414ded lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550205:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002527.550208:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414ded lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550213:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414ded lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550220:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed24559f200) 00010000:00010000:0.0:1786002527.550223:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.550225:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414ded lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.550231:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578414ded lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.550301:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18423:x1872758530907008:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 41886us (42084us total) trans 4294983593 rc 0/0 00000100:00100000:0.0:1786002527.550309:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 9 00010000:00010000:3.0:1786002527.554322:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002527.554335:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414dfb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.554348:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2bc00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002527.554356:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414dfb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002527.554366:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414dfb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.554410:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414dfb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.554416:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002527.554443:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414dfb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.554451:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2bc00/0x7cee4af578414df4 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414dfb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.554471:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002527.554473:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002527.554476:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002527.554476:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002527.554499:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560973696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002527.554561:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.554656:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560973696 00000100:00100000:3.0:1786002527.554663:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560973696 00000100:00100000:3.0:1786002527.554865:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:3.0:1786002527.554876:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+10:3645:x1872758560973696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002527.554890:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002527.554908:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578414dfb lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414df4 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.554922:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456c9700) 00010000:00010000:3.0:1786002527.554931:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002527.554977:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3645:x1872758560973696:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.554984:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1786002527.555059:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560973696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002527.555674:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.555812:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530907136 00000100:00100000:2.0:1786002527.555817:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530907136 00000100:00100000:2.0:1786002527.555884:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23903 00000100:00100000:2.0:1786002527.555891:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18423:x1872758530907136:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:2.0:1786002527.555949:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414e25 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.555961:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414e25 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.555971:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414e25 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.555981:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e2c lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.555989:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e2c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556000:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e2c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556043:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414e33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556050:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556057:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002527.556099:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556110:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414e25 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556117:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414e25 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556123:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414e25 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556130:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414e25 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556135:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.556139:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414e25 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556145:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414e25 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556154:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed24559f000) 00010000:00010000:2.0:1786002527.556778:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.556785:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414e25 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556792:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414e25 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556809:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e2c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556814:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e2c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556820:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e2c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556825:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.556828:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e2c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556833:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e2c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.556842:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xb62e0cbf (ffff9ed24559f400) 00010000:00010000:2.0:1786002527.556844:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.557223:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e2c lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.557231:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e2c lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.557306:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.557312:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414e33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.557317:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414e33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.557321:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.557324:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414e33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.557328:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414e33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.557335:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff9ed366e57e00) 00010000:00010000:2.0:1786002527.557337:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.557340:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414e33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.557345:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578414e33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.557476:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18423:x1872758530907136:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 1582us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.557484:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23903 00000100:00100000:0.0:1786002527.571095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.571230:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530907392 00000100:00100000:1.0:1786002527.571250:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530907392 00000100:00100000:1.0:1786002527.571312:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23904 00000100:00100000:1.0:1786002527.571323:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18423:x1872758530907392:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002527.571344:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.571365:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414e3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac03 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.571487:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578414e41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.571502:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578414e41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.571513:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578414e41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002527.571525:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1544:0x0]: returning size 2 00010000:00010000:1.0:1786002527.571624:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578414e3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1544:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac03 expref: 23 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.571642:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578414e41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac03 expref: 22 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.571925:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff9ed366e57e00) 00010000:00010000:1.0:1786002527.571928:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786002527.571932:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8de00, rc 0) 00000100:00100000:1.0:1786002527.571997:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18423:x1872758530907392:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 675us (911us total) trans 4294983594 rc 0/0 00000100:00100000:1.0:1786002527.572005:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23904 00000100:00100000:1.0:1786002527.580483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.580529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002527.580605:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530907648 00000100:00100000:3.0:1786002527.580615:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530907648 00000100:00100000:2.0:1786002527.580753:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530907520 00000100:00100000:2.0:1786002527.580758:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530907520 00002000:00100000:2.0:1786002527.580793:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cb:0x0] (0->1) req@ffff9ed244bbb480 x1872758530907520/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:208/0 lens 496/0 e 0 to 0 dl 1786002538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002527.580804:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244bbb480 with x1872758530907520 ext(0->1) 00002000:00010000:2.0:1786002527.580810:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244bbb480 00000100:00100000:3.0:1786002527.580815:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5217 00000100:00100000:3.0:1786002527.580828:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758530907648:12345-192.168.203.49@tcp:16:kworker.0 00000100:00100000:2.0:1786002527.580842:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:2.0:1786002527.580884:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758530907520:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:3.0:1786002527.580954:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758530907648:12345-192.168.203.49@tcp:16:kworker.0 Request processed in 127us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.580966:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5217 00000100:00100000:2.0:1786002527.581809:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2413:x1872758530907520:12345-192.168.203.49@tcp:4:bash.0 Request processed in 925us (1332us total) trans 4294969891 rc 0/0 00000100:00100000:2.0:1786002527.581817:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00002000:00100000:2.0:1786002527.581824:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9cb:0x0] (0->1) req@ffff9ed244bbb480 x1872758530907520/t4294969891(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:208/0 lens 496/448 e 0 to 0 dl 1786002538 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002527.581832:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244bbb480 with x1872758530907520 ext(0->1) 00002000:00010000:2.0:1786002527.581835:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244bbb480 00000100:00100000:1.0:1786002527.586223:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.586348:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530907776 00000100:00100000:0.0:1786002527.586356:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530907776 00000100:00100000:0.0:1786002527.586405:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5218 00000100:00100000:0.0:1786002527.586415:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2413:x1872758530907776:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:0.0:1786002527.586457:0:14665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.586477:0:14665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 18 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.586486:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002527.586490:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786002527.586494:0:14665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.586526:0:14665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 18 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.586539:0:14665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 18 pid: 8434 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.586554:0:14665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14665:1872758560973824:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002527.586630:0:14665:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46540 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.592317:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.592653:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002527.592786:0:14665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14665:1872758560973824:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002527.592812:0:14665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.592885:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530907904 00000100:00100000:1.0:1786002527.592893:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530907904 00002000:00100000:1.0:1786002527.592937:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->1) req@ffff9ed37137f100 x1872758530907904/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:208/0 lens 496/0 e 0 to 0 dl 1786002538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002527.592948:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37137f100 with x1872758530907904 ext(0->1) 00002000:00010000:1.0:1786002527.592953:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37137f100 00000100:00100000:1.0:1786002527.592986:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 9 00000100:00100000:1.0:1786002527.592996:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758530907904:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:1.0:1786002527.594112:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2410:x1872758530907904:12345-192.168.203.49@tcp:4:bash.0 Request processed in 1114us (1455us total) trans 4294969888 rc 0/0 00000100:00100000:1.0:1786002527.594121:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 9 00002000:00100000:1.0:1786002527.594129:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->1) req@ffff9ed37137f100 x1872758530907904/t4294969888(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:208/0 lens 496/448 e 0 to 0 dl 1786002538 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002527.594138:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37137f100 with x1872758530907904 ext(0->1) 00002000:00010000:1.0:1786002527.594142:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37137f100 00000100:00100000:1.0:1786002527.596630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.597370:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530908032 00000100:00100000:2.0:1786002527.597379:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530908032 00000100:00100000:2.0:1786002527.597439:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5219 00000100:00100000:2.0:1786002527.597449:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2410:x1872758530908032:12345-192.168.203.49@tcp:16:kworker.0 00000100:00100000:0.0:1786002527.600842:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530908160 00000100:00100000:0.0:1786002527.600867:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530908160 00002000:00100000:0.0:1786002527.600921:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->1) req@ffff9ed244bba680 x1872758530908160/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:208/0 lens 496/0 e 0 to 0 dl 1786002538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002527.600932:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244bba680 with x1872758530908160 ext(0->1) 00010000:00010000:0.0:1786002527.600942:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 22 pid: 8434 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.600959:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 22 pid: 8434 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002527.600967:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ed244bba680 00000100:00100000:0.0:1786002527.601046:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 8 00000100:00100000:0.0:1786002527.601062:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:2412:x1872758530908160:12345-192.168.203.49@tcp:4:bash.0 00000001:00080000:1.0:1786002527.604348:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969888 is committed 00000001:00080000:1.0:1786002527.604363:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969887 is committed 00000001:00080000:1.0:1786002527.604370:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969885 is committed 00000100:00100000:2.0:1786002527.604593:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2410:x1872758530908032:12345-192.168.203.49@tcp:16:kworker.0 Request processed in 7140us (12281us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.604604:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5219 00000100:00100000:0.0:1786002527.611072:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758530908160:12345-192.168.203.49@tcp:4:bash.0 Request processed in 10003us (14434us total) trans 4294969889 rc 0/0 00000100:00100000:0.0:1786002527.611086:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 8 00002000:00100000:0.0:1786002527.611098:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->1) req@ffff9ed244bba680 x1872758530908160/t4294969889(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:208/0 lens 496/448 e 0 to 0 dl 1786002538 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002527.611109:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244bba680 with x1872758530908160 ext(0->1) 00010000:00010000:0.0:1786002527.611119:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 13 pid: 8434 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.611137:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 13 pid: 8434 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002527.611145:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ed244bba680 00000100:00100000:1.0:1786002527.614222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.614401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.614481:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530908416 00000100:00100000:2.0:1786002527.614490:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530908416 00000100:00100000:2.0:1786002527.614543:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5220 00000100:00100000:2.0:1786002527.614553:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2412:x1872758530908416:12345-192.168.203.49@tcp:16:kworker.0 00000100:00100000:2.0:1786002527.615038:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2412:x1872758530908416:12345-192.168.203.49@tcp:16:kworker.0 Request processed in 485us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.615046:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5220 00000100:00100000:0.0:1786002527.615156:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530908288 00000100:00100000:0.0:1786002527.615161:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530908288 00002000:00100000:0.0:1786002527.615184:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9cc:0x0] (0->1) req@ffff9ed37f537100 x1872758530908288/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:208/0 lens 496/0 e 0 to 0 dl 1786002538 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002527.615199:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f537100 with x1872758530908288 ext(0->1) 00002000:00010000:0.0:1786002527.615204:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f537100 00000100:00100000:0.0:1786002527.615227:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:0.0:1786002527.615234:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2412:x1872758530908288:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002527.616717:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:2412:x1872758530908288:12345-192.168.203.49@tcp:4:bash.0 Request processed in 1412us (2245us total) trans 4294969892 rc 0/0 00000100:00100000:0.0:1786002527.616735:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 10 00002000:00100000:0.0:1786002527.616745:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9cc:0x0] (0->1) req@ffff9ed37f537100 x1872758530908288/t4294969892(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:208/0 lens 496/448 e 0 to 0 dl 1786002538 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002527.616754:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f537100 with x1872758530908288 ext(0->1) 00002000:00010000:0.0:1786002527.616758:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f537100 00000100:00100000:1.0:1786002527.628215:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.628304:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530908544 00000100:00100000:0.0:1786002527.628313:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530908544 00010000:00010000:0.0:1786002527.628349:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 13 pid: 8434 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.628387:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1676 00000100:00100000:0.0:1786002527.628397:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2413:x1872758530908544:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002527.628410:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786002527.628423:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:0.0:1786002527.628441:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb mtime from disk: 0 -> 1786002526 00002000:00010000:0.0:1786002527.628443:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb ctime from disk: 0 -> 1786002526 00002000:00010000:0.0:1786002527.628445:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9cc:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1786002527.628451:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 13 pid: 8434 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.628467:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 13 pid: 8434 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.628487:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000923f38eb/0x7cee4af578414c3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba8 expref: 13 pid: 8434 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.628517:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786002527.628521:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786002527.628527:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.628536:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.628571:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002527.632357:0:14665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.632375:0:14665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.632401:0:14665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.632409:0:14665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.632418:0:14665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.632425:0:14665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002527.632429:0:14665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.632437:0:14665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.632453:0:14665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.632480:0:14665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084e53472/0x7cee4af578414e4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.632627:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2413:x1872758530908544:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 4226us (4417us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.632639:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1676 00000100:00100000:1.0:1786002527.636386:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530907776:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 49963us (50161us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.636400:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5218 00000100:00100000:0.0:1786002527.657804:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.659243:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530908800 00000100:00100000:2.0:1786002527.659253:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530908800 00000100:00100000:2.0:1786002527.659305:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 10 00000100:00100000:2.0:1786002527.659316:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18423:x1872758530908800:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:2.0:1786002527.659364:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002527.659387:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578414c2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1544:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aba1 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.659406:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff9ed366e57e00) 00010000:00010000:2.0:1786002527.659411:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002527.659431:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e56 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.659443:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e56 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.659451:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e56 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002527.659467:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x19a:0x0] 00000100:00100000:2.0:1786002527.659514:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560973952:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002527.659563:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.659642:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.663939:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560973952 00000100:00100000:1.0:1786002527.663952:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560973952 00000100:00100000:1.0:1786002527.664014:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:1.0:1786002527.664025:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560973952:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.664324:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560973952:12345-0@lo:1000:mdt_io00_000.0 Request processed in 300us (4759us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.664332:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00100000:2.0:1786002527.665063:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560973952:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.673590:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974080:0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1786002527.673665:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.673799:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.674629:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560974080 00000100:00100000:2.0:1786002527.674637:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560974080 00000100:00100000:2.0:1786002527.675562:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:2.0:1786002527.675574:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560974080:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1786002527.678321:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560974080:12345-0@lo:403:mdt_io00_000.0 Request processed in 2743us (4649us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.678333:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00100000:3.0:1786002527.678419:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974080:0@lo:403:mdt_io00_000.0 00010000:00010000:3.0:1786002527.681253:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.681269:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.681279:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.681301:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974208:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1786002527.681354:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.681407:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.681479:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560974208 00000100:00100000:0.0:1786002527.681485:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560974208 00000100:00100000:0.0:1786002527.681541:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:0.0:1786002527.681551:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6533:x1872758560974208:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002527.681568:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002527.681584:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414e64 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414e5d expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.681611:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414e64 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414e5d expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.681624:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414e64 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414e5d expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.681632:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:0.0:1786002527.681635:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.681638:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34200, rc 0) 00000100:00100000:0.0:1786002527.681681:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6533:x1872758560974208:12345-0@lo:101:mdt_io00_000.0 Request processed in 132us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.681688:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00100000:3.0:1786002527.681811:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974208:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1786002527.681826:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414e64 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.681836:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414e64 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002527.681880:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:3.0:1786002527.681902:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.681908:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.681915:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.681926:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974336:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1786002527.681949:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.681968:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.683277:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560974336 00000100:00100000:1.0:1786002527.683285:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560974336 00000100:00100000:1.0:1786002527.683319:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:1.0:1786002527.683328:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:6533:x1872758560974336:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1786002527.683340:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.683357:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414e72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414e6b expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.683379:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414e72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414e6b expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.683391:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414e72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414e6b expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.683400:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xb62e0cbf (ffff9ed2456c9b00) 00010000:00010000:1.0:1786002527.683403:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.683406:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ca00, rc 0) 00000100:00100000:1.0:1786002527.683448:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6533:x1872758560974336:12345-0@lo:101:mdt_io00_000.0 Request processed in 121us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.683454:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00100000:3.0:1786002527.684262:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974336:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1786002527.684279:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414e72 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.684291:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414e72 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002527.684310:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:3.0:1786002527.684330:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e79 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.684339:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e79 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.684347:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e79 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.684364:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578414e80 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.684372:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578414e80 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.684378:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578414e80 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.684419:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.684431:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578414e41 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac03 expref: 21 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.684439:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.684464:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578414e41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac03 expref: 21 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.684478:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578414e41 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac03 expref: 21 pid: 10360 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.684491:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6533:1872758560974464:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002527.684572:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfd80 going to sleep for 11 seconds 00010000:00010000:3.0:1786002527.689634:0:6533:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@000000002c8484e7 x1872758560974464) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578414e41 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac03 expref: 21 pid: 10360 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.689666:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578414e41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac03 expref: 21 pid: 10360 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.689689:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578414e41 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1544:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac03 expref: 21 pid: 10360 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.689705:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6533:1872758560974464:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002527.689734:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff9ed366e57e00) 00010000:00010000:3.0:1786002527.689740:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.689749:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.689757:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.689776:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.689785:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.689790:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.689971:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974592:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.690018:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.690049:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcff00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.690179:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560974592 00000100:00100000:1.0:1786002527.690186:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560974592 00000100:00100000:1.0:1786002527.690228:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:1.0:1786002527.690237:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6533:x1872758560974592:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.690349:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6533:x1872758560974592:12345-0@lo:1000:mdt_io00_000.0 Request processed in 113us (330us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002527.690356:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00000100:00100000:0.0:1786002527.690467:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974592:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002527.690505:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974720:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002527.690531:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.690552:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d466c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.690649:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560974720 00000100:00100000:1.0:1786002527.690653:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560974720 00000100:00100000:1.0:1786002527.690684:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:1.0:1786002527.690691:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6533:x1872758560974720:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.692246:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6533:x1872758560974720:12345-0@lo:1000:mdt_io00_000.0 Request processed in 1551us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.692256:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00000100:00100000:0.0:1786002527.698296:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974720:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002527.698448:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974848:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002527.698509:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.698545:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d466c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.701952:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560974848 00000100:00100000:1.0:1786002527.701963:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560974848 00000100:00100000:1.0:1786002527.702009:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:1.0:1786002527.702018:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6533:x1872758560974848:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.702130:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6533:x1872758560974848:12345-0@lo:1000:mdt_io00_000.0 Request processed in 112us (3620us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.702138:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00100000:3.0:1786002527.702274:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974848:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.702390:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974976:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.702428:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.702461:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b3e300 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.702578:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560974976 00000100:00100000:2.0:1786002527.702583:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560974976 00000100:00100000:2.0:1786002527.702618:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:2.0:1786002527.702625:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6533:x1872758560974976:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002527.702688:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6533:x1872758560974976:12345-0@lo:1000:mdt_io00_000.0 Request processed in 63us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.702694:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00000100:00100000:2.0:1786002527.702768:0:6533:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969887 gen 2 00000004:00080000:2.0:1786002527.702774:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969880 committed transno 4294969887 00000004:00080000:2.0:1786002527.702785:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969882 committed transno 4294969887 00000004:00080000:2.0:1786002527.702794:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969884 committed transno 4294969887 00000004:00080000:2.0:1786002527.702803:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969887 committed transno 4294969887 00000100:00100000:2.0:1786002527.702814:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560974976:0@lo:1000:mdt_io00_000.0 00000040:00080000:2.0:1786002527.703145:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].410, 1264 off612072 00000040:00080000:2.0:1786002527.703210:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].410, 1344 off663424 00000100:00100000:2.0:1786002527.703234:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560975104:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002527.703261:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.703279:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2900 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.703292:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560975104 00000100:00100000:2.0:1786002527.703295:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560975104 00000100:00100000:2.0:1786002527.703318:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:2.0:1786002527.703324:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6533:x1872758560975104:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002527.703405:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6533:x1872758560975104:12345-0@lo:1000:mdt_io00_000.0 Request processed in 81us (143us total) trans 4294969890 rc 0/0 00000100:00100000:2.0:1786002527.703412:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00000100:00100000:2.0:1786002527.703444:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560975104:0@lo:1000:mdt_io00_000.0 00000004:00080000:2.0:1786002527.703452:0:6533:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245dcf300 with version 782 00000004:00080000:0.0:1786002527.703755:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 782 rpc_version 782 00000020:00100000:0.0:1786002527.703776:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002527.703783:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244d31c00 x1872758560975360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002527.703803:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560975360:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002527.703833:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.703883:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.703974:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560975360 00000100:00100000:3.0:1786002527.703979:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560975360 00000100:00100000:3.0:1786002527.704013:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:3.0:1786002527.704019:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:7805:x1872758560975360:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002527.704379:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:7805:x1872758560975360:12345-0@lo:1000:osp_up1-0.0 Request processed in 359us (544us total) trans 4294968569 rc 0/0 00000100:00100000:3.0:1786002527.704387:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00000100:00100000:0.0:1786002527.704471:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d31c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560975360:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1786002527.704541:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000447f4ae3 reply state 00000000b4b49d0d transno 4294983595 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704561:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704570:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff9ed366e57e00) 00010000:00010000:3.0:1786002527.704573:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1786002527.704577:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002527.704585:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e79 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704592:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e79 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704598:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e79 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704604:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e79 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704610:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002527.704614:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e79 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704621:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e79 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704631:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed24556e200) 00010000:00010000:3.0:1786002527.704634:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002527.704637:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e79 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704644:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578414e79 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002527.704665:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000447f4ae3 reply state 00000000b4b49d0d transno 4294983595 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578414e80 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704675:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578414e80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704682:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xb62e0cbf (ffff9ed24556e400) 00010000:00010000:3.0:1786002527.704684:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002527.704686:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1786002527.704690:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:3.0:1786002527.704697:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414e64 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704710:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414e64 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704729:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414e64 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704755:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002527.704760:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:3.0:1786002527.704765:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414e72 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704772:0:6533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414e72 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002527.704784:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x19a:0x0] 00010000:00010000:3.0:1786002527.704791:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e56 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704797:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e56 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704803:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e56 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704808:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002527.704811:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e56 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704817:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e56 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704826:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed24559f400) 00010000:00010000:3.0:1786002527.704829:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002527.704831:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e56 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.704837:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578414e56 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.704932:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18423:x1872758530908800:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 45616us (47136us total) trans 4294983595 rc 0/0 00000100:00100000:3.0:1786002527.704940:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 10 00010000:00010000:0.0:1786002527.705060:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002527.705066:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414e64 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.705073:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002527.705078:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414e64 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002527.705085:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414e64 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.705109:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414e64 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.705115:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002527.705142:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414e64 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.705157:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a229800/0x7cee4af578414e5d lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414e64 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.705171:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002527.705173:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002527.705176:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002527.705359:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002527.705371:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560975488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002527.705403:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.705468:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560975488 00000100:00100000:0.0:1786002527.705473:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560975488 00000100:00100000:0.0:1786002527.705521:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:0.0:1786002527.705530:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+12:3644:x1872758560975488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002527.705541:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002527.705557:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578414e64 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414e5d expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.705568:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:0.0:1786002527.705576:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002527.705606:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3644:x1872758560975488:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.705612:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:0.0:1786002527.705640:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560975488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002527.728312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.728503:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530908928 00000100:00100000:0.0:1786002527.728519:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530908928 00000100:00100000:0.0:1786002527.728580:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23905 00000100:00100000:0.0:1786002527.728590:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18423:x1872758530908928:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:0.0:1786002527.728672:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414e8e lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728688:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414e8e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728700:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414e8e lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728711:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414e95 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728729:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414e95 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728736:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414e95 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728791:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414e9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728800:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728807:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002527.728878:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728891:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414e8e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728898:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414e8e lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728904:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414e8e lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728911:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414e8e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728918:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002527.728923:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414e8e lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728930:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414e8e lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728941:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:0.0:1786002527.728944:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.728948:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414e8e lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728954:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414e8e lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728970:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414e95 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728976:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414e95 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728981:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414e95 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728986:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002527.728989:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414e95 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.728995:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414e95 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.729002:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xbc0ca3a9 (ffff9ed2456efb00) 00010000:00010000:0.0:1786002527.729004:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.729007:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414e95 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.729017:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414e95 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.729028:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.729034:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414e9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.729039:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414e9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.729044:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002527.729047:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414e9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.729053:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414e9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.729060:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:0.0:1786002527.729063:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.729066:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414e9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.729071:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414e9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.729132:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18423:x1872758530908928:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 542us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.729140:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23905 00000100:00100000:0.0:1786002527.737497:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002527.737580:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530909184 00000100:00100000:2.0:1786002527.737590:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530909184 00000100:00100000:2.0:1786002527.737640:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23906 00000100:00100000:2.0:1786002527.737650:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18423:x1872758530909184:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002527.737671:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002527.737690:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414ea3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac0a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.737809:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414eaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.737823:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414eaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.737834:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414eaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002527.737874:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1541:0x0]: returning size 2 00010000:00010000:2.0:1786002527.737972:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578414ea3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1541:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac0a expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.737991:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414eaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac0a expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.738005:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:2.0:1786002527.738008:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786002527.738011:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2ac00, rc 0) 00000100:00100000:2.0:1786002527.738066:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18423:x1872758530909184:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 417us (579us total) trans 4294983596 rc 0/0 00000100:00100000:2.0:1786002527.738073:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23906 00000100:00100000:2.0:1786002527.742263:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.742421:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530909312 00000100:00100000:1.0:1786002527.742430:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530909312 00000100:00100000:1.0:1786002527.742486:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5221 00000100:00100000:1.0:1786002527.742497:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:2412:x1872758530909312:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:1.0:1786002527.742543:0:14676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.742564:0:14676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000515dfc57/0x7cee4af578414bbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab7e expref: 23 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.742574:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002527.742578:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786002527.742583:0:14676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.742617:0:14676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000515dfc57/0x7cee4af578414bbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab7e expref: 23 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.742632:0:14676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000515dfc57/0x7cee4af578414bbd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab7e expref: 23 pid: 14687 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.742647:0:14676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14676:1872758560975616:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002527.742735:0:14676:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3455456c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.745361:0:14676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14676:1872758560975616:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002527.745386:0:14676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.748656:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002527.748798:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530909440 00000100:00100000:3.0:1786002527.748807:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530909440 00010000:00010000:3.0:1786002527.748844:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000515dfc57/0x7cee4af578414bbd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab7e expref: 24 pid: 14687 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.748906:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1677 00000100:00100000:3.0:1786002527.748916:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:2412:x1872758530909440:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002527.748931:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786002527.748946:0:10399:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1786002527.748949:0:10399:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb mtime from disk: 0 -> 1786002526 00002000:00010000:3.0:1786002527.748952:0:10399:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb ctime from disk: 0 -> 1786002526 00002000:00010000:3.0:1786002527.748954:0:10399:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9cb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1786002527.748961:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000515dfc57/0x7cee4af578414bbd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab7e expref: 24 pid: 14687 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.748975:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000515dfc57/0x7cee4af578414bbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab7e expref: 24 pid: 14687 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.749000:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000515dfc57/0x7cee4af578414bbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab7e expref: 24 pid: 14687 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.749016:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002527.749021:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002527.749026:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.749035:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.749073:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002527.749136:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:2412:x1872758530909440:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 220us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.749144:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1677 00010000:00010000:1.0:1786002527.749283:0:14676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.749292:0:14676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.749312:0:14676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.749320:0:14676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.749327:0:14676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.749333:0:14676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002527.749337:0:14676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.749345:0:14676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.749362:0:14676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.749370:0:14676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9fdfebb/0x7cee4af578414eb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.749437:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:2412:x1872758530909312:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 6942us (7182us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.749446:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5221 00000100:00100000:2.0:1786002527.760983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.761079:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530909696 00000100:00100000:0.0:1786002527.761088:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530909696 00000100:00100000:0.0:1786002527.761152:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:0.0:1786002527.761170:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18423:x1872758530909696:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:0.0:1786002527.761221:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002527.761256:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414baf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1541:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab77 expref: 24 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.761276:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:0.0:1786002527.761281:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002527.761304:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414ebf lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.761316:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414ebf lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.761325:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414ebf lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002527.761344:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x19a:0x0] 00000100:00100000:0.0:1786002527.761394:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e01500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560975744:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.761443:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.761476:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d460c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.761615:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560975744 00000100:00100000:1.0:1786002527.761620:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560975744 00000100:00100000:1.0:1786002527.761656:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:1.0:1786002527.761663:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560975744:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.761757:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560975744:12345-0@lo:1000:mdt_io00_002.0 Request processed in 94us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.761765:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00000100:00100000:3.0:1786002527.762023:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e01500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560975744:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.765736:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560975872:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1786002527.765806:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.766014:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2480 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.769967:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560975872 00000100:00100000:3.0:1786002527.769980:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560975872 00000100:00100000:2.0:1786002527.773442:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:2.0:1786002527.773456:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560975872:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1786002527.777496:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560975872:12345-0@lo:403:mdt_io00_002.0 Request processed in 4036us (11682us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.777510:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00000100:00100000:0.0:1786002527.777618:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560975872:0@lo:403:mdt_io00_002.0 00010000:00010000:0.0:1786002527.778672:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.778684:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.778694:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.778714:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e02d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976000:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1786002527.778767:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.781892:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d466c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.782014:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560976000 00000100:00100000:1.0:1786002527.782023:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560976000 00000100:00100000:1.0:1786002527.786981:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:1.0:1786002527.787005:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560976000:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002527.787026:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.787051:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578414ecd lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414ec6 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.787093:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578414ecd lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414ec6 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.787109:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578414ecd lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414ec6 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.787117:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456c9c00) 00010000:00010000:1.0:1786002527.787120:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.787123:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8dc00, rc 0) 00000100:00100000:1.0:1786002527.787205:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:6535:x1872758560976000:12345-0@lo:101:mdt_io00_002.0 Request processed in 210us (8437us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.787212:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00000100:00100000:0.0:1786002527.787549:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e02d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976000:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1786002527.787566:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414ecd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.787579:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414ecd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002527.787601:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:0.0:1786002527.787628:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.787636:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.787644:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.787662:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e02d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976128:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1786002527.787698:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.787734:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d466c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.787840:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560976128 00000100:00100000:1.0:1786002527.787868:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560976128 00000100:00100000:1.0:1786002527.787899:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:1.0:1786002527.787906:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+12:6535:x1872758560976128:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002527.787914:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.787925:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578414edb lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414ed4 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.787940:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578414edb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414ed4 expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.787949:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578414edb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414ed4 expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.787956:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xbc0ca3a9 (ffff9ed2456c9300) 00010000:00010000:1.0:1786002527.787958:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.787960:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d400, rc 0) 00000100:00100000:1.0:1786002527.787989:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560976128:12345-0@lo:101:mdt_io00_002.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.787995:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00000100:00100000:0.0:1786002527.788074:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e02d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976128:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1786002527.788085:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414edb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.788094:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414edb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002527.788105:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:0.0:1786002527.788121:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414ee2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.788130:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414ee2 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.788138:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414ee2 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.788150:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414ee9 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.788167:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.788175:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.788215:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.788228:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414eaa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac0a expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.788235:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.788401:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414eaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac0a expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.788416:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414eaa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac0a expref: 23 pid: 6520 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.788428:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e02d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6535:1872758560976256:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002527.788503:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d466c0 going to sleep for 11 seconds 00010000:00010000:2.0:1786002527.791586:0:6535:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@00000000c4f63bec x1872758560976256) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414eaa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac0a expref: 23 pid: 6520 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.791610:0:6535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414eaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac0a expref: 23 pid: 6520 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.791633:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414eaa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1541:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac0a expref: 23 pid: 6520 timeout: 987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.791650:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e02d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6535:1872758560976256:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002527.791671:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:2.0:1786002527.791677:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.791687:0:6535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.791694:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.791713:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.791732:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.791738:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.791912:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976384:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.791957:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.791987:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.792068:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560976384 00000100:00100000:3.0:1786002527.792075:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560976384 00000100:00100000:3.0:1786002527.792120:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:3.0:1786002527.792131:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560976384:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002527.792432:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560976384:12345-0@lo:1000:mdt_io00_002.0 Request processed in 301us (473us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002527.792439:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00000100:00100000:2.0:1786002527.792707:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976384:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.792756:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976512:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.792782:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.792804:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.792874:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560976512 00000100:00100000:1.0:1786002527.792879:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560976512 00000100:00100000:1.0:1786002527.792911:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:1.0:1786002527.792918:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560976512:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.792970:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560976512:12345-0@lo:1000:mdt_io00_002.0 Request processed in 53us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.792977:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:2.0:1786002527.793133:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976512:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.793333:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976640:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.793358:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.793417:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.795447:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560976640 00000100:00100000:0.0:1786002527.795458:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560976640 00000100:00100000:0.0:1786002527.795500:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:0.0:1786002527.795508:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560976640:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.795591:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:6535:x1872758560976640:12345-0@lo:1000:mdt_io00_002.0 Request processed in 83us (2231us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.795597:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00000100:00100000:2.0:1786002527.796263:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976640:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.796363:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976768:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.796394:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.796412:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.796557:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560976768 00000100:00100000:1.0:1786002527.796562:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560976768 00000100:00100000:1.0:1786002527.796587:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:1.0:1786002527.796593:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560976768:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.796657:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560976768:12345-0@lo:1000:mdt_io00_002.0 Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.796663:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00000100:00100000:2.0:1786002527.796727:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976768:0@lo:1000:mdt_io00_002.0 00000040:00080000:2.0:1786002527.797015:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].411, 1264 off613336 00000040:00080000:2.0:1786002527.797068:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].411, 1344 off664768 00000100:00100000:2.0:1786002527.797087:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976896:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002527.797110:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.797120:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed37b772e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.797302:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560976896 00000100:00100000:0.0:1786002527.797307:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560976896 00000100:00100000:0.0:1786002527.797324:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:0.0:1786002527.797330:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6535:x1872758560976896:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.797419:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6535:x1872758560976896:12345-0@lo:1000:mdt_io00_002.0 Request processed in 88us (307us total) trans 4294969893 rc 0/0 00000100:00100000:0.0:1786002527.797425:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000100:00100000:2.0:1786002527.798352:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560976896:0@lo:1000:mdt_io00_002.0 00000004:00080000:2.0:1786002527.798364:0:6535:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed2434d2480 with version 783 00000004:00080000:0.0:1786002527.798410:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 783 rpc_version 783 00000020:00100000:0.0:1786002527.798441:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002527.798448:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed370e02680 x1872758560977152/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002527.798465:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e02680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560977152:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002527.798502:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.798531:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.798586:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560977152 00000100:00100000:1.0:1786002527.798592:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560977152 00000100:00100000:1.0:1786002527.798628:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:1.0:1786002527.798636:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+13:7805:x1872758560977152:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002527.799573:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:7805:x1872758560977152:12345-0@lo:1000:osp_up1-0.0 Request processed in 936us (1068us total) trans 4294968570 rc 0/0 00000100:00100000:1.0:1786002527.799582:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00000100:00100000:0.0:1786002527.799975:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e02680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560977152:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1786002527.803377:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004fd4251 reply state 0000000095c64c42 transno 4294983597 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803401:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803410:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:2.0:1786002527.803413:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1786002527.803419:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002527.803428:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414ee2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803435:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414ee2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803442:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414ee2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803449:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414ee2 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803455:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.803459:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414ee2 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803467:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414ee2 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803477:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456ef600) 00010000:00010000:2.0:1786002527.803479:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.803483:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414ee2 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803488:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578414ee2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002527.803507:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004fd4251 reply state 0000000095c64c42 transno 4294983597 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803515:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414ee9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803521:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xbc0ca3a9 (ffff9ed2456eff00) 00010000:00010000:2.0:1786002527.803524:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002527.803526:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1786002527.803532:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:2.0:1786002527.803540:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414ecd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803548:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414ecd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.803555:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414ecd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.804038:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002527.804046:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:2.0:1786002527.804051:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414edb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.804069:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414edb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002527.804083:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x19a:0x0] 00010000:00010000:2.0:1786002527.804093:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414ebf lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.804099:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414ebf lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.804105:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414ebf lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.804111:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002527.804114:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414ebf lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.804121:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414ebf lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.804129:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed2456efb00) 00010000:00010000:2.0:1786002527.804132:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002527.804135:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414ebf lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.804141:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414ebf lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.804345:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18423:x1872758530909696:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 43075us (43270us total) trans 4294983597 rc 0/0 00000100:00100000:2.0:1786002527.804354:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 11 00010000:00010000:3.0:1786002527.811621:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002527.811636:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414ecd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.811648:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002527.811655:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414ecd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002527.811664:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414ecd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.811709:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414ecd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.811715:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002527.811754:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414ecd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.811762:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34200/0x7cee4af578414ec6 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414ecd expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.811782:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002527.811784:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002527.811786:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002527.811824:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002527.811878:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560977280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002527.811943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.812195:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560977280 00000100:00100000:3.0:1786002527.812203:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560977280 00000100:00100000:3.0:1786002527.812403:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:3.0:1786002527.812413:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+14:3647:x1872758560977280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002527.812427:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002527.812446:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578414ecd lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414ec6 expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.812459:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456c9c00) 00010000:00010000:3.0:1786002527.812479:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002527.812558:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+13:3647:x1872758560977280:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.812565:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:1.0:1786002527.814762:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002527.815103:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530909824 00000100:00100000:3.0:1786002527.815111:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530909824 00000100:00100000:0.0:1786002527.815331:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23907 00000100:00100000:0.0:1786002527.815344:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18423:x1872758530909824:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:0.0:1786002527.815419:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414ef7 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815435:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815446:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815457:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414efe lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815465:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414efe lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815472:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414efe lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815519:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414f05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815528:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815540:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002527.815581:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815593:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414ef7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815600:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414ef7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815606:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815613:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414ef7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815619:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002527.815624:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414ef7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815631:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414ef7 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815641:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:0.0:1786002527.815644:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.815648:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414ef7 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815654:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414ef7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815672:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414efe lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815679:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414efe lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815686:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414efe lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815691:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002527.815694:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414efe lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815699:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414efe lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815705:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x391d5834 (ffff9ed2456ef200) 00010000:00010000:0.0:1786002527.815708:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.815711:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414efe lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815729:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414efe lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815740:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815746:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414f05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815752:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815758:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002527.815761:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815767:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414f05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815774:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff9ed3465ad300) 00010000:00010000:0.0:1786002527.815776:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.815779:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414f05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.815785:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578414f05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.815875:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18423:x1872758530909824:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 534us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.815883:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23907 00000100:00100000:2.0:1786002527.820340:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560977280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002527.827349:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002527.832283:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530910080 00000100:00100000:3.0:1786002527.832298:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530910080 00000100:00100000:2.0:1786002527.832602:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23908 00000100:00100000:2.0:1786002527.832614:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18423:x1872758530910080:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002527.832633:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002527.832654:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414f0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac11 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.832766:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414f13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.832780:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414f13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.832792:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414f13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002527.832804:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1542:0x0]: returning size 2 00010000:00010000:2.0:1786002527.832918:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af578414f0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1542:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac11 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.832937:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414f13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac11 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.832945:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff9ed3465ad300) 00010000:00010000:2.0:1786002527.832948:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786002527.832951:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b800, rc 0) 00000100:00100000:2.0:1786002527.833076:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18423:x1872758530910080:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 463us (5734us total) trans 4294983598 rc 0/0 00000100:00100000:2.0:1786002527.833084:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23908 00000100:00100000:1.0:1786002527.844380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002527.844461:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530910208 00000100:00100000:3.0:1786002527.844470:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530910208 00000100:00100000:3.0:1786002527.844525:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5222 00000100:00100000:3.0:1786002527.844536:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2412:x1872758530910208:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:3.0:1786002527.844579:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.844599:0:14686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000cd0d33f/0x7cee4af578414be7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab8c expref: 11 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.844607:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x9cb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786002527.844611:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002527.844616:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.844651:0:14686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000cd0d33f/0x7cee4af578414be7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab8c expref: 11 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.844667:0:14686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000cd0d33f/0x7cee4af578414be7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab8c expref: 11 pid: 14685 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.844682:0:14686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14686:1872758560977408:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002527.844766:0:14686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b3ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.857881:0:14686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14686:1872758560977408:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002527.857909:0:14686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.860336:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002527.860538:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530910336 00000100:00100000:3.0:1786002527.860546:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530910336 00010000:00010000:3.0:1786002527.860579:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000cd0d33f/0x7cee4af578414be7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab8c expref: 12 pid: 14685 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.860619:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1678 00000100:00100000:3.0:1786002527.860629:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2413:x1872758530910336:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002527.860644:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786002527.860659:0:10399:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1786002527.860662:0:10399:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb mtime from disk: 0 -> 1786002526 00002000:00010000:3.0:1786002527.860664:0:10399:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb ctime from disk: 0 -> 1786002526 00002000:00010000:3.0:1786002527.860667:0:10399:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9cb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1786002527.860673:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000cd0d33f/0x7cee4af578414be7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab8c expref: 12 pid: 14685 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.860694:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000cd0d33f/0x7cee4af578414be7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab8c expref: 12 pid: 14685 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.860725:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd0d33f/0x7cee4af578414be7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab8c expref: 12 pid: 14685 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.860743:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002527.860747:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002527.860753:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.860762:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.860791:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002527.860842:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530910336:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 213us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.860880:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1678 00010000:00010000:1.0:1786002527.861382:0:14686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.861393:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.861412:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.861421:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.861429:0:14686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.861436:0:14686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002527.861440:0:14686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.861448:0:14686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.861460:0:14686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.861478:0:14686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578414f21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.861537:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758530910208:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 17002us (17165us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.861545:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5222 00000100:00100000:1.0:1786002527.869992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002527.870083:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530910592 00000100:00100000:3.0:1786002527.870092:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530910592 00000100:00100000:3.0:1786002527.870152:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:3.0:1786002527.870172:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18423:x1872758530910592:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:3.0:1786002527.870223:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002527.870257:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578414bd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1542:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab85 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.870280:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff9ed3465ad300) 00010000:00010000:3.0:1786002527.870284:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002527.870308:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f28 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.870318:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f28 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.870326:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f28 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002527.870343:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x19a:0x0] 00000100:00100000:3.0:1786002527.870392:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560977536:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.870443:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.870474:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.870612:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560977536 00000100:00100000:1.0:1786002527.870617:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560977536 00000100:00100000:1.0:1786002527.870644:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:1.0:1786002527.870651:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560977536:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.870748:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560977536:12345-0@lo:1000:mdt_io00_000.0 Request processed in 97us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.870755:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:3.0:1786002527.872410:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560977536:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.872999:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560977664:0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1786002527.873043:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.873080:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b3ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.873383:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560977664 00000100:00100000:1.0:1786002527.873388:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560977664 00000100:00100000:1.0:1786002527.873422:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:1.0:1786002527.873431:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560977664:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1786002527.881075:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560977664:12345-0@lo:403:mdt_io00_000.0 Request processed in 7636us (8022us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.881089:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00000100:00100000:3.0:1786002527.885213:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560977664:0@lo:403:mdt_io00_000.0 00010000:00010000:2.0:1786002527.887205:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.887221:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.887234:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.887306:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560977792:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1786002527.887362:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.887436:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.890352:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560977792 00000100:00100000:1.0:1786002527.890364:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560977792 00000100:00100000:1.0:1786002527.890474:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:1.0:1786002527.890485:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+13:6533:x1872758560977792:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1786002527.890506:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.890530:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af578414f36 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414f2f expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.890558:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af578414f36 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414f2f expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.890576:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af578414f36 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414f2f expref: 14 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.890584:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456c9800) 00010000:00010000:1.0:1786002527.890587:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.890591:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c000, rc 0) 00000100:00100000:1.0:1786002527.890664:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+14:6533:x1872758560977792:12345-0@lo:101:mdt_io00_000.0 Request processed in 181us (3301us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.890671:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00000100:00100000:2.0:1786002527.890756:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560977792:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1786002527.890775:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414f36 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.890786:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414f36 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002527.890807:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:2.0:1786002527.890838:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.890859:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.890869:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.890887:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560977920:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1786002527.890920:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.895094:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790540 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.897371:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560977920 00000100:00100000:0.0:1786002527.897384:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560977920 00000100:00100000:0.0:1786002527.897436:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:0.0:1786002527.897447:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:6533:x1872758560977920:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002527.897466:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002527.897489:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578414f44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414f3d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897523:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578414f44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414f3d expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897537:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578414f44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414f3d expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897546:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x391d5834 (ffff9ed2456ef200) 00010000:00010000:0.0:1786002527.897549:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002527.897553:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35200, rc 0) 00000100:00100000:0.0:1786002527.897617:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6533:x1872758560977920:12345-0@lo:101:mdt_io00_000.0 Request processed in 173us (6696us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.897625:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:0.0:1786002527.897671:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cb800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560977920:0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1786002527.897688:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414f44 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897699:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414f44 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002527.897732:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:0.0:1786002527.897751:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414f4b lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897760:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414f4b lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897769:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414f4b lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897779:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414f52 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897785:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414f52 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897792:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414f52 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897829:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897841:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414f13 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac11 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897869:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897898:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414f13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac11 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.897912:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414f13 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac11 expref: 25 pid: 6521 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.897925:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e02d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6533:1872758560978048:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002527.900912:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46b40 going to sleep for 11 seconds 00010000:00010000:3.0:1786002527.904472:0:6533:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@00000000c4f63bec x1872758560978048) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414f13 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac11 expref: 25 pid: 6521 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.904496:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414f13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac11 expref: 25 pid: 6521 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.904537:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578414f13 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1542:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac11 expref: 25 pid: 6521 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.904554:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e02d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6533:1872758560978048:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002527.904575:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff9ed3465ad300) 00010000:00010000:3.0:1786002527.904581:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.904590:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.904597:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.904617:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.904626:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.904632:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.904777:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddf480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560978176:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.904822:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.904891:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b3e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.905037:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560978176 00000100:00100000:0.0:1786002527.905044:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560978176 00000100:00100000:0.0:1786002527.905097:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:0.0:1786002527.905106:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6533:x1872758560978176:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002527.905436:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6533:x1872758560978176:12345-0@lo:1000:mdt_io00_000.0 Request processed in 329us (612us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786002527.905444:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00000100:00100000:3.0:1786002527.908298:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddf480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560978176:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.908379:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddf480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560978304:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1786002527.908429:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002527.908460:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.908529:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560978304 00000100:00100000:1.0:1786002527.908536:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560978304 00000100:00100000:1.0:1786002527.908581:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00100000:1.0:1786002527.908590:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6533:x1872758560978304:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.908707:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6533:x1872758560978304:12345-0@lo:1000:mdt_io00_000.0 Request processed in 117us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.908714:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00000100:00100000:2.0:1786002527.911841:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddf480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560978304:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002527.911992:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c9180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560978432:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002527.912044:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002527.912085:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2900 going to sleep for 11 seconds 00000100:00100000:0.0:1786002527.912250:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560978432 00000100:00100000:0.0:1786002527.912257:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560978432 00000100:00100000:0.0:1786002527.912303:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00100000:0.0:1786002527.912313:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6533:x1872758560978432:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1786002527.912391:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+15:6533:x1872758560978432:12345-0@lo:1000:mdt_io00_000.0 Request processed in 80us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002527.912399:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00000100:00100000:1.0:1786002527.912524:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c9180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560978432:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.912614:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560978560:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.912645:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.912668:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed366d7de40 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.912725:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560978560 00000100:00100000:2.0:1786002527.912730:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560978560 00000100:00100000:2.0:1786002527.912766:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00100000:2.0:1786002527.912774:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6533:x1872758560978560:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002527.912829:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6533:x1872758560978560:12345-0@lo:1000:mdt_io00_000.0 Request processed in 56us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.912837:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1786002527.912925:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560978560:0@lo:1000:mdt_io00_000.0 00000040:00080000:1.0:1786002527.913366:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].412, 1264 off614600 00000040:00080000:1.0:1786002527.913417:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].412, 1344 off666112 00000100:00100000:1.0:1786002527.913441:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560978688:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1786002527.913470:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.913494:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790540 going to sleep for 11 seconds 00000100:00100000:2.0:1786002527.915269:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560978688 00000100:00100000:2.0:1786002527.915278:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560978688 00000100:00100000:2.0:1786002527.915326:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00100000:2.0:1786002527.915335:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6533:x1872758560978688:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1786002527.915467:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6533:x1872758560978688:12345-0@lo:1000:mdt_io00_000.0 Request processed in 132us (1995us total) trans 4294969891 rc 0/0 00000100:00100000:2.0:1786002527.915474:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00000100:00100000:1.0:1786002527.915733:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6533:1872758560978688:0@lo:1000:mdt_io00_000.0 00000004:00080000:1.0:1786002527.915746:0:6533:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed345545f00 with version 784 00000004:00080000:0.0:1786002527.915792:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 784 rpc_version 784 00000020:00100000:0.0:1786002527.915822:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002527.915830:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed370e01500 x1872758560978944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3088/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002527.915875:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e01500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560978944:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002527.915913:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.915933:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.915985:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560978944 00000100:00100000:1.0:1786002527.915989:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560978944 00000100:00100000:1.0:1786002527.916021:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00100000:1.0:1786002527.916028:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b578050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:7805:x1872758560978944:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1786002527.916472:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b578050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+16:7805:x1872758560978944:12345-0@lo:1000:osp_up1-0.0 Request processed in 443us (558us total) trans 4294968571 rc 0/0 00000100:00100000:1.0:1786002527.916480:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00000100:00100000:0.0:1786002527.916671:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e01500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560978944:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1786002527.916738:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090d83381 reply state 00000000fcd069bb transno 4294983599 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916757:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916765:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff9ed3465ad300) 00010000:00010000:1.0:1786002527.916768:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:1.0:1786002527.916771:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002527.916779:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414f4b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916786:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414f4b lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916793:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414f4b lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916800:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414f4b lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916806:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002527.916810:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414f4b lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916817:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414f4b lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916826:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:1.0:1786002527.916828:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.916831:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414f4b lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916837:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578414f4b lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002527.916881:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090d83381 reply state 00000000fcd069bb transno 4294983599 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414f52 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916890:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414f52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916896:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x391d5834 (ffff9ed2456ef300) 00010000:00010000:1.0:1786002527.916899:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002527.916901:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:1.0:1786002527.916905:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:1.0:1786002527.916911:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414f36 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916919:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414f36 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916932:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414f36 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916946:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786002527.916950:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:1.0:1786002527.916954:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414f44 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916961:0:6533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414f44 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002527.916973:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x19a:0x0] 00010000:00010000:1.0:1786002527.916981:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f28 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916987:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f28 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916993:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f28 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.916998:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002527.917001:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f28 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.917006:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f28 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.917013:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed24556e200) 00010000:00010000:1.0:1786002527.917016:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.917019:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f28 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.917025:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f28 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.917127:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002527.917132:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414f36 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.917139:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ae00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002527.917144:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414f36 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002527.917165:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414f36 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.917188:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414f36 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.917194:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002527.917211:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414f36 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.917218:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2ae00/0x7cee4af578414f2f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414f36 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.917230:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002527.917231:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002527.917233:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002527.917238:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786002527.917330:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560979072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002527.917361:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.918204:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18423:x1872758530910592:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 47986us (48173us total) trans 4294983599 rc 0/0 00000100:00100000:1.0:1786002527.918213:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:2.0:1786002527.919113:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560979072 00000100:00100000:2.0:1786002527.919121:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560979072 00000100:00100000:2.0:1786002527.919174:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:2.0:1786002527.919184:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af74850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+16:3646:x1872758560979072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002527.919196:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002527.919215:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af578414f36 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414f2f expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.919230:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456c9800) 00010000:00010000:2.0:1786002527.919238:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002527.919293:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af74850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+15:3646:x1872758560979072:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.919300:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1786002527.919569:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560979072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002527.933472:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002527.933636:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530910720 00000100:00100000:1.0:1786002527.933646:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530910720 00000100:00100000:1.0:1786002527.933705:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23909 00000100:00100000:1.0:1786002527.933723:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18423:x1872758530910720:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:1.0:1786002527.933801:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f60 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.933817:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f60 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.933828:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f60 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.933840:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414f67 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.933867:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414f67 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.933874:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414f67 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.933933:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414f6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.933941:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.933948:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002527.933996:0:10360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934011:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f60 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934017:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f60 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934023:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f60 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934029:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f60 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934035:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002527.934039:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f60 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934047:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f60 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934069:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456c9200) 00010000:00010000:1.0:1786002527.934073:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.934078:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f60 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934084:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f60 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934099:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414f67 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934105:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414f67 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934111:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414f67 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934116:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002527.934118:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414f67 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934124:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414f67 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934131:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x18618557 (ffff9ed2456c9600) 00010000:00010000:1.0:1786002527.934134:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.934137:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414f67 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934142:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578414f67 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934152:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934169:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414f6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934174:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414f6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934179:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002527.934182:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414f6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934189:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414f6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934196:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff9ed366e57900) 00010000:00010000:1.0:1786002527.934199:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.934202:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414f6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.934208:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af578414f6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002527.934287:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18423:x1872758530910720:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 573us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.934295:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23909 00000100:00100000:1.0:1786002527.937329:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002527.937395:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530910976 00000100:00100000:3.0:1786002527.937404:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530910976 00000100:00100000:3.0:1786002527.937449:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23910 00000100:00100000:3.0:1786002527.937460:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:18423:x1872758530910976:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002527.937489:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002527.937507:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578414f75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac18 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.937599:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.937612:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.937623:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002527.937636:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1543:0x0]: returning size 2 00010000:00010000:3.0:1786002527.937743:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578414f75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1543:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac18 expref: 29 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.937768:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f7c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac18 expref: 28 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.937777:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff9ed366e57900) 00010000:00010000:3.0:1786002527.937779:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786002527.937783:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2423b4c00, rc 0) 00000100:00100000:3.0:1786002527.937842:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18423:x1872758530910976:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 383us (520us total) trans 4294983600 rc 0/0 00000100:00100000:3.0:1786002527.937874:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23910 00000100:00100000:2.0:1786002527.945009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002527.945152:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530911104 00000100:00100000:3.0:1786002527.945170:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530911104 00000100:00100000:3.0:1786002527.945223:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5223 00000100:00100000:3.0:1786002527.945233:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:2412:x1872758530911104:12345-192.168.203.49@tcp:1:lfs.0 00010000:00010000:3.0:1786002527.945286:0:14691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.945305:0:14691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de79215f/0x7cee4af578414c11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab9a expref: 22 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.945313:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x9cc:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786002527.945317:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002527.945322:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.945356:0:14691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de79215f/0x7cee4af578414c11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab9a expref: 22 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.945371:0:14691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de79215f/0x7cee4af578414c11 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab9a expref: 22 pid: 8764 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.945386:0:14691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14691:1872758560979200:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002527.945463:0:14691:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b3ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.954988:0:14691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14691:1872758560979200:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002527.955017:0:14691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.970066:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002527.970392:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530911232 00000100:00100000:3.0:1786002527.970401:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530911232 00010000:00010000:3.0:1786002527.970437:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de79215f/0x7cee4af578414c11 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab9a expref: 23 pid: 8764 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002527.970480:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1679 00000100:00100000:3.0:1786002527.970490:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:2413:x1872758530911232:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002527.970504:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786002527.970519:0:10399:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1786002527.970522:0:10399:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb mtime from disk: 0 -> 1786002526 00002000:00010000:3.0:1786002527.970525:0:10399:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb ctime from disk: 0 -> 1786002526 00002000:00010000:3.0:1786002527.970527:0:10399:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9cc:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1786002527.970534:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de79215f/0x7cee4af578414c11 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab9a expref: 23 pid: 8764 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.970549:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de79215f/0x7cee4af578414c11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab9a expref: 23 pid: 8764 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.970575:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de79215f/0x7cee4af578414c11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab9a expref: 23 pid: 8764 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.970591:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002527.970596:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002527.970602:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.970611:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.970644:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002527.970695:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:2413:x1872758530911232:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 206us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.970703:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1679 00010000:00010000:2.0:1786002527.970985:0:14691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.970996:0:14691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.971015:0:14691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.971024:0:14691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.971033:0:14691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.971040:0:14691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002527.971044:0:14691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.971052:0:14691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.971069:0:14691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002527.971078:0:14691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aca69537/0x7cee4af578414f8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002527.971134:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2412:x1872758530911104:12345-192.168.203.49@tcp:1:lfs.0 Request processed in 25903us (26133us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002527.971143:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5223 00000100:00100000:2.0:1786002527.976607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002527.976693:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530911488 00000100:00100000:0.0:1786002527.976702:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530911488 00000100:00100000:0.0:1786002527.976768:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:0.0:1786002527.976779:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18423:x1872758530911488:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:0.0:1786002527.976832:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002527.976889:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578414c03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1543:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab93 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.976911:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff9ed366e57900) 00010000:00010000:0.0:1786002527.976915:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002527.976939:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414f91 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.976951:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414f91 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.976959:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414f91 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002527.976976:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x19a:0x0] 00000100:00100000:0.0:1786002527.977024:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560979328:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.977083:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.977107:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46900 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.977176:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560979328 00000100:00100000:1.0:1786002527.977181:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560979328 00000100:00100000:1.0:1786002527.977216:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:1.0:1786002527.977224:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560979328:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002527.977318:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560979328:12345-0@lo:1000:mdt_io00_002.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.977326:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00000100:00100000:0.0:1786002527.977513:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560979328:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002527.978104:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560979456:0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1786002527.978139:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.978210:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.978788:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560979456 00000100:00100000:1.0:1786002527.978795:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560979456 00000100:00100000:1.0:1786002527.978834:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00100000:1.0:1786002527.978842:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560979456:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1786002527.983774:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560979456:12345-0@lo:403:mdt_io00_002.0 Request processed in 4924us (5626us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.983788:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00100000:0.0:1786002527.988367:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560979456:0@lo:403:mdt_io00_002.0 00010000:00010000:0.0:1786002527.989940:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.989951:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.989963:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.989982:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560979584:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1786002527.990040:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002527.990341:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560979584 00000100:00100000:1.0:1786002527.990349:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560979584 00000100:00100000:0.0:1786002527.990449:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002527.991262:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:1.0:1786002527.991276:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+15:6535:x1872758560979584:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1786002527.991294:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002527.991315:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f9f lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414f98 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.991341:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f9f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414f98 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.991355:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f9f lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414f98 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002527.991363:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456c9600) 00010000:00010000:1.0:1786002527.991366:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002527.991370:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8cc00, rc 0) 00000100:00100000:1.0:1786002527.991416:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:6535:x1872758560979584:12345-0@lo:101:mdt_io00_002.0 Request processed in 144us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002527.991423:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000100:00100000:0.0:1786002527.991499:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560979584:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1786002527.991518:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414f9f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.991527:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414f9f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002527.991544:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:0.0:1786002527.991568:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.991575:0:6535:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.991582:0:6535:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.991597:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560979712:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1786002527.991623:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002527.997271:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46540 going to sleep for 11 seconds 00000100:00100000:3.0:1786002527.997524:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560979712 00000100:00100000:3.0:1786002527.997533:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560979712 00000100:00100000:3.0:1786002527.997691:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:3.0:1786002527.997701:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:6535:x1872758560979712:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1786002527.997728:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002527.997751:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414fad lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578414fa6 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.997785:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414fad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578414fa6 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.997799:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414fad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414fa6 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002527.997808:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x18618557 (ffff9ed24556e500) 00010000:00010000:3.0:1786002527.997810:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002527.997814:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2423b4a00, rc 0) 00000100:00100000:3.0:1786002527.997886:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6535:x1872758560979712:12345-0@lo:101:mdt_io00_002.0 Request processed in 185us (6260us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002527.997891:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00100000:0.0:1786002527.997980:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560979712:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1786002527.997996:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414fad expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.998011:0:6535:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414fad expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002527.998033:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:0.0:1786002527.998053:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414fb4 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.998126:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414fb4 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.998136:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414fb4 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.998149:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.998212:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.998221:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.998326:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.998340:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f7c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac18 expref: 27 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.998348:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.998381:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f7c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac18 expref: 27 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002527.998395:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f7c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac18 expref: 27 pid: 14496 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002527.998408:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6535:1872758560979840:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002527.998478:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46540 going to sleep for 11 seconds 00010000:00010000:0.0:1786002528.001304:0:6535:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@000000000dabd159 x1872758560979840) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f7c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac18 expref: 27 pid: 14496 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.001330:0:6535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f7c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac18 expref: 27 pid: 14496 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.001352:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414f7c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1543:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac18 expref: 27 pid: 14496 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.001371:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6535:1872758560979840:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002528.001390:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff9ed366e57900) 00010000:00010000:0.0:1786002528.001396:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.001406:0:6535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.001413:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.001433:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.001442:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.001449:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.001572:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560979968:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002528.001615:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.001645:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46900 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.002151:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560979968 00000100:00100000:3.0:1786002528.002215:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560979968 00000100:00100000:3.0:1786002528.002371:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:3.0:1786002528.002381:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6535:x1872758560979968:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002528.002618:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:6535:x1872758560979968:12345-0@lo:1000:mdt_io00_002.0 Request processed in 237us (1001us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002528.002625:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00100000:1.0:1786002528.005329:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560979968:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002528.005409:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffaa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560980096:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1786002528.005459:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.005531:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed345545840 going to sleep for 11 seconds 00000100:00100000:0.0:1786002528.010167:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560980096 00000100:00100000:0.0:1786002528.010179:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560980096 00000100:00100000:0.0:1786002528.010327:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:0.0:1786002528.010337:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6535:x1872758560980096:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002528.010451:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:6535:x1872758560980096:12345-0@lo:1000:mdt_io00_002.0 Request processed in 116us (4992us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.010458:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00100000:3.0:1786002528.010552:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffaa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560980096:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002528.010685:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560980224:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002528.010727:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.010756:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b3e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002528.010814:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560980224 00000100:00100000:2.0:1786002528.010819:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560980224 00000100:00100000:2.0:1786002528.010871:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:2.0:1786002528.010878:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:6535:x1872758560980224:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002528.010922:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+17:6535:x1872758560980224:12345-0@lo:1000:mdt_io00_002.0 Request processed in 45us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.010928:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00100000:3.0:1786002528.010989:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560980224:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002528.011131:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560980352:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002528.011206:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.011228:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3820499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002528.011309:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560980352 00000100:00100000:2.0:1786002528.011313:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560980352 00000100:00100000:2.0:1786002528.011334:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:2.0:1786002528.011339:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6535:x1872758560980352:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1786002528.011390:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6535:x1872758560980352:12345-0@lo:1000:mdt_io00_002.0 Request processed in 50us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.011396:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00000100:00100000:3.0:1786002528.011451:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560980352:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1786002528.011737:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].413, 1264 off615864 00000040:00080000:3.0:1786002528.011786:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].413, 1344 off667456 00000100:00100000:3.0:1786002528.011808:0:6535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560980480:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1786002528.011833:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.011875:0:6535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d000 going to sleep for 11 seconds 00000100:00100000:0.0:1786002528.011929:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560980480 00000100:00100000:0.0:1786002528.011933:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560980480 00000100:00100000:0.0:1786002528.011960:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:0.0:1786002528.011966:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6535:x1872758560980480:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1786002528.012043:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:6535:x1872758560980480:12345-0@lo:1000:mdt_io00_002.0 Request processed in 76us (208us total) trans 4294969894 rc 0/0 00000100:00100000:0.0:1786002528.012049:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00100000:3.0:1786002528.012767:0:6535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6535:1872758560980480:0@lo:1000:mdt_io00_002.0 00000004:00080000:3.0:1786002528.012777:0:6535:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed357b3e300 with version 785 00000004:00080000:0.0:1786002528.012819:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 785 rpc_version 785 00000020:00100000:0.0:1786002528.012842:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002528.012883:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2454c3b80 x1872758560980736/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3344/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002528.012898:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560980736:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002528.012925:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.012940:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.012987:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560980736 00000100:00100000:3.0:1786002528.012991:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560980736 00000100:00100000:3.0:1786002528.013020:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:3.0:1786002528.013026:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+17:7805:x1872758560980736:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002528.013528:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+18:7805:x1872758560980736:12345-0@lo:1000:osp_up1-0.0 Request processed in 500us (600us total) trans 4294968572 rc 0/0 00000100:00100000:3.0:1786002528.013535:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00000100:00100000:1.0:1786002528.013707:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560980736:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1786002528.013946:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d13858c reply state 0000000049abaedf transno 4294983601 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.013965:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.013974:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff9ed366e57900) 00010000:00010000:3.0:1786002528.013977:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1786002528.013980:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002528.013989:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414fb4 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.013996:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414fb4 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.014002:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414fb4 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.014008:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414fb4 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.014015:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002528.014020:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414fb4 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.014027:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414fb4 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.014037:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efb00) 00010000:00010000:3.0:1786002528.014040:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.014044:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414fb4 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.014050:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578414fb4 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002528.014318:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d13858c reply state 0000000049abaedf transno 4294983601 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 3/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.014328:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.014334:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x18618557 (ffff9ed2456ef600) 00010000:00010000:3.0:1786002528.014336:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002528.014338:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1786002528.014343:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:3.0:1786002528.014349:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578414f9f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.014358:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414f9f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.014365:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578414f9f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.015137:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002528.015143:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0xd3:0x0] 00010000:00010000:3.0:1786002528.015151:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414fad expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.015213:0:6535:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578414fad expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002528.015228:0:6535:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x19a:0x0] 00010000:00010000:3.0:1786002528.015236:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414f91 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.015300:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414f91 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.015306:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414f91 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.015312:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002528.015315:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414f91 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.015322:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414f91 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.015332:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff9ed2456efc00) 00010000:00010000:3.0:1786002528.015335:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.015338:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414f91 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.015349:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578414f91 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.015433:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18423:x1872758530911488:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 38653us (38832us total) trans 4294983601 rc 0/0 00000100:00100000:3.0:1786002528.015442:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00010000:00010000:0.0:1786002528.015512:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002528.015519:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578414f9f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.015527:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002528.015531:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578414f9f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002528.015540:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578414f9f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.015567:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 2/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414f9f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.015574:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002528.015600:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 1/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414f9f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.015608:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f34000/0x7cee4af578414f98 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578414f9f expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.015622:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.015624:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.015627:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002528.018586:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786002528.018612:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560980864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002528.018678:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.023114:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.023272:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530911744 00000100:00100000:2.0:1786002528.023281:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530911744 00000100:00100000:2.0:1786002528.023338:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5104 00000100:00100000:2.0:1786002528.023348:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:18423:x1872758530911744:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:2.0:1786002528.023566:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:18423:x1872758530911744:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 219us (461us total) trans 4294968573 rc 0/0 00000100:00100000:2.0:1786002528.023576:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5104 00000100:00100000:0.0:1786002528.025810:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560980864 00000100:00100000:0.0:1786002528.025820:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560980864 00000100:00100000:2.0:1786002528.026018:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:2.0:1786002528.026029:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+18:3645:x1872758560980864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002528.026042:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002528.026077:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af578414f9f lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578414f98 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.026093:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456c9600) 00010000:00010000:2.0:1786002528.026103:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002528.026262:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560980864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002528.026440:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+17:3645:x1872758560980864:12345-0@lo:103:ldlm_bl.0 Request processed in 412us (7761us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.026448:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:2.0:1786002528.054765:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.054840:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530912000 00000100:00100000:3.0:1786002528.054879:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530912000 00000100:00100000:3.0:1786002528.054947:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23911 00000100:00100000:3.0:1786002528.054958:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18424:x1872758530912000:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002528.054980:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.054999:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578414fc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac1f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055072:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414fd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055084:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055096:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055113:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414fd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055120:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055126:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786002528.055340:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786002528.055399:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578414fde lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055408:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578414fde lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055415:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578414fde lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055428:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414fd0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055434:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414fd0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055441:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414fd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055447:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414fd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055454:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002528.055458:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414fd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055465:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414fd0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055476:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002528.055480:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.055484:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414fd0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055489:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578414fd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055507:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055512:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414fd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055518:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055523:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002528.055526:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055531:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414fd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055538:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9ed24556e100) 00010000:00010000:3.0:1786002528.055540:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.055543:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414fd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055553:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578414fd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055589:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578414fc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac1f expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055603:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578414fde lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac1f expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.055611:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed245e35200) 00010000:00010000:3.0:1786002528.055614:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002528.055616:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229800, rc 0) 00000100:00100000:3.0:1786002528.055679:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18424:x1872758530912000:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 723us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.055686:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23911 00000100:00100000:1.0:1786002528.079129:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.079228:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.079389:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530912384 00000100:00100000:3.0:1786002528.079398:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530912384 00000100:00100000:3.0:1786002528.079463:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1500 00000100:00100000:3.0:1786002528.079478:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2413:x1872758530912384:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002528.079492:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002528.079515:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af578414fde lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac1f expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.079537:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed245e35200) 00010000:00010000:3.0:1786002528.079542:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002528.079597:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:2413:x1872758530912384:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 121us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.079605:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1500 00000100:00100000:0.0:1786002528.080570:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530912256 00000100:00100000:0.0:1786002528.080576:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530912256 00000100:00100000:0.0:1786002528.080619:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23912 00000100:00100000:0.0:1786002528.080627:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:18424:x1872758530912256:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1786002528.080647:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002528.080666:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578414fe5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac26 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002528.080814:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19a:0x0]: returning size 4096 00010000:00010000:0.0:1786002528.080931:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578414fe5 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac26 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.080943:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:0.0:1786002528.080946:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002528.080950:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578414fe5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac26 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.080964:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34000, rc 0) 00000100:00100000:0.0:1786002528.080997:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18424:x1872758530912256:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 371us (1878us total) trans 4294968574 rc 301/301 00000100:00100000:0.0:1786002528.081004:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23912 00000100:00100000:1.0:1786002528.086400:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.086478:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530912512 00000100:00100000:2.0:1786002528.086487:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530912512 00000100:00100000:2.0:1786002528.086534:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5105 00000100:00100000:2.0:1786002528.086543:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18424:x1872758530912512:12345-192.168.203.49@tcp:33:lfs.0 00000004:00200000:2.0:1786002528.086660:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19a:0x0]: returning size 4096 00000004:00200000:2.0:1786002528.086664:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000100:00100000:2.0:1786002528.086737:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18424:x1872758530912512:12345-192.168.203.49@tcp:33:lfs.0 Request processed in 194us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.086744:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5105 00000100:00100000:2.0:1786002528.103337:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.103418:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530912768 00000100:00100000:3.0:1786002528.103427:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530912768 00000100:00100000:3.0:1786002528.103489:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5106 00000100:00100000:3.0:1786002528.103500:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:18424:x1872758530912768:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1786002528.103705:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:18424:x1872758530912768:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 205us (376us total) trans 4294968575 rc 0/0 00000100:00100000:3.0:1786002528.103713:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5106 00000100:00100000:3.0:1786002528.106011:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560980992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786002528.106070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.106235:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560980992 00000100:00100000:1.0:1786002528.106241:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560980992 00000100:00100000:1.0:1786002528.106280:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1786002528.106288:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3645:x1872758560980992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786002528.106306:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67681728 pending 172032 free 3923513344 avail 3691991040 00000100:00100000:1.0:1786002528.106346:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3645:x1872758560980992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.106352:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1786002528.106387:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560980992:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1786002528.106614:0:8753:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 888287765950ns, next at 889287764253ns, rc = 0 00000100:00100000:0.0:1786002528.106658:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002528.106668:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560981120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002528.106694:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.106789:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560981120 00000100:00100000:3.0:1786002528.106793:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560981120 00000100:00100000:3.0:1786002528.106820:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1786002528.106826:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872758560981120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786002528.106835:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67681728 pending 172032 free 3923513344 avail 3691991040 00000100:00100000:3.0:1786002528.106882:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872758560981120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.106888:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1786002528.106971:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560981120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002528.115069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.115160:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530912896 00000100:00100000:2.0:1786002528.115171:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530912896 00000100:00100000:2.0:1786002528.115230:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23913 00000100:00100000:2.0:1786002528.115240:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:18233:x1872758530912896:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002528.115262:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.115283:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578414ff3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac2d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.115349:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578414ffa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.115361:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578414ffa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.115371:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578414ffa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002528.115451:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19a:0x0]: returning size 4096 00000004:00200000:2.0:1786002528.115456:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00000004:00010000:2.0:1786002528.115475:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578414ffa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.115501:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af578414ff3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac2d expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.115522:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578414ffa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac2d expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.115530:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed24559f700) 00010000:00010000:2.0:1786002528.115533:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786002528.115536:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a000, rc 0) 00000100:00100000:2.0:1786002528.115594:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:18233:x1872758530912896:12345-192.168.203.49@tcp:101:bash.0 Request processed in 356us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.115601:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23913 00000100:00100000:1.0:1786002528.124334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.124438:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530913024 00000100:00100000:3.0:1786002528.124448:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530913024 00000100:00100000:3.0:1786002528.124511:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23914 00000100:00100000:3.0:1786002528.124521:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:18233:x1872758530913024:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002528.124539:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.124559:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229800/0x7cee4af578415001 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac34 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.124622:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578415008 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.124636:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578415008 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.124647:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578415008 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002528.124687:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0xd3:0x0]: returning size 4096 00000004:00200000:3.0:1786002528.124693:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:3.0:1786002528.124734:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229800/0x7cee4af578415001 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac34 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.124753:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578415008 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac34 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.124762:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:3.0:1786002528.124765:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786002528.124768:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228800, rc 0) 00000100:00100000:3.0:1786002528.124882:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18233:x1872758530913024:12345-192.168.203.49@tcp:101:bash.0 Request processed in 361us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.124888:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23914 00000100:00100000:2.0:1786002528.137401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.141363:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530913152 00000100:00100000:1.0:1786002528.141377:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530913152 00000100:00100000:0.0:1786002528.145438:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23915 00000100:00100000:0.0:1786002528.145451:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:18233:x1872758530913152:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002528.145471:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002528.145492:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af57841500f lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac3b expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.145550:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415016 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.145562:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415016 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.145573:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415016 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002528.145619:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0xd6:0x0]: returning size 4096 00000004:00200000:0.0:1786002528.145624:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 3 MDT count 2 00010000:00010000:0.0:1786002528.145660:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af57841500f lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac3b expref: 30 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.145679:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415016 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac3b expref: 29 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.145687:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:0.0:1786002528.145690:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786002528.145693:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34a00, rc 0) 00000100:00100000:0.0:1786002528.145804:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18233:x1872758530913152:12345-192.168.203.49@tcp:101:bash.0 Request processed in 354us (8411us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.145815:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23915 00000100:00100000:1.0:1786002528.159013:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.160164:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530913408 00000100:00100000:2.0:1786002528.160175:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530913408 00000100:00100000:2.0:1786002528.160246:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23916 00000100:00100000:2.0:1786002528.160258:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18233:x1872758530913408:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002528.160280:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.160301:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af57841501d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac42 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.160444:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578415024 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.160457:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578415024 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.160466:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578415024 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002528.160477:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19a:0x0]: returning size 4096 00010000:00010000:2.0:1786002528.160566:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af57841501d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac42 expref: 15 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.160589:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578415024 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac42 expref: 14 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.160597:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed24559f700) 00010000:00010000:2.0:1786002528.160601:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786002528.160604:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2aa00, rc 0) 00000100:00100000:2.0:1786002528.160670:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18233:x1872758530913408:12345-192.168.203.49@tcp:101:bash.0 Request processed in 413us (1665us total) trans 4294968576 rc 0/0 00000100:00100000:2.0:1786002528.160677:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23916 00010000:00010000:3.0:1786002528.170032:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.174972:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002528.175266:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530913536 00000100:00100000:0.0:1786002528.175276:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530913536 00000100:00100000:0.0:1786002528.175330:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5107 00000100:00100000:0.0:1786002528.175340:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18233:x1872758530913536:12345-192.168.203.49@tcp:37:bash.0 00000100:00100000:2.0:1786002528.188600:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18233:x1872758530913536:12345-192.168.203.49@tcp:37:bash.0 Request processed in 13251us (13626us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.188612:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5107 00000100:00100000:1.0:1786002528.203944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.204441:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530913664 00000100:00100000:2.0:1786002528.204452:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530913664 00000100:00100000:2.0:1786002528.204509:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5108 00000100:00100000:2.0:1786002528.204520:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18233:x1872758530913664:12345-192.168.203.49@tcp:37:bash.0 00000100:00100000:2.0:1786002528.215926:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18233:x1872758530913664:12345-192.168.203.49@tcp:37:bash.0 Request processed in 11398us (11981us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.215939:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5108 00000100:00100000:0.0:1786002528.232454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.233151:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530913792 00000100:00100000:2.0:1786002528.233159:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530913792 00000100:00100000:2.0:1786002528.233218:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23917 00000100:00100000:2.0:1786002528.233228:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18426:x1872758530913792:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:2.0:1786002528.233254:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.233275:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415032 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac49 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233335:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578415039 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233347:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578415039 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233358:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578415039 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233372:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578415040 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233379:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578415040 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233385:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578415040 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233419:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578415039 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233426:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578415039 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233431:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578415039 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233438:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578415039 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233444:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.233448:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578415039 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233456:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578415039 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233573:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002528.233577:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.233583:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578415039 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233589:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af578415039 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233604:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578415040 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233610:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578415040 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233616:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578415040 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233621:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.233625:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578415040 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233630:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578415040 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233638:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xeddcfc6c (ffff9ed24559fb00) 00010000:00010000:2.0:1786002528.233641:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.233644:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578415040 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233649:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578415040 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233680:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415032 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac49 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233690:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002528.233692:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002528.233696:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415032 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac49 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.233705:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2be00, rc 0) 00000100:00100000:2.0:1786002528.233776:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18426:x1872758530913792:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 549us (1332us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002528.233783:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23917 00000100:00100000:1.0:1786002528.242980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002528.243118:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530913920 00000100:00100000:0.0:1786002528.243128:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530913920 00000100:00100000:0.0:1786002528.243188:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23918 00000100:00100000:0.0:1786002528.243198:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18426:x1872758530913920:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:0.0:1786002528.243217:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002528.243237:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578415047 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac50 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243307:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841504e lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243320:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841504e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243330:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841504e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243343:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578415055 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243349:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578415055 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243359:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578415055 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243394:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841504e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243400:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841504e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243406:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841504e lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243413:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841504e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243419:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.243423:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841504e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243430:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841504e lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243441:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:0.0:1786002528.243444:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.243449:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841504e lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.243455:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841504e lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.244167:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578415055 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.244177:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578415055 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.244182:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578415055 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.244187:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.244190:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578415055 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.244196:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578415055 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.244204:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xeddcfc6c (ffff9ed2456ef100) 00010000:00010000:0.0:1786002528.244207:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.244210:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578415055 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.244216:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578415055 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.244358:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578415047 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac50 expref: 15 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.244369:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:0.0:1786002528.244371:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002528.244375:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578415047 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac50 expref: 15 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.244390:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34000, rc 0) 00000100:00100000:0.0:1786002528.244539:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18426:x1872758530913920:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 1342us (1566us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002528.244547:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23918 00000100:00100000:0.0:1786002528.252663:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.253126:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530914048 00000100:00100000:3.0:1786002528.253135:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530914048 00000100:00100000:3.0:1786002528.253189:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23919 00000100:00100000:3.0:1786002528.253198:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18426:x1872758530914048:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:3.0:1786002528.253218:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.253236:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af57841505c lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac57 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253350:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415063 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253363:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415063 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253374:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415063 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253386:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af57841506a lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253392:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af57841506a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253399:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af57841506a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253437:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415063 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253444:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415063 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253449:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415063 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253455:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415063 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253462:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002528.253513:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415063 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253522:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415063 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253534:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:3.0:1786002528.253537:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.253543:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415063 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253549:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415063 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253566:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af57841506a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253572:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af57841506a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253578:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af57841506a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253583:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002528.253585:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af57841506a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253591:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af57841506a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253602:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x3491cd4c (ffff9ed24556e900) 00010000:00010000:3.0:1786002528.253604:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.253607:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af57841506a lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253612:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af57841506a lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253649:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af57841505c lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac57 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253660:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:3.0:1786002528.253662:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002528.253665:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af57841505c lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac57 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.253674:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229800, rc 0) 00000100:00100000:3.0:1786002528.253785:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18426:x1872758530914048:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 586us (1130us total) trans 0 rc 301/301 00000100:00100000:3.0:1786002528.253792:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23919 00000100:00100000:0.0:1786002528.260897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.261046:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530914176 00000100:00100000:1.0:1786002528.261065:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530914176 00000100:00100000:1.0:1786002528.261122:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23920 00000100:00100000:1.0:1786002528.261132:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18426:x1872758530914176:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002528.261153:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.261173:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af578415071 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac5e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261231:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578415078 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261387:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578415078 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261399:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578415078 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261417:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841507f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261423:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841507f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261430:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841507f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261476:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578415078 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261484:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578415078 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261491:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578415078 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261498:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578415078 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261504:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.261508:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578415078 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261515:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578415078 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261526:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:1.0:1786002528.261529:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.261534:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578415078 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261540:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8dc00/0x7cee4af578415078 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261552:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841507f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261558:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841507f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261564:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841507f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261569:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.261572:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841507f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261578:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841507f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261584:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x3491cd4c (ffff9ed2456c9200) 00010000:00010000:1.0:1786002528.261586:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.261589:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841507f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261595:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c000/0x7cee4af57841507f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261623:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af578415071 lrc: 1/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac5e expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261633:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:1.0:1786002528.261635:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002528.261638:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af578415071 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac5e expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.261647:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8da00, rc 0) 00000100:00100000:1.0:1786002528.261707:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18426:x1872758530914176:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 575us (819us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002528.261722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23920 00000100:00100000:1.0:1786002528.268328:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002528.268403:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530914304 00000100:00100000:0.0:1786002528.268412:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530914304 00000100:00100000:0.0:1786002528.268475:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23921 00000100:00100000:0.0:1786002528.268486:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18426:x1872758530914304:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:0.0:1786002528.268506:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002528.268527:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415086 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac65 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268587:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841508d lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268599:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841508d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268609:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841508d lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268623:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415094 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268630:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415094 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268636:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415094 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268674:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841508d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268681:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841508d lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268687:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841508d lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268693:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841508d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268699:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.268703:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841508d lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268709:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841508d lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268730:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:0.0:1786002528.268733:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.268737:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841508d lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268742:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841508d lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268753:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415094 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268759:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415094 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268764:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415094 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268768:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.268770:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415094 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268775:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415094 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268781:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x3735a305 (ffff9ed2456ef100) 00010000:00010000:0.0:1786002528.268783:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.268785:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415094 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268790:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415094 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268819:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415086 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac65 expref: 30 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268828:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:0.0:1786002528.268830:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002528.268834:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415086 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac65 expref: 30 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.268878:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34000, rc 0) 00000100:00100000:0.0:1786002528.268938:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18426:x1872758530914304:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 454us (618us total) trans 0 rc 301/301 00000100:00100000:0.0:1786002528.268945:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23921 00000100:00100000:0.0:1786002528.278214:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.278338:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530914432 00000100:00100000:2.0:1786002528.278347:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530914432 00000100:00100000:2.0:1786002528.278407:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23922 00000100:00100000:2.0:1786002528.278418:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18426:x1872758530914432:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:2.0:1786002528.278439:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.278458:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af57841509b lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac6c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278519:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150a2 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278532:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150a2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278543:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150a2 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278557:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278565:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278571:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278610:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150a2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278618:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150a2 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278624:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150a2 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278630:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150a2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278637:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.278641:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150a2 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278649:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150a2 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278660:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:2.0:1786002528.278663:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.278667:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150a2 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278674:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150a2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278688:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278694:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278699:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278704:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.278707:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278721:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278729:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x3735a305 (ffff9ed24559fb00) 00010000:00010000:2.0:1786002528.278732:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.278735:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278741:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278770:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af57841509b lrc: 1/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac6c expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278781:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:2.0:1786002528.278783:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002528.278788:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af57841509b lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac6c expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.278798:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b400, rc 0) 00000100:00100000:2.0:1786002528.278886:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18426:x1872758530914432:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 468us (680us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002528.278894:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23922 00000100:00100000:2.0:1786002528.297092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.297221:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530914688 00000100:00100000:1.0:1786002528.297231:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530914688 00000100:00100000:1.0:1786002528.297296:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23923 00000100:00100000:1.0:1786002528.297307:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18426:x1872758530914688:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002528.297326:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.297346:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784150b0 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac73 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297412:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150b7 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297426:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150b7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297438:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150b7 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297448:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784150be lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297456:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784150be lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297463:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784150be lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297509:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150b7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297517:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150b7 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297524:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150b7 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297535:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150b7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297541:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.297545:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150b7 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297553:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150b7 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297564:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:1.0:1786002528.297568:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.297582:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150b7 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297589:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150b7 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297601:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784150be lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297606:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784150be lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297611:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784150be lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297616:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.297619:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784150be lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297628:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784150be lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297636:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xdcc87686 (ffff9ed24556ea00) 00010000:00010000:1.0:1786002528.297638:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.297641:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784150be lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297646:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af5784150be lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297674:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784150b0 lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac73 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297684:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:1.0:1786002528.297687:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002528.297691:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784150b0 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac73 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.297949:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8da00, rc 0) 00000100:00100000:1.0:1786002528.298008:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18426:x1872758530914688:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 701us (924us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002528.298015:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23923 00000100:00100000:3.0:1786002528.301371:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.301461:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530914944 00000100:00100000:2.0:1786002528.301480:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530914944 00000100:00100000:2.0:1786002528.301540:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23924 00000100:00100000:2.0:1786002528.301549:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18426:x1872758530914944:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:2.0:1786002528.301568:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.301597:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af5784150c5 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac7a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.301661:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150cc lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.301673:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150cc lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.301684:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150cc lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.301695:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.301723:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578414e09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414e02 expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.301737:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.301769:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578414e09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578414e02 expref: 16 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002528.301783:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758560981248:0@lo:104: 00000100:00100000:2.0:1786002528.301827:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.301907:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f480 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.302072:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560981248 00000100:00100000:1.0:1786002528.302077:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560981248 00000100:00100000:1.0:1786002528.302112:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1786002528.302119:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6520:x1872758560981248:12345-0@lo:104: 00010000:00010000:1.0:1786002528.302131:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414e09 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.302180:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786002528.302185:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6520:x1872758560981248:12345-0@lo:104: Request processed in 67us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.302191:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1786002528.302348:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758560981248:0@lo:104: 00010000:00010000:3.0:1786002528.302367:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.302455:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002528.302462:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414e09 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.302478:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228e00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002528.302483:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578414e09 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002528.302492:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578414e09 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.302517:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414e09 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.302524:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002528.302553:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414e09 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.302560:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228e00/0x7cee4af578414e02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414e09 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.302581:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.302583:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.302585:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.302624:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786002528.302636:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560981376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002528.302666:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.302742:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560981376 00000100:00100000:3.0:1786002528.302747:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560981376 00010000:00010000:3.0:1786002528.302767:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578414e09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578414e02 expref: 17 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.302795:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:3.0:1786002528.302803:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+17:3646:x1872758560981376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002528.302812:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1786002528.304591:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968576 is committed 00000004:00080000:1.0:1786002528.304601:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 5 committed 00000001:00080000:1.0:1786002528.304623:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968572 is committed 00000020:00080000:1.0:1786002528.304633:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 417 batchid updated 00010000:00010000:0.0:1786002528.304741:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578414e09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578414e02 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.304756:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xdcc87686 (ffff9ed2456efd00) 00010000:00010000:0.0:1786002528.304761:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.304770:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.304777:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.304807:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002528.304874:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+10:3646:x1872758560981376:12345-0@lo:103:ldlm_bl.0 Request processed in 2071us (2206us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.304882:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00100000:0.0:1786002528.304922:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560981376:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1786002528.304979:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 417 00000004:00080000:3.0:1786002528.305033:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245e3d480 with version 794 00000020:00080000:3.0:1786002528.305057:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 417 cancel update log [0x200000401:0x3:0x0].414: rc = 0 00000020:00080000:3.0:1786002528.305125:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 417 cancel update log [0x240000400:0x3:0x0].414: rc = 0 00000020:00080000:3.0:1786002528.305134:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 417 00000100:00100000:2.0:1786002528.305338:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560981632:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1786002528.305374:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.305397:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002528.305403:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560981504:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1786002528.305424:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.305451:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560981632 00000100:00100000:2.0:1786002528.305457:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560981632 00000100:00100000:2.0:1786002528.305500:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560981504 00000100:00100000:2.0:1786002528.305504:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560981504 00000100:00100000:2.0:1786002528.305524:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5224 00000100:00100000:2.0:1786002528.305531:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3645:x1872758560981632:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1786002528.305554:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2506 count 1 00010000:00010000:2.0:1786002528.305575:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.305594:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b95571d0/0x7cee4af578414860 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaa5 expref: 20 pid: 14676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.305609:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1786002528.305613:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002528.305618:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.305641:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b95571d0/0x7cee4af578414860 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaa5 expref: 20 pid: 14676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.305656:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b95571d0/0x7cee4af578414860 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaa5 expref: 20 pid: 14676 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002528.305667:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f537480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1872758560981760:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002528.305730:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1786002528.305746:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5225 00000100:00100000:2.0:1786002528.305753:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+7:3645:x1872758560981504:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1786002528.305767:0:14678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2504 count 1 00010000:00010000:2.0:1786002528.305778:0:14678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.305790:0:14678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a766f448/0x7cee4af578414821 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa90 expref: 20 pid: 14678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.305796:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1786002528.305799:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002528.305803:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.305822:0:14678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a766f448/0x7cee4af578414821 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa90 expref: 20 pid: 14678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.305831:0:14678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a766f448/0x7cee4af578414821 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa90 expref: 20 pid: 14678 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002528.305842:0:14678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14678:1872758560981888:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002528.305893:0:14678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f000 going to sleep for 11 seconds 00000004:00080000:0.0:1786002528.306246:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 794 rpc_version 794 00000020:00100000:0.0:1786002528.306266:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002528.306273:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2454c2a00 x1872758560982144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002528.306286:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560982144:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002528.306316:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.306329:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46300 going to sleep for 11 seconds 00010000:00010000:1.0:1786002528.306385:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306394:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306503:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784150e8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306513:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784150e8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306523:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784150e8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002528.306532:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19c:0x0]: returning size 2 00010000:00010000:1.0:1786002528.306598:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150cc lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306611:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150cc lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306616:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150cc lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306621:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150cc lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306626:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.306631:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150cc lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306637:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150cc lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306649:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:1.0:1786002528.306652:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.306656:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150cc lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306662:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2be00/0x7cee4af5784150cc lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306675:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306682:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306688:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306693:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.306696:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306702:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306710:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xdcc87686 (ffff9ed2456efd00) 00010000:00010000:1.0:1786002528.306712:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.306723:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306729:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a200/0x7cee4af5784150d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306773:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b400/0x7cee4af5784150c5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac7a expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306787:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784150e8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac7a expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.306793:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9ed244f15200) 00010000:00010000:1.0:1786002528.306796:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002528.306799:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8da00, rc 0) 00000100:00100000:1.0:1786002528.306867:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18426:x1872758530914944:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 5297us (5481us total) trans 4294968577 rc 0/0 00000100:00100000:1.0:1786002528.306876:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23924 00000100:00100000:2.0:1786002528.312806:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560982144 00000100:00100000:2.0:1786002528.312820:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560982144 00000100:00100000:2.0:1786002528.312909:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:2.0:1786002528.312920:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7466:x1872758560982144:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002528.313115:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7466:x1872758560982144:12345-0@lo:1000:osp_up0-1.0 Request processed in 197us (6797us total) trans 4294983602 rc 0/0 00000100:00100000:2.0:1786002528.313123:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00100000:0.0:1786002528.313505:0:7466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983589 gen 2 00000004:00080000:0.0:1786002528.313511:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983589 committed transno 4294983589 00000020:00080000:0.0:1786002528.313518:0:7466:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed245c66e40 refcount 2 committed 0 result 0 batchid 418 00000020:00080000:0.0:1786002528.313522:0:7466:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455df500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245c66a80 00000020:00080000:0.0:1786002528.313525:0:7466:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].415 00000020:00080000:0.0:1786002528.313528:0:7466:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455df700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2436fea00 00000020:00080000:0.0:1786002528.313531:0:7466:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].415 00000100:00100000:0.0:1786002528.313559:0:7466:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed2454c2a00 x1872758560982144/t4294983602(4294983602) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1786002544 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786002528.313578:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560982144:0@lo:1000:osp_up0-1.0 00000020:00080000:3.0:1786002528.313628:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 418 committed batchid 417 00000020:00080000:3.0:1786002528.313663:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 417 00000100:00100000:3.0:1786002528.314420:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.314446:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.314465:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530915072 00000100:00100000:3.0:1786002528.314481:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530915072 00010000:00010000:3.0:1786002528.314514:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b95571d0/0x7cee4af578414860 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaa5 expref: 21 pid: 14676 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.314538:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530915200 00000100:00100000:3.0:1786002528.314541:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530915200 00010000:00010000:3.0:1786002528.314554:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a766f448/0x7cee4af578414821 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa90 expref: 22 pid: 14678 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.314575:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1681 00000100:00100000:3.0:1786002528.314583:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:2411:x1872758530915072:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002528.314596:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002528.314602:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b95571d0/0x7cee4af578414860 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaa5 expref: 22 pid: 14676 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.314613:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b95571d0/0x7cee4af578414860 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaa5 expref: 22 pid: 14676 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.314636:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002528.314641:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002528.314646:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.314655:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.314673:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002528.314712:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:2411:x1872758530915072:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 129us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.314728:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1681 00000100:00100000:3.0:1786002528.314745:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1682 00000100:00100000:3.0:1786002528.314752:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2411:x1872758530915200:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002528.314760:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002528.314765:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a766f448/0x7cee4af578414821 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa90 expref: 21 pid: 14678 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.314782:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a766f448/0x7cee4af578414821 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa90 expref: 21 pid: 14678 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.314794:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002528.314797:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002528.314802:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.314810:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.314823:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002528.314841:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2411:x1872758530915200:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 90us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.314871:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1682 00000100:00080000:3.0:1786002528.314891:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786002528.315365:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b95571d0/0x7cee4af578414860 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaa5 expref: 20 pid: 14676 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.315380:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f537480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1872758560981760:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002528.315397:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.315406:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.315413:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.315422:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.315430:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.315445:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786002528.315599:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3645:x1872758560981632:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10066us (10223us total) trans 4294969895 rc 0/0 00000100:00100000:0.0:1786002528.315608:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5224 00000004:00080000:0.0:1786002528.315642:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454cb100/2, rc 0, transno 4294969895 00000100:00100000:0.0:1786002528.315648:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560981632:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1786002528.315989:0:14678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a766f448/0x7cee4af578414821 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aa90 expref: 19 pid: 14678 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002528.316001:0:14678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:14678:1872758560981888:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002528.316013:0:14678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.316022:0:14678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.316030:0:14678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.316038:0:14678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.316045:0:14678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.316072:0:14678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1786002528.316149:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3645:x1872758560981504:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10396us (10723us total) trans 4294969896 rc 0/0 00000100:00100000:1.0:1786002528.316156:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5225 00010000:00010000:0.0:1786002528.316385:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786002528.316392:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.316401:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002528.316406:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.316415:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.316430:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.316437:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d9c4626/0x7cee4af5784150da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.316451:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002528.316454:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.316461:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2bc00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002528.316465:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.316484:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.316494:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.316502:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001239dafd/0x7cee4af5784150e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.316514:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.316516:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.316518:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786002528.316536:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454cb800/2, rc 0, transno 4294969896 00000100:00100000:0.0:1786002528.316541:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560981504:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1786002528.317143:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786002528.319638:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969896 is committed 00000001:00080000:3.0:1786002528.319652:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969894 is committed 00000001:00080000:3.0:1786002528.319657:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969892 is committed 00000100:00100000:0.0:1786002528.320511:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.320576:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530915328 00000100:00100000:1.0:1786002528.320585:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530915328 00000100:00100000:1.0:1786002528.320653:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5226 00000100:00100000:1.0:1786002528.320664:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2410:x1872758530915328:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002528.320685:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.320707:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af5784150f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac81 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002528.320745:0:14665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ca:0x0] initial LVB size: 2, mtime: 0x6a743c5e, atime: 0x0, ctime: 0x6a743c5e, blocks: 0x8 00010000:00010000:1.0:1786002528.320763:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=888s v=(0 0) 00010000:00010000:1.0:1786002528.320768:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002528.320777:0:14665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af5784150f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac81 expref: 11 pid: 14665 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.320793:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af5784150f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac81 expref: 11 pid: 14665 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.320805:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8dc00, rc 0) 00000100:00100000:1.0:1786002528.320896:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2410:x1872758530915328:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 233us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.320902:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5226 00000100:00080000:3.0:1786002528.321118:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002528.331543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002528.331626:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530915456 00000100:00100000:0.0:1786002528.331635:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530915456 00002000:00100000:0.0:1786002528.331679:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->4095) req@ffff9ed243ddf480 x1872758530915456/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:209/0 lens 488/0 e 0 to 0 dl 1786002539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002528.331690:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed243ddf480 with x1872758530915456 ext(0->4095) 00002000:00010000:0.0:1786002528.331696:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed243ddf480 00000100:00100000:0.0:1786002528.331737:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 11 00000100:00100000:0.0:1786002528.331747:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530915456:12345-192.168.203.49@tcp:3:cmp.0 00000100:00100000:0.0:1786002528.331917:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530915456:12345-192.168.203.49@tcp:3:cmp.0 Request processed in 171us (381us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786002528.331925:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 11 00002000:00100000:0.0:1786002528.331931:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9ca:0x0] (0->4095) req@ffff9ed243ddf480 x1872758530915456/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:209/0 lens 488/4536 e 0 to 0 dl 1786002539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002528.331939:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed243ddf480 with x1872758530915456 ext(0->4095) 00002000:00010000:0.0:1786002528.331943:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed243ddf480 00000100:00100000:0.0:1786002528.347516:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.347763:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530915712 00000100:00100000:2.0:1786002528.347773:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530915712 00000100:00100000:2.0:1786002528.347825:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5109 00000100:00100000:2.0:1786002528.347835:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:18426:x1872758530915712:12345-192.168.203.49@tcp:35:cmp.0 00000100:00100000:2.0:1786002528.348151:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:18426:x1872758530915712:12345-192.168.203.49@tcp:35:cmp.0 Request processed in 316us (644us total) trans 4294968578 rc 0/0 00000100:00100000:2.0:1786002528.348158:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5109 00000100:00100000:3.0:1786002528.366451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.366599:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530915968 00000100:00100000:1.0:1786002528.366608:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530915968 00000100:00100000:1.0:1786002528.366667:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23925 00000100:00100000:1.0:1786002528.366678:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18428:x1872758530915968:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002528.366698:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.366727:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150fd lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac88 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366797:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415104 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366811:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415104 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366822:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415104 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366832:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841510b lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366838:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841510b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366844:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841510b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366914:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415104 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366923:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415104 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366930:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415104 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366936:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415104 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366942:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8de00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.366946:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415104 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366954:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415104 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366966:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:1.0:1786002528.366969:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.366973:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415104 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366980:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415104 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366992:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841510b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.366998:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841510b lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.367003:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841510b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.367007:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.367010:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841510b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.367016:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841510b lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.367023:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xbc0ca3a9 (ffff9ed2456eff00) 00010000:00010000:1.0:1786002528.367025:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.367028:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841510b lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.367034:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841510b lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.367078:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150fd lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac88 expref: 30 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.367088:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:1.0:1786002528.367091:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002528.367095:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784150fd lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac88 expref: 30 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.367103:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c000, rc 0) 00000100:00100000:1.0:1786002528.367150:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18428:x1872758530915968:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 473us (708us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002528.367157:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23925 00000100:00100000:0.0:1786002528.391340:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.391428:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530916224 00000100:00100000:3.0:1786002528.391437:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530916224 00000100:00100000:3.0:1786002528.391513:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23926 00000100:00100000:3.0:1786002528.391531:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:18428:x1872758530916224:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:3.0:1786002528.391560:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.391589:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578415112 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac8f expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.391666:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578415119 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.391681:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578415119 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.391692:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578415119 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.391705:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.391725:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578414edb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414ed4 expref: 9 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.391733:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.391762:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578414edb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578414ed4 expref: 9 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.391778:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560982272:0@lo:104: 00000100:00100000:3.0:1786002528.391821:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.391899:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d540 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.391995:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560982272 00000100:00100000:1.0:1786002528.392001:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560982272 00000100:00100000:1.0:1786002528.392037:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1786002528.392044:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:14496:x1872758560982272:12345-0@lo:104: 00010000:00010000:1.0:1786002528.392064:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414edb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.392115:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786002528.392122:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:14496:x1872758560982272:12345-0@lo:104: Request processed in 79us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.392138:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1786002528.392383:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560982272:0@lo:104: 00010000:00010000:3.0:1786002528.392401:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.392517:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002528.392524:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414edb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.392532:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002528.392537:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578414edb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002528.392546:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578414edb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.392574:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414edb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.392580:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002528.392610:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414edb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.392617:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35e00/0x7cee4af578414ed4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414edb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.392634:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.392636:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.392637:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002528.392687:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560982400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002528.392734:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.392875:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560982400 00000100:00100000:0.0:1786002528.392880:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560982400 00010000:00010000:0.0:1786002528.392899:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578414edb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578414ed4 expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.392971:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1683 00000100:00100000:0.0:1786002528.392980:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3646:x1872758560982400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002528.392995:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1786002528.395350:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968578 is committed 00000020:00080000:0.0:1786002528.395361:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 418 batchid updated 00010000:00010000:1.0:1786002528.395475:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d400/0x7cee4af578414edb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578414ed4 expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.395496:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xbc0ca3a9 (ffff9ed2456c9300) 00010000:00010000:1.0:1786002528.395501:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.395511:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.395518:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.395551:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002528.395618:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3646:x1872758560982400:12345-0@lo:103:ldlm_bl.0 Request processed in 2639us (2882us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.395627:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1683 00000100:00100000:2.0:1786002528.395741:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560982400:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1786002528.395804:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 418 00000004:00080000:3.0:1786002528.395884:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245e3d540 with version 795 00000020:00080000:3.0:1786002528.395896:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 418 cancel update log [0x200000401:0x3:0x0].415: rc = 0 00000020:00080000:3.0:1786002528.395961:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 418 cancel update log [0x240000400:0x3:0x0].415: rc = 0 00000020:00080000:3.0:1786002528.395968:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 418 00000004:00080000:1.0:1786002528.396021:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 795 rpc_version 795 00000020:00100000:1.0:1786002528.396046:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002528.396064:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244ffb800 x1872758560982656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002528.396084:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffb800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560982656:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002528.396118:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.396145:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3455456c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.396195:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560982656 00000100:00100000:3.0:1786002528.396202:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560982656 00000100:00100000:3.0:1786002528.396250:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:3.0:1786002528.396260:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7466:x1872758560982656:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002528.396384:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:7466:x1872758560982656:12345-0@lo:1000:osp_up0-1.0 Request processed in 126us (265us total) trans 4294983603 rc 0/0 00000100:00100000:3.0:1786002528.396391:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000100:00100000:1.0:1786002528.396547:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffb800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560982656:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1786002528.396660:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396669:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396775:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415127 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396786:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415127 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396794:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415127 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002528.396805:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19e:0x0]: returning size 2 00010000:00010000:0.0:1786002528.396885:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578415119 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396893:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578415119 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396900:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578415119 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396907:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578415119 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396913:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.396918:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578415119 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396925:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578415119 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396936:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:0.0:1786002528.396939:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.396942:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578415119 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396949:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4c00/0x7cee4af578415119 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396963:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396973:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396979:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396984:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.396987:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396993:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.396999:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xbc0ca3a9 (ffff9ed2456c9300) 00010000:00010000:0.0:1786002528.397001:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.397004:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.397010:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af578415120 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.397066:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4400/0x7cee4af578415112 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac8f expref: 14 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.397082:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415127 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac8f expref: 13 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.397090:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:0.0:1786002528.397092:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002528.397095:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35a00, rc 0) 00000100:00100000:0.0:1786002528.397145:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:18428:x1872758530916224:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 5617us (5814us total) trans 4294968579 rc 0/0 00000100:00100000:0.0:1786002528.397152:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23926 00000100:00100000:0.0:1786002528.411814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.411918:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530916352 00000100:00100000:1.0:1786002528.411927:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530916352 00000100:00100000:1.0:1786002528.411981:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5227 00000100:00100000:1.0:1786002528.411991:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758530916352:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002528.412011:0:14676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.412031:0:14676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c72fde03/0x7cee4af578415135 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac96 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002528.412065:0:14676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cb:0x0] initial LVB size: 2, mtime: 0x6a743c5e, atime: 0x0, ctime: 0x6a743c5e, blocks: 0x8 00010000:00010000:1.0:1786002528.412087:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=888s v=(0 0) 00010000:00010000:1.0:1786002528.412091:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002528.412100:0:14676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c72fde03/0x7cee4af578415135 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac96 expref: 8 pid: 14676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.412117:0:14676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c72fde03/0x7cee4af578415135 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac96 expref: 8 pid: 14676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.412131:0:14676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d400, rc 0) 00000100:00100000:1.0:1786002528.412187:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758530916352:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 197us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.412194:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5227 00000100:00100000:3.0:1786002528.417421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002528.417511:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530916480 00000100:00100000:0.0:1786002528.417520:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530916480 00002000:00100000:0.0:1786002528.417567:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9cb:0x0] (0->4095) req@ffff9ed366d6c000 x1872758530916480/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:209/0 lens 488/0 e 0 to 0 dl 1786002539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002528.417580:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed366d6c000 with x1872758530916480 ext(0->4095) 00002000:00010000:0.0:1786002528.417585:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed366d6c000 00000100:00100000:0.0:1786002528.417618:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 12 00000100:00100000:0.0:1786002528.417628:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758530916480:12345-192.168.203.49@tcp:3:cmp.0 00000100:00100000:0.0:1786002528.417787:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758530916480:12345-192.168.203.49@tcp:3:cmp.0 Request processed in 159us (374us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786002528.417795:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 12 00002000:00100000:0.0:1786002528.417802:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9cb:0x0] (0->4095) req@ffff9ed366d6c000 x1872758530916480/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:209/0 lens 488/4536 e 0 to 0 dl 1786002539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002528.417810:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed366d6c000 with x1872758530916480 ext(0->4095) 00002000:00010000:0.0:1786002528.417814:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed366d6c000 00000100:00100000:0.0:1786002528.427477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.427566:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530916736 00000100:00100000:2.0:1786002528.427575:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530916736 00000100:00100000:2.0:1786002528.427634:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5110 00000100:00100000:2.0:1786002528.427645:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:18428:x1872758530916736:12345-192.168.203.49@tcp:35:cmp.0 00000100:00100000:2.0:1786002528.427968:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18428:x1872758530916736:12345-192.168.203.49@tcp:35:cmp.0 Request processed in 324us (498us total) trans 4294968580 rc 0/0 00000100:00100000:2.0:1786002528.427976:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5110 00000100:00100000:3.0:1786002528.456310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.456403:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530916992 00000100:00100000:1.0:1786002528.456413:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530916992 00000100:00100000:1.0:1786002528.456487:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23927 00000100:00100000:1.0:1786002528.456498:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18430:x1872758530916992:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002528.456519:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.456540:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af57841513c lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ac9d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456614:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578415143 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456628:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578415143 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456640:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578415143 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456651:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af57841514a lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456658:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af57841514a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456664:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af57841514a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456701:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578415143 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456709:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578415143 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456724:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578415143 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456731:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578415143 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456738:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.456742:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578415143 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456749:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578415143 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456761:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:1.0:1786002528.456764:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.456769:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578415143 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456775:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af578415143 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456788:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af57841514a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456795:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af57841514a lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456801:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af57841514a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456807:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8de00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.456810:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af57841514a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456815:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af57841514a lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456822:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x84832a57 (ffff9ed24556ed00) 00010000:00010000:1.0:1786002528.456825:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.456827:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af57841514a lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456834:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af57841514a lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456916:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af57841513c lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac9d expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456926:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:1.0:1786002528.456929:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002528.456932:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af57841513c lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac9d expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.456942:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c000, rc 0) 00000100:00100000:1.0:1786002528.456989:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18430:x1872758530916992:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 493us (688us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002528.456997:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23927 00000100:00100000:3.0:1786002528.466920:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.467000:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530917248 00000100:00100000:2.0:1786002528.467010:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530917248 00000100:00100000:2.0:1786002528.467072:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23928 00000100:00100000:2.0:1786002528.467082:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18430:x1872758530917248:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:2.0:1786002528.467102:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.467120:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578415151 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aca4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.467185:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578415158 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.467197:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578415158 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.467208:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578415158 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.467218:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.467232:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414da0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414d92 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.467250:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.467279:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414da0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578414d92 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002528.467295:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560982784:0@lo:104: 00000100:00100000:2.0:1786002528.467335:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.467376:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.467487:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560982784 00000100:00100000:3.0:1786002528.467491:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560982784 00000100:00100000:3.0:1786002528.467527:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1786002528.467536:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6521:x1872758560982784:12345-0@lo:104: 00010000:00010000:3.0:1786002528.467547:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414da0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.467606:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786002528.467612:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6521:x1872758560982784:12345-0@lo:104: Request processed in 78us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.467619:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00010000:00010000:3.0:1786002528.467641:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002528.467647:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414da0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.467655:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228600 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002528.467660:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578414da0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002528.467669:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578414da0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.467694:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414da0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.467701:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002528.467731:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414da0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.467738:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228600/0x7cee4af578414d92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414da0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.467758:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.467760:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.467762:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002528.467770:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002528.467780:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560982912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002528.467808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.467834:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560982912 00000100:00100000:3.0:1786002528.467838:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560982912 00010000:00010000:3.0:1786002528.467880:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414da0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578414d92 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.467899:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684 00000100:00100000:3.0:1786002528.467905:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3646:x1872758560982912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002528.467913:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1786002528.468577:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758560982784:0@lo:104: 00010000:00010000:2.0:1786002528.468596:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002528.469757:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968580 is committed 00010000:00010000:0.0:1786002528.469903:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578414da0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578414d92 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.469920:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x84832a57 (ffff9ed2456efa00) 00010000:00010000:0.0:1786002528.469924:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.469934:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.469941:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.469969:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002528.470026:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3646:x1872758560982912:12345-0@lo:103:ldlm_bl.0 Request processed in 2121us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.470035:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684 00010000:00010000:2.0:1786002528.470114:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470122:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470224:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578415166 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470247:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578415166 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470255:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578415166 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002528.470267:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19b:0x0]: returning size 3 00010000:00010000:2.0:1786002528.470349:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578415158 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470357:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578415158 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470364:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578415158 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470371:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578415158 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470377:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.470381:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578415158 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470389:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578415158 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470398:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:2.0:1786002528.470401:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.470405:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578415158 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470411:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b000/0x7cee4af578415158 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470422:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470433:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470439:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470444:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ae00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.470446:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470452:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470459:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x84832a57 (ffff9ed2456efa00) 00010000:00010000:2.0:1786002528.470461:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.470464:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470470:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ae00/0x7cee4af57841515f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470515:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a800/0x7cee4af578415151 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aca4 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470528:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578415166 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aca4 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.470534:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9ed24559fb00) 00010000:00010000:2.0:1786002528.470536:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002528.470539:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b800, rc 0) 00000100:00100000:2.0:1786002528.470593:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18430:x1872758530917248:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 3512us (3680us total) trans 4294968581 rc 0/0 00000100:00100000:2.0:1786002528.470600:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23928 00000100:00100000:3.0:1786002528.471365:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560982912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002528.488610:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.488700:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530917376 00000100:00100000:1.0:1786002528.488709:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530917376 00000100:00100000:1.0:1786002528.488769:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5228 00000100:00100000:1.0:1786002528.488778:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758530917376:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002528.488793:0:14686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.488812:0:14686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af578415174 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3acab expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002528.488834:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cd:0x0] initial LVB size: 3, mtime: 0x6a743c5e, atime: 0x0, ctime: 0x6a743c5e, blocks: 0x8 00010000:00010000:1.0:1786002528.488887:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=888s v=(0 0) 00010000:00010000:1.0:1786002528.488891:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002528.488900:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af578415174 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acab expref: 9 pid: 14686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.488922:0:14686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af578415174 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acab expref: 9 pid: 14686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.488934:0:14686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c000, rc 0) 00000100:00100000:1.0:1786002528.488982:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758530917376:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 205us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.488989:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5228 00000100:00100000:0.0:1786002528.506771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.506887:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530917504 00000100:00100000:2.0:1786002528.506897:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530917504 00002000:00100000:2.0:1786002528.506946:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9cd:0x0] (0->4095) req@ffff9ed2454c1c00 x1872758530917504/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:209/0 lens 488/0 e 0 to 0 dl 1786002539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002528.506955:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2454c1c00 with x1872758530917504 ext(0->4095) 00002000:00010000:2.0:1786002528.506961:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2454c1c00 00000100:00100000:2.0:1786002528.506981:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 13 00000100:00100000:2.0:1786002528.506990:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758530917504:12345-192.168.203.49@tcp:3:cmp.0 00000100:00100000:2.0:1786002528.507156:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758530917504:12345-192.168.203.49@tcp:3:cmp.0 Request processed in 166us (392us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786002528.507163:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 13 00002000:00100000:2.0:1786002528.507169:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9cd:0x0] (0->4095) req@ffff9ed2454c1c00 x1872758530917504/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:209/0 lens 488/4536 e 0 to 0 dl 1786002539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002528.507177:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2454c1c00 with x1872758530917504 ext(0->4095) 00002000:00010000:2.0:1786002528.507180:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2454c1c00 00000100:00100000:3.0:1786002528.521963:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.522313:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530917760 00000100:00100000:2.0:1786002528.522323:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530917760 00000100:00100000:2.0:1786002528.522379:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5111 00000100:00100000:2.0:1786002528.522389:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:18430:x1872758530917760:12345-192.168.203.49@tcp:35:cmp.0 00000100:00100000:2.0:1786002528.522644:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18430:x1872758530917760:12345-192.168.203.49@tcp:35:cmp.0 Request processed in 256us (689us total) trans 4294968582 rc 0/0 00000100:00100000:2.0:1786002528.522657:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5111 00000100:00100000:0.0:1786002528.554489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.554568:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530918016 00000100:00100000:2.0:1786002528.554578:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530918016 00000100:00100000:2.0:1786002528.554637:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23929 00000100:00100000:2.0:1786002528.554649:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18432:x1872758530918016:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:2.0:1786002528.554667:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.554686:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841517b lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3acb2 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554765:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578415182 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554778:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578415182 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554789:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578415182 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554800:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415189 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554807:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415189 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554814:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415189 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554868:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578415182 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554880:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578415182 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554887:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578415182 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554894:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578415182 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554900:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ae00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.554904:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578415182 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554912:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578415182 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554923:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002528.554926:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.554930:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578415182 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554937:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af578415182 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554949:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415189 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554955:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415189 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554961:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415189 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554967:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.554970:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415189 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554976:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415189 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554983:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x391d5834 (ffff9ed2456ef300) 00010000:00010000:2.0:1786002528.554986:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.554988:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415189 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.554994:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415189 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.555022:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841517b lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acb2 expref: 30 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.555032:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002528.555034:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002528.555037:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841517b lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acb2 expref: 30 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.555046:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a800, rc 0) 00000100:00100000:2.0:1786002528.555109:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18432:x1872758530918016:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 462us (642us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002528.555116:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23929 00000100:00100000:0.0:1786002528.559277:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.559581:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530918272 00000100:00100000:2.0:1786002528.559590:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530918272 00000100:00100000:2.0:1786002528.559639:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23930 00000100:00100000:2.0:1786002528.559648:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18432:x1872758530918272:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:2.0:1786002528.559670:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.559689:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ac00/0x7cee4af578415190 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3acb9 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.559770:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af578415197 lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.559782:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af578415197 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.559793:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af578415197 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.559804:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.559815:0:10360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578414f44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414f3d expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.559823:0:10360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.559880:0:10360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578414f44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578414f3d expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002528.559895:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:10360:1872758560983040:0@lo:104: 00000100:00100000:2.0:1786002528.559941:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.559979:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.560037:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560983040 00000100:00100000:1.0:1786002528.560042:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560983040 00000100:00100000:1.0:1786002528.560083:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1786002528.560091:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10360:x1872758560983040:12345-0@lo:104: 00010000:00010000:1.0:1786002528.560103:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414f44 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.560156:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786002528.560162:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10360:x1872758560983040:12345-0@lo:104: Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.560169:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00010000:00010000:1.0:1786002528.560188:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002528.560193:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414f44 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.560201:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b600 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002528.560206:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578414f44 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002528.560218:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578414f44 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.560251:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414f44 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.560258:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002528.560278:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414f44 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.560286:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed243d2b600/0x7cee4af578414f3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414f44 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.560303:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002528.560305:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002528.560307:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.560318:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560983168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002528.560349:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.560381:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560983168 00000100:00100000:1.0:1786002528.560385:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560983168 00010000:00010000:1.0:1786002528.560402:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578414f44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578414f3d expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002528.560425:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:1.0:1786002528.560431:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3644:x1872758560983168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002528.560440:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1786002528.560743:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:10360:1872758560983040:0@lo:104: 00010000:00010000:1.0:1786002528.560761:0:10360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002528.565165:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968582 is committed 00010000:00010000:2.0:1786002528.565286:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578414f44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578414f3d expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.565303:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x391d5834 (ffff9ed2456ef200) 00010000:00010000:2.0:1786002528.565310:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.565318:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.565325:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.565356:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002528.565432:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1872758560983168:12345-0@lo:103:ldlm_bl.0 Request processed in 5000us (5081us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.565442:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00010000:00010000:1.0:1786002528.565691:0:10360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.565699:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.565814:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af5784151a5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.565825:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af5784151a5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.565833:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af5784151a5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002528.565872:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19f:0x0]: returning size 2 00010000:00010000:1.0:1786002528.565959:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af578415197 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.565967:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af578415197 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.565973:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af578415197 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.565980:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af578415197 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.565986:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.565991:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af578415197 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.565999:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af578415197 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.566008:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:1.0:1786002528.566011:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.566015:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af578415197 lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.566021:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a400/0x7cee4af578415197 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.566031:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.566037:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.566042:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.566047:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2bc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.566049:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.566067:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.566075:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x391d5834 (ffff9ed2456ef200) 00010000:00010000:1.0:1786002528.566077:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.566081:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.566086:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2bc00/0x7cee4af57841519e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.566130:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2ac00/0x7cee4af578415190 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acb9 expref: 16 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.566145:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af5784151a5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acb9 expref: 15 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.566152:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9ed244f15100) 00010000:00010000:1.0:1786002528.566154:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002528.566156:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8de00, rc 0) 00000100:00100000:1.0:1786002528.566200:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18432:x1872758530918272:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 6551us (6931us total) trans 4294968583 rc 0/0 00000100:00100000:1.0:1786002528.566207:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23930 00000100:00100000:3.0:1786002528.567167:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560983168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002528.579357:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.579432:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530918400 00000100:00100000:3.0:1786002528.579441:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530918400 00000100:00100000:3.0:1786002528.579502:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5229 00000100:00100000:3.0:1786002528.579512:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2412:x1872758530918400:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:3.0:1786002528.579531:0:14691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.579550:0:14691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a8598c9/0x7cee4af5784151b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3acc0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002528.579574:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cb:0x0] initial LVB size: 2, mtime: 0x6a743c5e, atime: 0x0, ctime: 0x6a743c5e, blocks: 0x8 00010000:00010000:3.0:1786002528.579594:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=888s v=(0 0) 00010000:00010000:3.0:1786002528.579598:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002528.579608:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a8598c9/0x7cee4af5784151b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acc0 expref: 12 pid: 14691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.579641:0:14691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a8598c9/0x7cee4af5784151b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acc0 expref: 12 pid: 14691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.579655:0:14691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228600, rc 0) 00000100:00100000:3.0:1786002528.579722:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530918400:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 202us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.579730:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5229 00000100:00100000:0.0:1786002528.585618:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.585711:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530918528 00000100:00100000:1.0:1786002528.585728:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530918528 00000100:00100000:1.0:1786002528.585787:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3981 00000100:00100000:1.0:1786002528.585798:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2413:x1872758530918528:12345-192.168.203.49@tcp:63:ll_sa.0 00010000:00010000:1.0:1786002528.585833:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.585883:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784151ba lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3acc7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.585937:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784151c1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.585954:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784151c1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.585964:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784151c1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.585980:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151c8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.585987:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151c8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.585994:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151c8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586031:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784151c1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586038:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784151c1 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586044:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784151c1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586051:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.586060:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784151c1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586067:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784151c1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586078:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:1.0:1786002528.586082:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.586086:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784151c1 lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586091:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784151c1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586102:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151c8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586107:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151c8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586113:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151c8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586118:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.586120:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151c8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586126:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151c8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586134:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x18618557 (ffff9ed2456ef600) 00010000:00010000:1.0:1786002528.586136:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.586139:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151c8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586144:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151c8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586169:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784151ba lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acc7 expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586179:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:1.0:1786002528.586182:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002528.586185:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784151ba lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acc7 expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.586194:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c600, rc -2) 00000100:00100000:1.0:1786002528.586249:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2413:x1872758530918528:12345-192.168.203.49@tcp:63:ll_sa.0 Request processed in 452us (640us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002528.586257:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3981 00000100:00100000:0.0:1786002528.592228:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.592309:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530918656 00000100:00100000:2.0:1786002528.592319:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530918656 00002000:00100000:2.0:1786002528.592362:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->4095) req@ffff9ed2455fa300 x1872758530918656/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:209/0 lens 488/0 e 0 to 0 dl 1786002539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002528.592373:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455fa300 with x1872758530918656 ext(0->4095) 00002000:00010000:2.0:1786002528.592378:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455fa300 00000100:00100000:2.0:1786002528.592408:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 14 00000100:00100000:2.0:1786002528.592416:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530918656:12345-192.168.203.49@tcp:3:cmp.0 00000100:00100000:2.0:1786002528.592557:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530918656:12345-192.168.203.49@tcp:3:cmp.0 Request processed in 139us (336us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786002528.592568:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 14 00002000:00100000:2.0:1786002528.592575:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9cb:0x0] (0->4095) req@ffff9ed2455fa300 x1872758530918656/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:209/0 lens 488/4536 e 0 to 0 dl 1786002539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002528.592583:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455fa300 with x1872758530918656 ext(0->4095) 00002000:00010000:2.0:1786002528.592586:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455fa300 00000100:00100000:0.0:1786002528.597048:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.597182:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530918784 00000100:00100000:1.0:1786002528.597192:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530918784 00000100:00100000:1.0:1786002528.597254:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 513 00000100:00100000:1.0:1786002528.597264:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758530918784:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002528.597333:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758530918784:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 70us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.597341:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 513 00000100:00100000:0.0:1786002528.605597:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.605886:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530919040 00000100:00100000:2.0:1786002528.605895:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530919040 00000100:00100000:2.0:1786002528.605944:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5112 00000100:00100000:2.0:1786002528.605954:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:18432:x1872758530919040:12345-192.168.203.49@tcp:35:cmp.0 00000100:00100000:2.0:1786002528.606353:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18432:x1872758530919040:12345-192.168.203.49@tcp:35:cmp.0 Request processed in 399us (763us total) trans 4294968584 rc 0/0 00000100:00100000:2.0:1786002528.606360:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5112 00000100:00100000:1.0:1786002528.619792:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560983296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002528.619881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.619966:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560983296 00000100:00100000:3.0:1786002528.619974:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560983296 00000100:00100000:3.0:1786002528.620011:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:3.0:1786002528.620019:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:3645:x1872758560983296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786002528.620062:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444061184 avail 1297821696 00000100:00100000:3.0:1786002528.620108:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:3645:x1872758560983296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.620115:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:1.0:1786002528.620231:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560983296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002528.629215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.629286:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530919296 00000100:00100000:2.0:1786002528.629295:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530919296 00000100:00100000:2.0:1786002528.629347:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23931 00000100:00100000:2.0:1786002528.629357:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18436:x1872758530919296:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:2.0:1786002528.629377:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.629395:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af5784151cf lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ace3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629462:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784151d6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629485:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784151d6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629501:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784151d6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629513:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784151dd lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629520:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784151dd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629527:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784151dd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629563:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784151d6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629570:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784151d6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629576:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784151d6 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629582:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784151d6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629588:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.629592:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784151d6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629599:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784151d6 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629610:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002528.629614:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.629619:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784151d6 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629625:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af5784151d6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629638:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784151dd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629643:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784151dd lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629648:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784151dd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629654:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ae00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.629656:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784151dd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629662:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784151dd lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629670:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x18618557 (ffff9ed2456ef600) 00010000:00010000:2.0:1786002528.629673:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.629676:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784151dd lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629682:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784151dd lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629709:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af5784151cf lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ace3 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629730:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002528.629732:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002528.629736:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af5784151cf lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ace3 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.629746:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a800, rc 0) 00000100:00100000:2.0:1786002528.629803:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18436:x1872758530919296:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 446us (594us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002528.629810:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23931 00000100:00100000:0.0:1786002528.637682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.637824:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530919552 00000100:00100000:1.0:1786002528.637834:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530919552 00000100:00100000:1.0:1786002528.637908:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23932 00000100:00100000:1.0:1786002528.637917:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18436:x1872758530919552:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002528.637939:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.637957:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af5784151e4 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3acea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.638025:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151eb lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.638037:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151eb lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.638048:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151eb lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.638068:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.638078:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414fad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414fa6 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.638085:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.638113:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414fad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578414fa6 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002528.638127:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758560983424:0@lo:104: 00000100:00100000:1.0:1786002528.638172:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.638211:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed353790240 going to sleep for 11 seconds 00000100:00100000:2.0:1786002528.638320:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1786002528.638332:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560983424 00000100:00100000:2.0:1786002528.638336:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560983424 00000100:00100000:2.0:1786002528.638366:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:2.0:1786002528.638373:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bf22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6520:x1872758560983424:12345-0@lo:104: 00010000:00010000:2.0:1786002528.638384:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414fad expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.638438:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786002528.638444:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bf22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6520:x1872758560983424:12345-0@lo:104: Request processed in 72us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.638450:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:3.0:1786002528.638546:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758560983424:0@lo:104: 00010000:00010000:3.0:1786002528.638563:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.638662:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002528.638670:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414fad expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.638679:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002528.638684:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578414fad expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002528.638709:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578414fad expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.638745:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414fad expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.638752:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002528.638782:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414fad expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.638789:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed244f35000/0x7cee4af578414fa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414fad expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.638806:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.638808:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.638809:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002528.638910:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002528.638922:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560983552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002528.638952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.639090:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560983552 00000100:00100000:0.0:1786002528.639094:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560983552 00010000:00010000:0.0:1786002528.639112:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414fad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578414fa6 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.639133:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:0.0:1786002528.639140:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1872758560983552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002528.639149:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1786002528.642271:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968584 is committed 00010000:00010000:3.0:1786002528.642683:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2423b4a00/0x7cee4af578414fad lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578414fa6 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.642770:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x18618557 (ffff9ed24556e500) 00010000:00010000:3.0:1786002528.642777:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.642788:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.642796:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.643013:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002528.643137:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1872758560983552:12345-0@lo:103:ldlm_bl.0 Request processed in 3996us (4183us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.643148:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00100000:2.0:1786002528.643326:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560983552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002528.643377:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.643386:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.643835:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af5784151f9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.643948:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af5784151f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.643959:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af5784151f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002528.643971:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a0:0x0]: returning size 2 00010000:00010000:1.0:1786002528.644104:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151eb lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644113:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151eb lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644120:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151eb lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644127:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151eb lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644133:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.644137:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151eb lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644145:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151eb lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644154:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:1.0:1786002528.644158:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.644162:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151eb lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644168:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ce00/0x7cee4af5784151eb lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644180:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644186:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644192:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644198:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.644200:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644206:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644213:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x18618557 (ffff9ed24556e500) 00010000:00010000:1.0:1786002528.644215:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.644218:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644223:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d000/0x7cee4af5784151f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644324:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af5784151e4 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acea expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644342:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af5784151f9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acea expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.644350:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9ed244f15800) 00010000:00010000:1.0:1786002528.644352:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002528.644355:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8cc00, rc 0) 00000100:00100000:1.0:1786002528.644436:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18436:x1872758530919552:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 6519us (6760us total) trans 4294968585 rc 0/0 00000100:00100000:1.0:1786002528.644444:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23932 00000100:00100000:0.0:1786002528.648708:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.648994:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530919680 00000100:00100000:2.0:1786002528.649003:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530919680 00000100:00100000:2.0:1786002528.649087:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5230 00000100:00100000:2.0:1786002528.649098:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758530919680:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:2.0:1786002528.649114:0:14685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.649132:0:14685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af578415207 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3acf1 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002528.649154:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cc:0x0] initial LVB size: 2, mtime: 0x6a743c5e, atime: 0x0, ctime: 0x6a743c5e, blocks: 0x8 00010000:00010000:2.0:1786002528.649173:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=888s v=(0 0) 00010000:00010000:2.0:1786002528.649178:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002528.649186:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af578415207 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acf1 expref: 10 pid: 14685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.649202:0:14685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af578415207 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acf1 expref: 10 pid: 14685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.649214:0:14685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a800, rc 0) 00000100:00100000:2.0:1786002528.649359:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758530919680:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 262us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.649367:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5230 00000100:00100000:0.0:1786002528.655734:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.655819:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530919808 00000100:00100000:2.0:1786002528.655829:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530919808 00002000:00100000:2.0:1786002528.656033:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9cc:0x0] (0->4095) req@ffff9ed2455f8a80 x1872758530919808/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:209/0 lens 488/0 e 0 to 0 dl 1786002539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002528.656044:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455f8a80 with x1872758530919808 ext(0->4095) 00002000:00010000:2.0:1786002528.656060:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2455f8a80 00000100:00100000:2.0:1786002528.656089:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 15 00000100:00100000:2.0:1786002528.656100:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2411:x1872758530919808:12345-192.168.203.49@tcp:3:cmp.0 00000100:00100000:2.0:1786002528.656253:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2411:x1872758530919808:12345-192.168.203.49@tcp:3:cmp.0 Request processed in 154us (527us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1786002528.656261:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 15 00002000:00100000:2.0:1786002528.656268:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9cc:0x0] (0->4095) req@ffff9ed2455f8a80 x1872758530919808/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:209/0 lens 488/4536 e 0 to 0 dl 1786002539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002528.656276:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455f8a80 with x1872758530919808 ext(0->4095) 00002000:00010000:2.0:1786002528.656280:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2455f8a80 00000100:00100000:1.0:1786002528.663333:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.663415:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530920064 00000100:00100000:3.0:1786002528.663424:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530920064 00000100:00100000:3.0:1786002528.663483:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5113 00000100:00100000:3.0:1786002528.663492:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:18436:x1872758530920064:12345-192.168.203.49@tcp:35:cmp.0 00000100:00100000:3.0:1786002528.663781:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18436:x1872758530920064:12345-192.168.203.49@tcp:35:cmp.0 Request processed in 288us (455us total) trans 4294968586 rc 0/0 00000100:00100000:3.0:1786002528.663789:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5113 00000100:00100000:1.0:1786002528.685772:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.685892:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530920320 00000100:00100000:2.0:1786002528.685902:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530920320 00000100:00100000:2.0:1786002528.686042:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23933 00000100:00100000:2.0:1786002528.686063:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18438:x1872758530920320:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:2.0:1786002528.686085:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.686105:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af57841520e lrc: 2/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3acf8 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686180:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415215 lrc: 3/1,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686194:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415215 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686204:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415215 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686218:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841521c lrc: 3/1,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686225:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841521c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686230:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841521c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686279:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415215 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686287:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415215 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686292:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415215 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686298:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415215 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686303:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.686308:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415215 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686314:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415215 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686325:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002528.686328:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.686333:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415215 lrc: 3/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686340:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415215 lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686353:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841521c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686360:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841521c lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686366:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841521c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686370:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.686372:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841521c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686377:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841521c lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686383:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xb62e0cbf (ffff9ed24556e400) 00010000:00010000:2.0:1786002528.686385:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.686388:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841521c lrc: 2/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686392:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841521c lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686421:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af57841520e lrc: 1/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acf8 expref: 30 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686437:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002528.686439:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002528.686442:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af57841520e lrc: 0/0,0 mode: --/CR res: [0x200000400:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acf8 expref: 30 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.686452:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2ae00, rc 0) 00000100:00100000:2.0:1786002528.686660:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18438:x1872758530920320:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 607us (894us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002528.686668:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23933 00000100:00100000:1.0:1786002528.690388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002528.690750:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530920576 00000100:00100000:0.0:1786002528.690759:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530920576 00000100:00100000:0.0:1786002528.690821:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23934 00000100:00100000:0.0:1786002528.690831:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18438:x1872758530920576:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:0.0:1786002528.690881:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002528.690901:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578415223 lrc: 2/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3acff expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.690964:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841522a lrc: 3/1,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.690976:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841522a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.690998:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841522a lrc: 3/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.691008:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.691017:0:14496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414e72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578414e6b expref: 5 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.691025:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.691062:0:14496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414e72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578414e6b expref: 5 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.691075:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560983680:0@lo:104: 00000100:00100000:0.0:1786002528.691114:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.691146:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d463c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002528.691823:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560983680 00000100:00100000:2.0:1786002528.691829:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560983680 00000100:00100000:2.0:1786002528.692028:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1786002528.692037:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:14496:x1872758560983680:12345-0@lo:104: 00010000:00010000:2.0:1786002528.692059:0:17237:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414e72 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.692122:0:17237:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786002528.692129:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:14496:x1872758560983680:12345-0@lo:104: Request processed in 94us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.692135:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00010000:00010000:3.0:1786002528.692178:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002528.692185:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578414e72 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.692194:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228c00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002528.692199:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578414e72 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002528.692209:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578414e72 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.692253:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414e72 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.692260:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002528.692279:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414e72 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.692287:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9ed35a228c00/0x7cee4af578414e6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578414e72 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.692307:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.692309:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.692311:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002528.692317:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002528.692326:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560983808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002528.692356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.692642:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:14496:1872758560983680:0@lo:104: 00010000:00010000:0.0:1786002528.692660:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002528.692742:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560983808 00000100:00100000:1.0:1786002528.692747:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560983808 00010000:00010000:1.0:1786002528.692766:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414e72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578414e6b expref: 6 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002528.692826:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:1.0:1786002528.692834:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1872758560983808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002528.692843:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1786002528.694311:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968586 is committed 00010000:00010000:1.0:1786002528.694409:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af578414e72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578414e6b expref: 6 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.694425:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xb62e0cbf (ffff9ed2456c9b00) 00010000:00010000:1.0:1786002528.694430:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.694440:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.694447:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.694479:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002528.694536:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560983808:12345-0@lo:103:ldlm_bl.0 Request processed in 1702us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.694543:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000100:00100000:2.0:1786002528.694762:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560983808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002528.694812:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.694820:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.694951:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578415238 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.694962:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578415238 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.694970:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578415238 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002528.694981:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19d:0x0]: returning size 2 00010000:00010000:0.0:1786002528.695071:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841522a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695079:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841522a lrc: 4/1,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695085:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841522a lrc: 3/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695097:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841522a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695103:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.695106:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841522a lrc: 4/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695114:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841522a lrc: 5/0,0 mode: CR/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695124:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:0.0:1786002528.695127:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.695130:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841522a lrc: 3/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695137:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841522a lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695148:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695154:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695161:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695166:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.695169:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695179:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695186:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xb62e0cbf (ffff9ed2456c9b00) 00010000:00010000:0.0:1786002528.695189:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.695191:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695198:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578415231 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695248:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578415223 lrc: 0/0,0 mode: --/CR res: [0x240000400:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acff expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695262:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578415238 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acff expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.695270:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9ed2456ef800) 00010000:00010000:0.0:1786002528.695272:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002528.695274:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35800, rc 0) 00000100:00100000:0.0:1786002528.695324:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18438:x1872758530920576:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 4494us (4944us total) trans 4294968587 rc 0/0 00000100:00100000:0.0:1786002528.695332:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23934 00000100:00100000:3.0:1786002528.702985:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.703322:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530920704 00000100:00100000:1.0:1786002528.703332:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530920704 00000100:00100000:1.0:1786002528.703384:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5231 00000100:00100000:1.0:1786002528.703394:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530920704:12345-192.168.203.49@tcp:101:cmp.0 00010000:00010000:1.0:1786002528.703410:0:14678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.703429:0:14678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000515dfc57/0x7cee4af578415246 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad06 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002528.703451:0:14678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cc:0x0] initial LVB size: 2, mtime: 0x6a743c5e, atime: 0x0, ctime: 0x6a743c5e, blocks: 0x8 00010000:00010000:1.0:1786002528.703471:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=888s v=(0 0) 00010000:00010000:1.0:1786002528.703476:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002528.703485:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000515dfc57/0x7cee4af578415246 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad06 expref: 13 pid: 14678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.703501:0:14678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000515dfc57/0x7cee4af578415246 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad06 expref: 13 pid: 14678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.703520:0:14678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d000, rc 0) 00000100:00100000:1.0:1786002528.703579:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758530920704:12345-192.168.203.49@tcp:101:cmp.0 Request processed in 185us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.703585:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5231 00000100:00100000:2.0:1786002528.709338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.709404:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530920832 00000100:00100000:3.0:1786002528.709413:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530920832 00002000:00100000:3.0:1786002528.709458:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->4095) req@ffff9ed24662aa00 x1872758530920832/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:209/0 lens 488/0 e 0 to 0 dl 1786002539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002528.709468:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed24662aa00 with x1872758530920832 ext(0->4095) 00002000:00010000:3.0:1786002528.709473:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed24662aa00 00000100:00100000:3.0:1786002528.709501:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 16 00000100:00100000:3.0:1786002528.709509:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2413:x1872758530920832:12345-192.168.203.49@tcp:3:cmp.0 00000100:00100000:3.0:1786002528.709672:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2413:x1872758530920832:12345-192.168.203.49@tcp:3:cmp.0 Request processed in 162us (343us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786002528.709680:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 16 00002000:00100000:3.0:1786002528.709686:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9cc:0x0] (0->4095) req@ffff9ed24662aa00 x1872758530920832/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:209/0 lens 488/4536 e 0 to 0 dl 1786002539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002528.709693:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed24662aa00 with x1872758530920832 ext(0->4095) 00002000:00010000:3.0:1786002528.709696:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed24662aa00 00000100:00100000:2.0:1786002528.716557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002528.717032:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530921088 00000100:00100000:0.0:1786002528.717043:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530921088 00000100:00100000:0.0:1786002528.717104:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5114 00000100:00100000:0.0:1786002528.717114:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18438:x1872758530921088:12345-192.168.203.49@tcp:35:cmp.0 00000100:00100000:0.0:1786002528.717390:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18438:x1872758530921088:12345-192.168.203.49@tcp:35:cmp.0 Request processed in 276us (841us total) trans 4294968588 rc 0/0 00000100:00100000:0.0:1786002528.717398:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5114 00000100:00100000:1.0:1786002528.727413:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.727574:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530921216 00000100:00100000:2.0:1786002528.727582:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530921216 00000100:00100000:2.0:1786002528.727636:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 3983 00000100:00100000:2.0:1786002528.727645:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2412:x1872758530921216:12345-192.168.203.49@tcp:63:ll_sa.0 00010000:00010000:2.0:1786002528.727677:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.727694:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841524d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad0d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727757:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415254 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727770:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415254 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727779:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415254 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727794:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af57841525b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727800:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af57841525b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727806:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af57841525b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727899:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415254 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727907:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415254 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727913:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415254 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727924:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.727928:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415254 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727935:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415254 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727946:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002528.727949:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.727953:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415254 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727959:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415254 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727971:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af57841525b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727977:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af57841525b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727982:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af57841525b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727986:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.727989:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af57841525b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.727994:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af57841525b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.728004:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x861f4748 (ffff9ed24559ff00) 00010000:00010000:2.0:1786002528.728006:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.728008:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af57841525b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.728013:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af57841525b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x861f4748 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.728042:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841524d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad0d expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.728113:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002528.728116:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002528.728121:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841524d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad0d expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.728131:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2ba00, rc -2) 00000100:00100000:2.0:1786002528.728229:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2412:x1872758530921216:12345-192.168.203.49@tcp:63:ll_sa.0 Request processed in 583us (823us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002528.728246:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 3983 00000100:00100000:2.0:1786002528.736961:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.737084:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530921344 00000100:00100000:1.0:1786002528.737094:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530921344 00000100:00100000:1.0:1786002528.737154:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23935 00000100:00100000:1.0:1786002528.737164:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18439:x1872758530921344:12345-192.168.203.49@tcp:41:rm.0 00000004:00000024:1.0:1786002528.737213:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847006208 avail 7383703552 00000100:00100000:1.0:1786002528.737285:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:18439:x1872758530921344:12345-192.168.203.49@tcp:41:rm.0 Request processed in 123us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.737292:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23935 00000100:00100000:1.0:1786002528.742665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002528.742776:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530921600 00000100:00100000:0.0:1786002528.742784:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530921600 00000100:00100000:0.0:1786002528.742879:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23936 00000100:00100000:0.0:1786002528.742892:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18439:x1872758530921600:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002528.742945:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002528.742968:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8cc00/0x7cee4af5784151f9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acea expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.742984:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9ed244f15800) 00010000:00010000:0.0:1786002528.742993:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002528.743033:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.743041:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.743050:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.743081:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560983936:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1786002528.743124:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.743153:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d463c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.743263:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560983936 00000100:00100000:3.0:1786002528.743267:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560983936 00000100:00100000:3.0:1786002528.743302:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:3.0:1786002528.743309:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560983936:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1786002528.743319:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.743331:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415269 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578415262 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.743351:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415016 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac3b expref: 28 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.743360:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415269 lrc: 4/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578415262 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.743382:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415016 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac3b expref: 28 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.743394:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415016 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac3b expref: 28 pid: 14496 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.743405:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6525:1872758560984064:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002528.743456:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002528.746738:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6525:1872758560984064:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002528.746772:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415269 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578415262 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.746785:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:0.0:1786002528.746788:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.746792:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415269 lrc: 3/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578415262 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.746801:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228c00, rc 0) 00000100:00100000:0.0:1786002528.746880:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:6522:x1872758560983936:12345-0@lo:101:mdt00_002.0 Request processed in 3570us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.746889:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:1.0:1786002528.747154:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560983936:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002528.747171:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 4/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.747182:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 4/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002528.748887:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.749214:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530921728 00000100:00100000:2.0:1786002528.749223:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530921728 00010000:00010000:2.0:1786002528.749269:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415016 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac3b expref: 29 pid: 14496 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002528.749305:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1688 00000100:00100000:2.0:1786002528.749316:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2413:x1872758530921728:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002528.749331:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002528.749338:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415016 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac3b expref: 29 pid: 14496 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.749351:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415016 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac3b expref: 29 pid: 14496 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.749371:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415016 lrc: 0/0,0 mode: --/PR res: [0x200000400:0xd6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac3b expref: 29 pid: 14496 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.749385:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002528.749391:0:10399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415269 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578415262 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.749403:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415269 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578415262 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.749411:0:10399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415269 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578415262 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.749443:0:10399:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415269 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578415262 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002528.749457:0:10399:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:10399:1872758560984192:0@lo:105: 00000100:00100000:2.0:1786002528.749498:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.749537:0:10399:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f480 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.749719:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560984192 00000100:00100000:1.0:1786002528.749724:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560984192 00000100:00100000:1.0:1786002528.749763:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:1.0:1786002528.749770:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10399:x1872758560984192:12345-0@lo:105: 00010000:00010000:1.0:1786002528.749781:0:6503:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 5/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.749789:0:6503:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 5/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.749798:0:6503:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 5/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.749805:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.749812:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.749819:0:6503:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.749844:0:6503:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f35400) 00010000:00010000:0.0:1786002528.749954:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.749963:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002528.749984:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:0.0:1786002528.750014:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.750021:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.750030:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.750043:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560984320:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1786002528.750083:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.750099:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46900 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.750186:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10399:x1872758560984192:12345-0@lo:105: Request processed in 415us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.750194:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1786002528.750291:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560984320 00000100:00100000:2.0:1786002528.750296:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560984320 00000100:00100000:2.0:1786002528.750323:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:2.0:1786002528.750329:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6522:x1872758560984320:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1786002528.750344:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.750356:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415277 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578415270 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.750373:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 2/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.750381:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415277 lrc: 4/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578415270 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.750395:0:6526:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:2.0:1786002528.750423:0:6526:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1786002528.750457:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415277 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578415270 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.750465:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x18618557 (ffff9ed2456ef600) 00010000:00010000:2.0:1786002528.750468:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.750472:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415277 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578415270 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.750479:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2ba00, rc 0) 00000001:00080000:2.0:1786002528.751895:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983603 is committed 00000001:00080000:2.0:1786002528.751954:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983601 is committed 00000100:00100000:2.0:1786002528.752036:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560984320:12345-0@lo:101:mdt00_002.0 Request processed in 1705us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.752045:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00000100:00100000:1.0:1786002528.752322:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560984320:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002528.752338:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 4/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.752354:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 4/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.752465:0:10399:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:10399:1872758560984192:0@lo:105: 00010000:00010000:3.0:1786002528.752573:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002528.752650:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758530921728:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 3334us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.752659:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1688 00010000:00010000:0.0:1786002528.753024:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414dae lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753033:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414dae lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753039:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414dae lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753045:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.753118:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414dae lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753127:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414dae lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753139:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x84832a57 (ffff9ed24556ed00) 00010000:00010000:0.0:1786002528.753142:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.753146:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414dae lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753151:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578414dae lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753175:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753181:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753186:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753195:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.753198:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753203:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753209:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1545:0x0].0x0 (ffff9ed24556e300) 00010000:00010000:0.0:1786002528.753211:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1786002528.753213:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753218:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578414db5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1545:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753284:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414e17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753292:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414e17 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753298:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414e17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753303:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.753306:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414e17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753311:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414e17 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753322:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xdcc87686 (ffff9ed24556ea00) 00010000:00010000:0.0:1786002528.753324:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.753327:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414e17 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753333:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578414e17 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753345:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753350:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753356:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753360:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.753363:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753368:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753373:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1540:0x0].0x0 (ffff9ed24556e800) 00010000:00010000:0.0:1786002528.753375:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1786002528.753377:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753383:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578414e1e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1540:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753395:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578414e80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753401:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578414e80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753406:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578414e80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753410:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.753412:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578414e80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753417:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578414e80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753423:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xb62e0cbf (ffff9ed24556e400) 00010000:00010000:0.0:1786002528.753425:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.753427:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578414e80 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753432:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578414e80 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753442:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753446:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753452:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753457:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.753459:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753465:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753757:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1544:0x0].0x0 (ffff9ed366e57e00) 00010000:00010000:0.0:1786002528.753759:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1786002528.753762:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753768:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578414e87 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1544:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753785:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414ee9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753791:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414ee9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753797:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414ee9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753802:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.753804:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414ee9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753809:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414ee9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753819:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xbc0ca3a9 (ffff9ed2456eff00) 00010000:00010000:0.0:1786002528.753831:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.753835:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414ee9 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753840:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578414ee9 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753875:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753881:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753886:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753891:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.753894:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753900:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753908:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1541:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:0.0:1786002528.753910:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1786002528.753913:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753919:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578414ef0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1541:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753932:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414f52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753938:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414f52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753944:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414f52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753950:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.753952:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414f52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753958:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414f52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753964:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x391d5834 (ffff9ed2456ef300) 00010000:00010000:0.0:1786002528.753966:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.753969:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414f52 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753975:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578414f52 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753986:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753992:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.753997:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754002:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.754004:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754010:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754016:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1542:0x0].0x0 (ffff9ed3465ad300) 00010000:00010000:0.0:1786002528.754018:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1786002528.754020:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754026:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578414f59 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1542:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754036:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754042:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754058:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754064:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.754067:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754072:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754082:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x18618557 (ffff9ed2456ef600) 00010000:00010000:0.0:1786002528.754085:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.754089:0:3630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415277 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578415270 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754100:0:3630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415277 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578415270 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754108:0:3630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415277 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af578415270 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.754142:0:3630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415277 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578415270 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.754155:0:3630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3630:1872758560984448:0@lo:105: 00000100:00100000:0.0:1786002528.754195:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.754227:0:3630:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46840 going to sleep for 11 seconds 00000100:00100000:2.0:1786002528.754648:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560984448 00000100:00100000:2.0:1786002528.754655:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560984448 00000100:00100000:2.0:1786002528.754694:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1786002528.754703:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3630:x1872758560984448:12345-0@lo:105: 00010000:00010000:2.0:1786002528.754723:0:17237:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 5/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.754733:0:17237:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 5/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.754741:0:17237:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 5/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.754747:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 5/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.754753:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.754761:0:17237:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 6/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.754786:0:17237:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed244f35000) 00000100:00100000:2.0:1786002528.754824:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3630:x1872758560984448:12345-0@lo:105: Request processed in 121us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.754830:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:0.0:1786002528.756195:0:3630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3630:1872758560984448:0@lo:105: 00010000:00010000:0.0:1786002528.756217:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 2/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.756225:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578414fbb lrc: 0/0,0 mode: --/TXN res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.756249:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.756256:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.756263:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.756268:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.756271:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.756277:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.756288:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1543:0x0].0x0 (ffff9ed366e57900) 00010000:00010000:0.0:1786002528.756291:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:0.0:1786002528.756295:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.756300:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578414fc2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1543:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.756328:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.756338:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002528.756357:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00000100:00100000:0.0:1786002528.756404:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560984576:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786002528.756447:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.756486:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46000 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.756650:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560984576 00000100:00100000:1.0:1786002528.756657:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560984576 00000100:00100000:1.0:1786002528.756697:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:1.0:1786002528.756706:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560984576:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002528.756795:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560984576:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.756802:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00000100:00100000:2.0:1786002528.756894:0:6522:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983603 gen 2 00000004:00080000:2.0:1786002528.756900:0:6522:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983602 committed transno 4294983603 00000004:00080000:2.0:1786002528.756915:0:6522:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983603 committed transno 4294983603 00000100:00100000:2.0:1786002528.756925:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560984576:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786002528.756965:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560984704:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786002528.756992:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.757017:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f480 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.757078:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560984704 00000100:00100000:3.0:1786002528.757082:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560984704 00000100:00100000:3.0:1786002528.757115:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:3.0:1786002528.757123:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560984704:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786002528.757187:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560984704:12345-0@lo:1000:mdt00_002.0 Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.757193:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00000100:00100000:1.0:1786002528.757381:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560984704:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002528.757422:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560984832:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002528.757448:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.757529:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560984832 00000100:00100000:2.0:1786002528.757533:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560984832 00000100:00100000:2.0:1786002528.757562:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:2.0:1786002528.757569:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560984832:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786002528.757626:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560984832:12345-0@lo:1000:mdt00_002.0 Request processed in 57us (177us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002528.757633:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00000100:00100000:1.0:1786002528.757717:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.757731:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560984832:0@lo:1000:mdt00_002.0 00000004:00080000:1.0:1786002528.757748:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:1.0:1786002528.757755:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.757764:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.757772:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.757799:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786002528.757804:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:1.0:1786002528.757808:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.757815:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.757822:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.757840:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1786002528.757917:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18439:x1872758530921600:12345-192.168.203.49@tcp:36:rm.0 Request processed in 15026us (15259us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002528.757924:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23936 00010000:00010000:2.0:1786002528.760346:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002528.760359:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.760370:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002528.760377:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002528.760387:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.760429:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.760440:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002528.760473:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.760481:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35400/0x7cee4af578415262 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415269 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.760501:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002528.760505:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.760511:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002528.760515:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002528.760521:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.760537:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.760543:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002528.760548:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.760555:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35000/0x7cee4af578415270 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415277 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.760571:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002528.760573:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002528.760575:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002528.760819:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560984960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002528.760899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.760933:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786002528.760939:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560985088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002528.760959:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.761250:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560984960 00000100:00100000:2.0:1786002528.761257:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560984960 00000100:00100000:2.0:1786002528.761300:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560985088 00000100:00100000:2.0:1786002528.761303:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560985088 00000100:00100000:2.0:1786002528.761323:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:2.0:1786002528.761332:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3644:x1872758560984960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002528.761345:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002528.761362:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415269 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578415262 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.761382:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002528.761389:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002528.761421:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3644:x1872758560984960:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.761427:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:2.0:1786002528.761442:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:2.0:1786002528.761449:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af74c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3644:x1872758560985088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002528.761456:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002528.761465:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415277 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x18618557 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578415270 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.761490:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x18618557 (ffff9ed2456ef600) 00010000:00010000:2.0:1786002528.761496:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002528.761519:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af74c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758560985088:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.761525:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:0.0:1786002528.761732:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560985088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002528.761742:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560984960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002528.761948:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.762228:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002528.762346:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530921984 00000100:00100000:0.0:1786002528.762351:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530921984 00000100:00100000:0.0:1786002528.762416:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23937 00000100:00100000:0.0:1786002528.762423:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18439:x1872758530921984:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002528.762479:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002528.762495:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228800/0x7cee4af578415008 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac34 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.762509:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed24556e100) 00010000:00010000:0.0:1786002528.762519:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002528.762541:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841527e lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.762552:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841527e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.762561:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841527e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.762573:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578415285 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.762584:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578415285 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.762589:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578415285 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.762644:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841528c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.762651:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841528c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.762658:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841528c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002528.763075:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00010000:00010000:0.0:1786002528.763120:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578415293 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763129:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578415293 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763137:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578415293 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763144:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578415293 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763150:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578415293 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763155:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578415293 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763205:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002528.763222:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841528c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763228:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841528c lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763241:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841528c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763247:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.763251:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841528c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763258:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841528c lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763266:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002528.763268:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002528.763271:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841528c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763277:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841528c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763291:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841527e lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763296:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841527e lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763305:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841527e lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763311:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841527e lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763315:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.763317:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841527e lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763322:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841527e lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763329:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456ef900) 00010000:00010000:0.0:1786002528.763331:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.763333:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841527e lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763338:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af57841527e lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002528.763349:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d494e7e5 reply state 00000000d865e384 transno 4294968589 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578415285 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763358:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578415285 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.763363:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x18618557 (ffff9ed2456ef500) 00010000:00010000:0.0:1786002528.763365:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002528.763367:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002528.763429:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18439:x1872758530921984:12345-192.168.203.49@tcp:36:rm.0 Request processed in 1005us (1201us total) trans 4294968589 rc 0/0 00000100:00100000:0.0:1786002528.763436:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23937 00010000:00010000:3.0:1786002528.767333:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002528.767345:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578415293 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.767355:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002528.767359:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578415293 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.767367:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578415293 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.767382:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a0:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:3.0:1786002528.767385:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002528.767389:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578415293 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.767400:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578415293 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.767423:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.767425:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.767427:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.767642:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.767732:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530922240 00000100:00100000:2.0:1786002528.767741:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530922240 00000100:00100000:2.0:1786002528.767834:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23938 00000100:00100000:2.0:1786002528.767875:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18439:x1872758530922240:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:2.0:1786002528.767930:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002528.767946:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415127 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac8f expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.767958:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:2.0:1786002528.767964:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002528.768004:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.768012:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.768021:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002528.768042:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560985216:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1786002528.768145:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.768171:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a300 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.768224:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560985216 00000100:00100000:3.0:1786002528.768228:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560985216 00000100:00100000:3.0:1786002528.768268:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00100000:3.0:1786002528.768275:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:6521:x1872758560985216:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1786002528.768284:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.768297:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784152a1 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841529a expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.768317:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784152a1 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841529a expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.768328:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784152a1 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841529a expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.768335:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002528.768337:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.768339:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229800, rc 0) 00000100:00100000:3.0:1786002528.768379:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:6521:x1872758560985216:12345-0@lo:101:mdt00_001.0 Request processed in 104us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.768385:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00000100:00100000:0.0:1786002528.768593:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560985216:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1786002528.768609:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784152a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.768618:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784152a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002528.768635:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:0.0:1786002528.768654:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.768661:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.768669:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.768680:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560985344:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1786002528.768704:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.768732:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.768770:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560985344 00000100:00100000:3.0:1786002528.768774:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560985344 00000100:00100000:3.0:1786002528.768805:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:3.0:1786002528.768813:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6521:x1872758560985344:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1786002528.768820:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.768831:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784152af lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784152a8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.768871:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784152af lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784152a8 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.768882:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784152af lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784152a8 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.768889:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xbc0ca3a9 (ffff9ed245fedb00) 00010000:00010000:3.0:1786002528.768891:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.768894:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229200, rc 0) 00000100:00100000:3.0:1786002528.768925:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6521:x1872758560985344:12345-0@lo:101:mdt00_001.0 Request processed in 113us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.768931:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00000100:00100000:2.0:1786002528.768999:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560985344:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1786002528.769010:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784152af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.769023:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784152af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002528.769035:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00000100:00100000:2.0:1786002528.769077:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560985472:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786002528.769103:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.769123:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed244e2a300 going to sleep for 11 seconds 00000100:00100000:0.0:1786002528.769221:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560985472 00000100:00100000:0.0:1786002528.769225:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560985472 00000100:00100000:0.0:1786002528.769265:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:0.0:1786002528.769271:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6521:x1872758560985472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786002528.769331:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6521:x1872758560985472:12345-0@lo:1000:mdt00_001.0 Request processed in 59us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.769341:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00000100:00100000:0.0:1786002528.769365:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560985472:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786002528.769404:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560985600:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786002528.769429:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.769442:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46540 going to sleep for 11 seconds 00000100:00100000:0.0:1786002528.769453:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560985600 00000100:00100000:0.0:1786002528.769456:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560985600 00000100:00100000:0.0:1786002528.769620:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00100000:0.0:1786002528.769627:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6521:x1872758560985600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786002528.769697:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6521:x1872758560985600:12345-0@lo:1000:mdt00_001.0 Request processed in 70us (267us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786002528.769703:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000100:00100000:0.0:1786002528.769737:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6521:1872758560985600:0@lo:1000:mdt00_001.0 00000004:00080000:0.0:1786002528.769752:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:0.0:1786002528.769757:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784152a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.769765:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784152a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.769772:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784152a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.769789:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1786002528.769793:0:6521:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:0.0:1786002528.769801:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002528.769807:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784152a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.769815:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:0.0:1786002528.769819:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784152a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002528.769828:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784152a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.769871:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784152a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.769878:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786002528.769894:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784152a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.769902:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2b000/0x7cee4af57841529a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784152a1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.769915:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.769917:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.769919:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002528.769928:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560985728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002528.769954:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.769985:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560985728 00000100:00100000:0.0:1786002528.769989:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560985728 00000100:00100000:0.0:1786002528.770014:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:0.0:1786002528.770020:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3646:x1872758560985728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002528.770031:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002528.770044:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784152a1 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841529a expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.770206:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:0.0:1786002528.770213:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002528.770319:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3646:x1872758560985728:12345-0@lo:103:ldlm_bl.0 Request processed in 298us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.770326:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00010000:00010000:0.0:1786002528.770344:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784152af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.770351:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784152af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.770358:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784152af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.770378:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786002528.770428:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18439:x1872758530922240:12345-192.168.203.49@tcp:36:rm.0 Request processed in 2584us (2788us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786002528.770434:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23938 00010000:00010000:3.0:1786002528.770479:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002528.770484:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784152af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.770491:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002528.770495:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784152af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002528.770502:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784152af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.770525:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784152af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.770531:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002528.770541:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784152af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.770547:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34800/0x7cee4af5784152a8 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784152af expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.770560:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.770561:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.770563:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002528.770570:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560985856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002528.770595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.770615:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560985856 00000100:00100000:3.0:1786002528.770618:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560985856 00000100:00100000:3.0:1786002528.770641:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1786002528.770648:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3647:x1872758560985856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002528.770656:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002528.770666:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af5784152af lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784152a8 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.770677:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xbc0ca3a9 (ffff9ed245fedb00) 00010000:00010000:3.0:1786002528.770682:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002528.770704:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758560985856:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.770725:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1786002528.770754:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560985856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002528.772990:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560985728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002528.773883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002528.773982:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530922496 00000100:00100000:1.0:1786002528.773988:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530922496 00000100:00100000:1.0:1786002528.774033:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23939 00000100:00100000:1.0:1786002528.774042:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:18439:x1872758530922496:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:1.0:1786002528.774120:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784152b6 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774135:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784152b6 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774150:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784152b6 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774161:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af5784152bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774168:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af5784152bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774174:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af5784152bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774223:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af5784152c4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774230:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af5784152c4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774244:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af5784152c4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002528.774463:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 64 off8576 00010000:00010000:1.0:1786002528.774501:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784152cb lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774509:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784152cb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774517:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784152cb lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774524:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784152cb lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774531:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784152cb lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774538:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784152cb lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774561:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002528.774576:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af5784152c4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774582:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af5784152c4 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774589:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af5784152c4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774594:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.774599:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af5784152c4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774605:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af5784152c4 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774615:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9ed244f15c00) 00010000:00010000:1.0:1786002528.774617:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002528.774621:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af5784152c4 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774626:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c600/0x7cee4af5784152c4 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x19e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774645:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784152b6 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774651:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784152b6 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774657:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784152b6 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774663:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784152b6 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774667:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002528.774670:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784152b6 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774676:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784152b6 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774682:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed244f15400) 00010000:00010000:1.0:1786002528.774684:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.774686:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784152b6 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774692:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784152b6 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002528.774703:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef7e5fde reply state 00000000e2d10f1d transno 4294968590 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af5784152bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774720:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af5784152bd lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.774727:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xbc0ca3a9 (ffff9ed244f15900) 00010000:00010000:1.0:1786002528.774729:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002528.774732:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002528.774873:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002528.774880:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784152cb lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.774886:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ca00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002528.774889:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784152cb lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.774896:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784152cb lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.774905:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19e:0x0].0x0 (ffff9ed244f15c00) 00010000:00010000:0.0:1786002528.774907:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002528.774910:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784152cb lrc: 1/0,0 mode: --/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.774916:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8ca00/0x7cee4af5784152cb lrc: 0/0,0 mode: --/PW res: [0x240000402:0x19e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.774928:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.774930:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.774931:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.774999:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18439:x1872758530922496:12345-192.168.203.49@tcp:36:rm.0 Request processed in 957us (1117us total) trans 4294968590 rc 0/0 00000100:00100000:1.0:1786002528.775006:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23939 00000100:00100000:1.0:1786002528.779954:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002528.780094:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530922752 00000100:00100000:0.0:1786002528.780103:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530922752 00000100:00100000:0.0:1786002528.780146:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23940 00000100:00100000:0.0:1786002528.780154:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18439:x1872758530922752:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002528.780205:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002528.780228:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2b800/0x7cee4af578415166 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aca4 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.780254:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9ed24559fb00) 00010000:00010000:0.0:1786002528.780263:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002528.780303:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.780311:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.780324:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.780343:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560985984:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1786002528.780385:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.780415:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.780454:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560985984 00000100:00100000:3.0:1786002528.780459:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560985984 00000100:00100000:3.0:1786002528.780502:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00100000:3.0:1786002528.780509:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:14496:x1872758560985984:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002528.780519:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.780533:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784152d9 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784152d2 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.780555:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784152d9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784152d2 expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.780568:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784152d9 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784152d2 expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.780576:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:3.0:1786002528.780578:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.780581:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229800, rc 0) 00000100:00100000:3.0:1786002528.780620:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:14496:x1872758560985984:12345-0@lo:101:mdt00_004.0 Request processed in 111us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.780627:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00000100:00100000:2.0:1786002528.780801:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560985984:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002528.780816:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784152d9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.780826:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784152d9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002528.780843:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:2.0:1786002528.780891:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.780899:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.780907:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002528.780918:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560986112:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002528.780943:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.780961:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.781062:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560986112 00000100:00100000:3.0:1786002528.781067:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560986112 00000100:00100000:3.0:1786002528.781096:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00100000:3.0:1786002528.781102:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:14496:x1872758560986112:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002528.781111:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.781122:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784152e7 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784152e0 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.781137:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784152e7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784152e0 expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.781147:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784152e7 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784152e0 expref: 11 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.781155:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x84832a57 (ffff9ed245fedf00) 00010000:00010000:3.0:1786002528.781157:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.781160:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228800, rc 0) 00000100:00100000:3.0:1786002528.781189:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560986112:12345-0@lo:101:mdt00_004.0 Request processed in 86us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.781195:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000100:00100000:3.0:1786002528.781216:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560986112:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002528.781225:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784152e7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.781246:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784152e7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002528.781258:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00000100:00100000:3.0:1786002528.781286:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560986240:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002528.781309:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.781321:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d600 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.781332:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560986240 00000100:00100000:3.0:1786002528.781335:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560986240 00000100:00100000:3.0:1786002528.781351:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00100000:3.0:1786002528.781356:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560986240:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002528.781407:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560986240:12345-0@lo:1000:mdt00_004.0 Request processed in 50us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.781414:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00100000:3.0:1786002528.781436:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560986240:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002528.781682:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560986368:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002528.781707:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.781731:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d600 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.781742:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560986368 00000100:00100000:3.0:1786002528.781746:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560986368 00000100:00100000:3.0:1786002528.781763:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:3.0:1786002528.781768:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560986368:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002528.781828:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560986368:12345-0@lo:1000:mdt00_004.0 Request processed in 59us (119us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002528.781833:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00000100:00100000:3.0:1786002528.781876:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560986368:0@lo:1000:mdt00_004.0 00000004:00080000:3.0:1786002528.781890:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:3.0:1786002528.781895:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784152d9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.781903:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784152d9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.781910:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784152d9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.781929:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002528.781934:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:3.0:1786002528.781941:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002528.781947:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784152d9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.781955:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002528.781960:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784152d9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002528.781967:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784152d9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.781986:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784152d9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.781992:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002528.782006:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784152d9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.782013:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f35e00/0x7cee4af5784152d2 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784152d9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.782027:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.782029:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.782030:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002528.782039:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560986496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002528.782167:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786002528.782201:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784152e7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.782211:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784152e7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.782218:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784152e7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.782230:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002528.782351:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002528.782356:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784152e7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.782363:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a600 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002528.782367:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784152e7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002528.782375:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784152e7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.782393:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784152e7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.782399:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002528.782417:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784152e7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.782429:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2a600/0x7cee4af5784152e0 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784152e7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.782442:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.782443:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.782445:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002528.782526:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560986496 00000100:00100000:0.0:1786002528.782531:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560986496 00000100:00100000:0.0:1786002528.782565:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:0.0:1786002528.782572:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3644:x1872758560986496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002528.782581:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002528.782595:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784152d9 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784152d2 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.782611:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245feda00) 00010000:00010000:0.0:1786002528.782618:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002528.782642:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3644:x1872758560986496:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.782649:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:2.0:1786002528.782707:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560986496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002528.782726:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786002528.782731:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560986624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002528.782755:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.782815:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560986624 00000100:00100000:0.0:1786002528.782819:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560986624 00000100:00100000:0.0:1786002528.782870:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:0.0:1786002528.782877:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3644:x1872758560986624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002528.782885:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002528.782895:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784152e7 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784152e0 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.782912:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x84832a57 (ffff9ed245fedf00) 00010000:00010000:0.0:1786002528.782919:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002528.782945:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758560986624:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.782951:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:0.0:1786002528.782974:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560986624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002528.783216:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18439:x1872758530922752:12345-192.168.203.49@tcp:36:rm.0 Request processed in 3059us (3268us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002528.783224:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23940 00000100:00100000:2.0:1786002528.786033:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002528.786165:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530923008 00000100:00100000:0.0:1786002528.786174:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530923008 00000100:00100000:0.0:1786002528.786262:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23941 00000100:00100000:0.0:1786002528.786273:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:18439:x1872758530923008:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002528.786355:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784152ee lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786371:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784152ee lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786382:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784152ee lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786394:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784152f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786401:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784152f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786407:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784152f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786477:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784152fc lrc: 3/0,1 mode: --/EX res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786486:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784152fc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786493:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784152fc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002528.786727:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8640 00010000:00010000:0.0:1786002528.786773:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578415303 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786782:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578415303 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786791:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578415303 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786798:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578415303 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786804:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578415303 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.786811:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578415303 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791205:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002528.791253:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784152fc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791270:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784152fc lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791277:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784152fc lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791284:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.791288:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784152fc lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791296:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784152fc lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791313:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9ed2456ef300) 00010000:00010000:0.0:1786002528.791316:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002528.791320:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784152fc lrc: 2/0,0 mode: --/EX res: [0x240000402:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791327:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784152fc lrc: 0/0,0 mode: --/EX res: [0x240000402:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791352:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784152ee lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791358:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784152ee lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791365:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784152ee lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791371:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784152ee lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791377:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.791380:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784152ee lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791386:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784152ee lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791393:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:0.0:1786002528.791395:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.791398:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784152ee lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791404:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784152ee lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002528.791418:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b49e185a reply state 000000002ec446f9 transno 4294968591 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784152f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791430:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784152f5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.791437:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x84832a57 (ffff9ed2456ef700) 00010000:00010000:0.0:1786002528.791439:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002528.791442:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002528.791529:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18439:x1872758530923008:12345-192.168.203.49@tcp:36:rm.0 Request processed in 5255us (5501us total) trans 4294968591 rc 0/0 00000100:00100000:0.0:1786002528.791538:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23941 00010000:00010000:1.0:1786002528.791742:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002528.791748:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578415303 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.791754:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002528.791757:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578415303 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.791763:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578415303 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.791772:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19b:0x0].0x0 (ffff9ed2456ef300) 00010000:00010000:1.0:1786002528.791774:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002528.791777:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578415303 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.791783:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578415303 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.791797:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002528.791798:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002528.791800:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.795616:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.795683:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530923264 00000100:00100000:3.0:1786002528.795692:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530923264 00000100:00100000:3.0:1786002528.795759:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23942 00000100:00100000:3.0:1786002528.795768:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18439:x1872758530923264:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:3.0:1786002528.795822:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002528.795864:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784150e8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac7a expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.795883:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9ed244f15200) 00010000:00010000:3.0:1786002528.795892:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002528.795933:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.795942:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.795952:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.795976:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560986752:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1786002528.796018:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.796042:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3da80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.796068:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560986752 00000100:00100000:3.0:1786002528.796071:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560986752 00000100:00100000:3.0:1786002528.796100:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:3.0:1786002528.796107:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:6522:x1872758560986752:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1786002528.796116:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.796130:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415311 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841530a expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.796150:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415311 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841530a expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.796161:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415311 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841530a expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.796168:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245fed000) 00010000:00010000:3.0:1786002528.796170:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.796173:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228c00, rc 0) 00000100:00100000:3.0:1786002528.796205:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:6522:x1872758560986752:12345-0@lo:101:mdt00_002.0 Request processed in 98us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.796212:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00000100:00100000:3.0:1786002528.796392:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560986752:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1786002528.796407:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578415311 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.796422:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415311 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002528.796438:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:3.0:1786002528.796455:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.796462:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.796468:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.796479:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560986880:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1786002528.796501:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.796528:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3da80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.796569:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560986880 00000100:00100000:1.0:1786002528.796572:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560986880 00000100:00100000:1.0:1786002528.796605:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00100000:1.0:1786002528.796612:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6522:x1872758560986880:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002528.796620:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.796632:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841531f lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578415318 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.796647:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841531f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578415318 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.796656:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841531f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578415318 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.796662:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xdcc87686 (ffff9ed244f15400) 00010000:00010000:1.0:1786002528.796664:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.796667:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c600, rc 0) 00000100:00100000:1.0:1786002528.796698:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560986880:12345-0@lo:101:mdt00_002.0 Request processed in 86us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.796705:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00000100:00100000:1.0:1786002528.796741:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560986880:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1786002528.796751:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841531f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.796760:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841531f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002528.796771:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00000100:00100000:1.0:1786002528.796801:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560987008:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002528.796827:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.796841:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3455456c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.796872:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560987008 00000100:00100000:1.0:1786002528.796875:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560987008 00000100:00100000:1.0:1786002528.796896:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00100000:1.0:1786002528.796904:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560987008:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002528.796957:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560987008:12345-0@lo:1000:mdt00_002.0 Request processed in 54us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.796963:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00000100:00100000:1.0:1786002528.796985:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560987008:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002528.797020:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560987136:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002528.797043:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.797068:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.797079:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560987136 00000100:00100000:1.0:1786002528.797083:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560987136 00000100:00100000:1.0:1786002528.797100:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00100000:1.0:1786002528.797105:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560987136:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786002528.797167:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6522:x1872758560987136:12345-0@lo:1000:mdt00_002.0 Request processed in 60us (122us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002528.797173:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00000100:00100000:1.0:1786002528.797195:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6522:1872758560987136:0@lo:1000:mdt00_002.0 00000004:00080000:1.0:1786002528.797209:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:1.0:1786002528.797214:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415311 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.797228:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578415311 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.797337:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578415311 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.797354:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786002528.797359:0:6522:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:1.0:1786002528.797367:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002528.797372:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578415311 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.797378:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229200 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002528.797383:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578415311 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002528.797390:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578415311 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.797411:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415311 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.797417:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002528.797433:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415311 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.797440:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229200/0x7cee4af57841530a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415311 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.797459:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002528.797461:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002528.797462:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.797472:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560987264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002528.797499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786002528.797535:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841531f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.797543:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af57841531f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.797550:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af57841531f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.797561:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786002528.797611:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18439:x1872758530923264:12345-192.168.203.49@tcp:36:rm.0 Request processed in 1843us (2001us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002528.797617:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23942 00000100:00100000:0.0:1786002528.798475:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560987264 00000100:00100000:0.0:1786002528.798481:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560987264 00000100:00100000:0.0:1786002528.798518:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:0.0:1786002528.798526:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3646:x1872758560987264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002528.798536:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002528.798550:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af578415311 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841530a expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.798567:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed245fed000) 00010000:00010000:0.0:1786002528.798574:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002528.798607:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3646:x1872758560987264:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.798613:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:0.0:1786002528.798643:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560987264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002528.800497:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002528.800506:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af57841531f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.800516:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229400 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002528.800522:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af57841531f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002528.800530:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af57841531f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.800563:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841531f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.800571:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1786002528.800617:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560987392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002528.800663:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.800731:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560987392 00000100:00100000:2.0:1786002528.800738:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560987392 00000100:00100000:2.0:1786002528.800777:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:2.0:1786002528.800786:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3647:x1872758560987392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002528.800796:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002528.800812:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af57841531f lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578415318 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.800826:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xdcc87686 (ffff9ed244f15400) 00010000:00010000:2.0:1786002528.800833:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002528.800901:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841531f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.800910:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed35a229400/0x7cee4af578415318 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841531f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.800926:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.800928:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.800929:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.801004:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.801061:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530923520 00000100:00100000:3.0:1786002528.801065:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530923520 00000100:00100000:3.0:1786002528.801100:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23943 00000100:00100000:3.0:1786002528.801107:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:18439:x1872758530923520:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:3.0:1786002528.801164:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578415326 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801176:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578415326 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801186:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578415326 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801197:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841532d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801204:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841532d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801214:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841532d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801362:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578415334 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801370:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578415334 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801377:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578415334 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002528.801603:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1786002528.801613:0:14496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 888982764886ns, next at 889982762597ns, rc = 0 00010000:00010000:3.0:1786002528.801655:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841533b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801664:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841533b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801671:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841533b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801677:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841533b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801682:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841533b lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801687:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841533b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801703:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002528.801728:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578415334 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801735:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578415334 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801739:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578415334 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801744:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002528.801748:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578415334 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801754:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578415334 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801763:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9ed245fed200) 00010000:00010000:3.0:1786002528.801766:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002528.801769:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578415334 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801774:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229000/0x7cee4af578415334 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801792:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578415326 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801799:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578415326 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801809:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578415326 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801815:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578415326 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801819:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002528.801822:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578415326 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801827:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578415326 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801834:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed245fed700) 00010000:00010000:3.0:1786002528.801836:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.801839:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578415326 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801844:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a229a00/0x7cee4af578415326 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002528.801881:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da20dabf reply state 000000001c9e6518 transno 4294968592 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841532d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801892:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841532d lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.801898:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xdcc87686 (ffff9ed245fed500) 00010000:00010000:3.0:1786002528.801900:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002528.801902:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002528.801952:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:18439:x1872758530923520:12345-192.168.203.49@tcp:36:rm.0 Request processed in 844us (948us total) trans 4294968592 rc 0/0 00000100:00100000:3.0:1786002528.801959:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23943 00010000:00010000:1.0:1786002528.802693:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002528.802700:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841533b lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.802707:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002528.802718:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841533b lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.802730:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841533b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.802739:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19c:0x0].0x0 (ffff9ed245fed200) 00010000:00010000:1.0:1786002528.802742:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002528.802745:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841533b lrc: 1/0,0 mode: --/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.802750:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228e00/0x7cee4af57841533b lrc: 0/0,0 mode: --/PW res: [0x240000402:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.802768:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002528.802770:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002528.802772:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.806096:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.806154:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530923776 00000100:00100000:3.0:1786002528.806163:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530923776 00000100:00100000:3.0:1786002528.806212:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23944 00000100:00100000:3.0:1786002528.806222:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:18439:x1872758530923776:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:3.0:1786002528.806281:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002528.806304:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578415238 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acff expref: 21 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.806320:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9ed2456ef800) 00010000:00010000:3.0:1786002528.806330:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002528.806368:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.806376:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.806385:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.806403:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560987520:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1786002528.806444:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.806465:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.806512:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560987520 00000100:00100000:1.0:1786002528.806516:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560987520 00000100:00100000:1.0:1786002528.806548:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00100000:1.0:1786002528.806555:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:10360:x1872758560987520:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1786002528.806564:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.806577:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578415349 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578415342 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.806596:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578415349 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578415342 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.806607:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578415349 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578415342 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.806619:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed244f15e00) 00010000:00010000:1.0:1786002528.806622:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.806624:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ce00, rc 0) 00000100:00100000:1.0:1786002528.806654:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560987520:12345-0@lo:101:mdt00_003.0 Request processed in 100us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.806661:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000100:00100000:3.0:1786002528.806921:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560987520:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002528.806936:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578415349 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.806951:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415349 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002528.806966:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:3.0:1786002528.806982:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.806989:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.806996:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.807006:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560987648:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1786002528.807026:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.807048:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.807069:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560987648 00000100:00100000:3.0:1786002528.807072:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560987648 00000100:00100000:3.0:1786002528.807097:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00100000:3.0:1786002528.807103:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758560987648:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002528.807110:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.807121:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578415357 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578415350 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.807135:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578415357 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578415350 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.807146:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578415357 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578415350 expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.807154:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xb62e0cbf (ffff9ed245fed100) 00010000:00010000:3.0:1786002528.807157:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.807159:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5ba00, rc 0) 00000100:00100000:3.0:1786002528.807184:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:10360:x1872758560987648:12345-0@lo:101:mdt00_003.0 Request processed in 81us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.807190:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00100000:3.0:1786002528.807213:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560987648:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002528.807222:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578415357 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.807242:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415357 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002528.807254:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00000100:00100000:3.0:1786002528.807282:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560987776:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002528.807304:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.807315:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d480 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.807619:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560987776 00000100:00100000:1.0:1786002528.807624:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560987776 00000100:00100000:1.0:1786002528.807651:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:1.0:1786002528.807658:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:10360:x1872758560987776:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786002528.807722:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:10360:x1872758560987776:12345-0@lo:1000:mdt00_003.0 Request processed in 52us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.807729:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00000100:00100000:3.0:1786002528.807838:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560987776:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002528.807897:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560987904:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002528.807920:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.807935:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d480 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.807946:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560987904 00000100:00100000:3.0:1786002528.807950:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560987904 00000100:00100000:3.0:1786002528.807968:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:3.0:1786002528.807973:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:10360:x1872758560987904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002528.808036:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:10360:x1872758560987904:12345-0@lo:1000:mdt00_003.0 Request processed in 61us (114us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002528.808042:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000100:00100000:3.0:1786002528.808077:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758560987904:0@lo:1000:mdt00_003.0 00000004:00080000:3.0:1786002528.808092:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:3.0:1786002528.808096:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415349 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.808104:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578415349 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.808110:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578415349 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.808124:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002528.808128:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:3.0:1786002528.808132:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415357 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.808139:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578415357 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.808146:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578415357 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.808156:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1786002528.808177:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786002528.808184:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578415349 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.808192:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5ac00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002528.808197:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578415349 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002528.808204:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578415349 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.808224:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415349 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.808230:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002528.808313:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002528.808317:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 2/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578415357 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.808323:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a800 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002528.808327:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578415357 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002528.808333:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578415357 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.808351:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415357 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.808361:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002528.808382:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 1/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415357 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.808389:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5a800/0x7cee4af578415350 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415357 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.808403:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002528.808405:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002528.808407:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.808415:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786002528.808424:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560988160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002528.808454:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786002528.808732:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415349 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.808741:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5ac00/0x7cee4af578415342 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415349 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.808754:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.808756:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.808758:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002528.808795:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18439:x1872758530923776:12345-192.168.203.49@tcp:36:rm.0 Request processed in 2573us (2705us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002528.808802:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23944 00000100:00100000:1.0:1786002528.808877:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560988032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002528.808903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.810997:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560988160 00000100:00100000:3.0:1786002528.811005:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560988160 00000100:00100000:3.0:1786002528.811040:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560988032 00000100:00100000:3.0:1786002528.811043:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560988032 00000100:00100000:1.0:1786002528.811154:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.811208:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:3.0:1786002528.811217:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3645:x1872758560988160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002528.811230:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002528.811258:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af578415357 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578415350 expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.811277:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0xb62e0cbf (ffff9ed245fed100) 00010000:00010000:3.0:1786002528.811286:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002528.811330:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3645:x1872758560988160:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.811337:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:3.0:1786002528.811353:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1786002528.811359:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3645:x1872758560988032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002528.811366:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002528.811377:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578415349 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578415342 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.811387:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed244f15e00) 00010000:00010000:3.0:1786002528.811393:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002528.811415:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3645:x1872758560988032:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (2511us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.811421:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:1.0:1786002528.811574:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560988032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002528.811585:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560988160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002528.811675:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758560987392:12345-0@lo:103:ldlm_bl.0 Request processed in 10888us (11009us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.811683:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:0.0:1786002528.811817:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560987392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002528.812006:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530924032 00000100:00100000:0.0:1786002528.812011:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530924032 00000100:00100000:0.0:1786002528.812056:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23945 00000100:00100000:0.0:1786002528.812062:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:18439:x1872758530924032:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002528.812122:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841535e lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812134:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841535e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812143:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841535e lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812157:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578415365 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812164:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578415365 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812169:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578415365 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812212:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841536c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812219:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841536c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812226:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841536c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002528.812429:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 64 off8576 00010000:00010000:0.0:1786002528.812484:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415373 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812492:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415373 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812499:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415373 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812506:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415373 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812512:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415373 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812518:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415373 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812537:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002528.812551:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841536c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812557:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841536c lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812563:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841536c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812568:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.812572:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841536c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812578:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841536c lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812586:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:0.0:1786002528.812588:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002528.812591:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841536c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812597:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841536c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812609:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841535e lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812619:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841535e lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812624:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841535e lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812629:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841535e lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812633:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002528.812635:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841535e lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812640:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841535e lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812645:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002528.812647:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.812649:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841535e lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812655:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841535e lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002528.812666:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024a9d1c8 reply state 00000000cc7bac6b transno 4294968593 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578415365 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812675:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578415365 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.812680:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xb62e0cbf (ffff9ed2456ef600) 00010000:00010000:0.0:1786002528.812683:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002528.812685:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002528.812737:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18439:x1872758530924032:12345-192.168.203.49@tcp:36:rm.0 Request processed in 674us (1584us total) trans 4294968593 rc 0/0 00000100:00100000:0.0:1786002528.812744:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23945 00010000:00010000:2.0:1786002528.813031:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002528.813038:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415373 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.813044:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002528.813055:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415373 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.813065:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415373 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.813075:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19d:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:2.0:1786002528.813077:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002528.813080:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415373 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.813086:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578415373 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.813098:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002528.813100:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002528.813101:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.817204:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.817274:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530924288 00000100:00100000:3.0:1786002528.817283:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530924288 00000100:00100000:3.0:1786002528.817337:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23946 00000100:00100000:3.0:1786002528.817348:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:18439:x1872758530924288:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:3.0:1786002528.817400:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002528.817423:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8de00/0x7cee4af5784151a5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acb9 expref: 22 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.817439:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9ed244f15100) 00010000:00010000:3.0:1786002528.817448:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002528.817486:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.817494:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.817503:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 3/0,1 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.817523:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560988288:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1786002528.817569:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.817659:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d000 going to sleep for 11 seconds 00000100:00100000:0.0:1786002528.818154:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560988288 00000100:00100000:0.0:1786002528.818159:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560988288 00000100:00100000:0.0:1786002528.818240:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:0.0:1786002528.818249:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:6520:x1872758560988288:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1786002528.818259:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002528.818273:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578415381 lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841537a expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.818294:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578415381 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841537a expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.818307:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578415381 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841537a expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.818314:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002528.818317:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002528.818320:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34600, rc 0) 00000100:00100000:0.0:1786002528.818374:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:6520:x1872758560988288:12345-0@lo:101:mdt00_000.0 Request processed in 127us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.818381:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000100:00100000:3.0:1786002528.818446:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560988288:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1786002528.818461:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578415381 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.818482:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415381 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002528.818500:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:3.0:1786002528.818519:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.818527:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.818540:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 3/0,1 mode: --/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.818551:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560988416:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1786002528.818583:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002528.818777:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d000 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.818835:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560988416 00000100:00100000:1.0:1786002528.818840:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560988416 00000100:00100000:1.0:1786002528.818900:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:1.0:1786002528.818907:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6520:x1872758560988416:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786002528.818915:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002528.818927:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841538f lrc: 2/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578415388 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.818943:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841538f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578415388 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.818954:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841538f lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578415388 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.818961:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x391d5834 (ffff9ed244f15b00) 00010000:00010000:1.0:1786002528.818963:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002528.818966:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ca00, rc 0) 00000100:00100000:1.0:1786002528.818998:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560988416:12345-0@lo:101:mdt00_000.0 Request processed in 91us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.819005:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00100000:1.0:1786002528.819029:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560988416:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1786002528.819039:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af57841538f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.819047:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841538f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002528.819073:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00000100:00100000:1.0:1786002528.819104:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d33800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560988544:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1786002528.819128:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.819142:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.819154:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560988544 00000100:00100000:1.0:1786002528.819157:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560988544 00000100:00100000:1.0:1786002528.819174:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:1.0:1786002528.819181:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560988544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1786002528.819412:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560988544:12345-0@lo:1000:mdt00_000.0 Request processed in 229us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.819421:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00000100:00100000:1.0:1786002528.819451:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d33800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560988544:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1786002528.819497:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d33800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560988672:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1786002528.819519:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.819541:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.819619:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560988672 00000100:00100000:3.0:1786002528.819623:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560988672 00000100:00100000:3.0:1786002528.819654:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:3.0:1786002528.819660:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560988672:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002528.819729:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6520:x1872758560988672:12345-0@lo:1000:mdt00_000.0 Request processed in 69us (208us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002528.819735:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000100:00100000:1.0:1786002528.819791:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d33800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758560988672:0@lo:1000:mdt00_000.0 00000004:00080000:1.0:1786002528.819805:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:1.0:1786002528.819810:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578415381 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.819819:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 4/0,1 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578415381 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.819826:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578415381 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.819903:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1786002528.819909:0:6520:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:1.0:1786002528.819913:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af57841538f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.819920:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af57841538f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.819933:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af57841538f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.820136:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786002528.820143:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 2/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578415381 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.820150:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002528.820155:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578415381 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002528.820162:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 3/0,0 mode: CW/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578415381 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.820184:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 2/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415381 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.820195:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002528.820225:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 1/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415381 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.820232:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5b000/0x7cee4af57841537a lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578415381 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.820315:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560988800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786002528.820346:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786002528.820445:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002528.820449:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 4/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af57841538f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.820455:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5bc00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002528.820459:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 5/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af57841538f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002528.820465:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 5/0,0 mode: PW/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af57841538f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.820530:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 4/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841538f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.820536:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1786002528.820578:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1786002528.820621:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 3/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841538f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.820630:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.820632:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002528.820634:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002528.820646:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560988800 00000100:00100000:3.0:1786002528.820651:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560988800 00000100:00100000:3.0:1786002528.820688:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:3.0:1786002528.820696:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3646:x1872758560988800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002528.820707:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002528.820731:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578415381 lrc: 0/0,0 mode: --/CW res: [0x200000400:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841537a expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.820744:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:3.0:1786002528.820751:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002528.820826:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786002528.820832:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f5bc00/0x7cee4af578415388 lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af57841538f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002528.820918:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:18439:x1872758530924288:12345-192.168.203.49@tcp:36:rm.0 Request processed in 3570us (3720us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786002528.820925:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23946 00010000:00010000:2.0:1786002528.821076:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002528.823967:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3646:x1872758560988800:12345-0@lo:103:ldlm_bl.0 Request processed in 3262us (3610us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.823981:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:0.0:1786002528.824404:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.824464:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530924544 00000100:00100000:3.0:1786002528.824472:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530924544 00000100:00100000:3.0:1786002528.824523:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23947 00000100:00100000:3.0:1786002528.824532:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:18439:x1872758530924544:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:3.0:1786002528.824609:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578415396 lrc: 3/0,1 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.824624:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578415396 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.824636:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578415396 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.824648:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ac00/0x7cee4af57841539d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.824654:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ac00/0x7cee4af57841539d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.824661:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ac00/0x7cee4af57841539d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.824824:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153a4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.824833:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153a4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.824841:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153a4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002528.825134:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8640 00010000:00010000:3.0:1786002528.825176:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af5784153ab lrc: 3/0,1 mode: --/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825186:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af5784153ab lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825193:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af5784153ab lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825201:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af5784153ab lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825207:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af5784153ab lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825213:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af5784153ab lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825280:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002528.825298:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153a4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825304:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153a4 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825310:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153a4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825317:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002528.825321:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153a4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825327:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153a4 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825338:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9ed245fed700) 00010000:00010000:3.0:1786002528.825341:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002528.825345:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153a4 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825351:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153a4 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825373:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578415396 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825380:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578415396 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825386:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578415396 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825395:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578415396 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825400:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002528.825403:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578415396 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825409:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578415396 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825416:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed245fed100) 00010000:00010000:3.0:1786002528.825418:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002528.825421:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578415396 lrc: 3/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825427:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ba00/0x7cee4af578415396 lrc: 0/0,0 mode: --/CW res: [0x240000400:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002528.825441:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008ff67a2 reply state 00000000f511b4f7 transno 4294968594 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ac00/0x7cee4af57841539d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825451:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ac00/0x7cee4af57841539d lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.825457:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x391d5834 (ffff9ed245fede00) 00010000:00010000:3.0:1786002528.825460:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002528.825462:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002528.825522:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:18439:x1872758530924544:12345-192.168.203.49@tcp:36:rm.0 Request processed in 990us (1119us total) trans 4294968594 rc 0/0 00000100:00100000:3.0:1786002528.825529:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23947 00000100:00100000:1.0:1786002528.826001:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560988928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002528.826044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.826103:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560988800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002528.826404:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560988928 00000100:00100000:3.0:1786002528.826409:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560988928 00000100:00100000:3.0:1786002528.826452:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:3.0:1786002528.826460:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3646:x1872758560988928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002528.826472:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002528.826488:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841538f lrc: 0/0,0 mode: --/PW res: [0x200000400:0xd6:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af578415388 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.826501:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x391d5834 (ffff9ed244f15b00) 00010000:00010000:3.0:1786002528.826508:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002528.826538:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758560988928:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.826545:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:3.0:1786002528.830484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.830517:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530924928 00000100:00100000:3.0:1786002528.830526:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530924928 00000100:00100000:3.0:1786002528.830568:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5115 00000100:00100000:3.0:1786002528.830578:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:18439:x1872758530924928:12345-192.168.203.49@tcp:35:rm.0 00000100:00100000:3.0:1786002528.830781:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18439:x1872758530924928:12345-192.168.203.49@tcp:35:rm.0 Request processed in 204us (305us total) trans 4294968595 rc 0/0 00000100:00100000:3.0:1786002528.830789:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5115 00000100:00100000:3.0:1786002528.830832:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002528.830870:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530924672 00000100:00100000:3.0:1786002528.830874:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530924672 00000100:00100000:3.0:1786002528.830902:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1513 00000100:00100000:3.0:1786002528.830908:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758530924672:12345-192.168.203.49@tcp:103:rm.0 00010000:00010000:3.0:1786002528.830920:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002528.830943:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af578414d06 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abd2 expref: 10 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.830958:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed245e35200) 00010000:00010000:3.0:1786002528.830968:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002528.830988:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758530924672:12345-192.168.203.49@tcp:103:rm.0 Request processed in 79us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.830994:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1513 00000100:00100000:1.0:1786002528.831930:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560988928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002528.832311:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002528.832319:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af5784153ab lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.832328:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5be00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002528.832333:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af5784153ab lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.832342:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af5784153ab lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.832353:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19f:0x0].0x0 (ffff9ed245fed700) 00010000:00010000:0.0:1786002528.832356:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002528.832360:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af5784153ab lrc: 1/0,0 mode: --/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.832366:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5be00/0x7cee4af5784153ab lrc: 0/0,0 mode: --/PW res: [0x240000402:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.832385:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.832387:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002528.832388:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002528.835402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.835529:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530925184 00000100:00100000:2.0:1786002528.835538:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530925184 00000100:00100000:2.0:1786002528.835596:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23948 00000100:00100000:2.0:1786002528.835606:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:18439:x1872758530925184:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:2.0:1786002528.835662:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786002528.835687:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2aa00/0x7cee4af578415024 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac42 expref: 24 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.835727:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed243d2a000/0x7cee4af578414ffa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x19a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac2d expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.835735:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed24559f700) 00010000:00010000:2.0:1786002528.835745:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002528.835788:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.835796:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.835805:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002528.835824:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560989056:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1786002528.835901:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.835938:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245c66240 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.836023:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560989056 00000100:00100000:3.0:1786002528.836027:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560989056 00000100:00100000:3.0:1786002528.836067:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:3.0:1786002528.836075:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:14496:x1872758560989056:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002528.836085:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.836097:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af5784153b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784153b2 expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.836116:0:15596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414cea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abcb expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.836124:0:15596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af5784153b9 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784153b2 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.836145:0:15596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414cea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abcb expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.836158:0:15596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414cea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abcb expref: 8 pid: 6520 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002528.836173:0:15596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136dc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560989184:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002528.836241:0:15596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e3d480 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.840179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002528.840267:0:15596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136dc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:15596:1872758560989184:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002528.840299:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af5784153b9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784153b2 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.840312:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002528.840314:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.840318:0:15596:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af5784153b9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784153b2 expref: 10 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.840328:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a000, rc 0) 00000100:00100000:2.0:1786002528.840391:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:14496:x1872758560989056:12345-0@lo:101:mdt00_004.0 Request processed in 4315us (4489us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.840401:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00000100:00100000:1.0:1786002528.840533:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560989056:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1786002528.840551:0:14496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.840561:0:14496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.840679:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530925312 00000100:00100000:0.0:1786002528.840686:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530925312 00010000:00010000:0.0:1786002528.840720:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414cea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abcb expref: 9 pid: 6520 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.840751:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1689 00000100:00100000:0.0:1786002528.840760:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758530925312:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002528.840775:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002528.840782:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414cea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abcb expref: 9 pid: 6520 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.840793:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414cea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abcb expref: 9 pid: 6520 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.840812:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578414cea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3abcb expref: 9 pid: 6520 timeout: 989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.840823:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002528.840828:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af5784153b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784153b2 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.840836:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af5784153b9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784153b2 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.840869:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af5784153b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7cee4af5784153b2 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.840898:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af5784153b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784153b2 expref: 9 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.840911:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560989312:0@lo:105: 00000100:00100000:0.0:1786002528.840942:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.840971:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d463c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002528.841054:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560989312 00000100:00100000:2.0:1786002528.841059:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560989312 00000100:00100000:2.0:1786002528.841092:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1786002528.841099:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560989312:12345-0@lo:105: 00010000:00010000:2.0:1786002528.841111:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.841119:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.841127:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.841134:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.841141:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.841148:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.841159:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed243d2ba00) 00000100:00100000:2.0:1786002528.841190:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758560989312:12345-0@lo:105: Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.841197:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1786002528.841220:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758560989312:0@lo:105: 00010000:00010000:2.0:1786002528.841230:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002528.841272:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758530925312:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 513us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.841279:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1689 00010000:00010000:1.0:1786002528.841399:0:14496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.841413:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002528.841431:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1786002528.841463:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8ce00/0x7cee4af5784153c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.841471:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8ce00/0x7cee4af5784153c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.841479:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8ce00/0x7cee4af5784153c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002528.841494:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d30380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560989440:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1786002528.841521:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.841543:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002528.842130:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560989440 00000100:00100000:2.0:1786002528.842136:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560989440 00000100:00100000:2.0:1786002528.842161:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:2.0:1786002528.842167:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:14496:x1872758560989440:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1786002528.842181:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002528.842194:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784153c7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784153c0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.842212:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784153c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784153c0 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.842222:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784153c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784153c0 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.842229:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9ed35363d100) 00010000:00010000:2.0:1786002528.842232:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.842235:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2ae00, rc 0) 00000100:00100000:2.0:1786002528.842900:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560989440:12345-0@lo:101:mdt00_004.0 Request processed in 731us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.842908:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00100000:1.0:1786002528.843017:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d30380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560989440:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1786002528.843030:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8ce00/0x7cee4af5784153c0 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784153c7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.843040:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8ce00/0x7cee4af5784153c0 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784153c7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002528.843064:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1786002528.843098:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560989568:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1786002528.843125:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.843144:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002528.843254:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560989568 00000100:00100000:0.0:1786002528.843259:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560989568 00000100:00100000:0.0:1786002528.843292:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00100000:0.0:1786002528.843298:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560989568:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1786002528.843360:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560989568:12345-0@lo:1000:mdt00_004.0 Request processed in 62us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.843366:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00000100:00100000:1.0:1786002528.843497:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560989568:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1786002528.843532:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560989696:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1786002528.843555:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.843578:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.843622:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560989696 00000100:00100000:3.0:1786002528.843627:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560989696 00000100:00100000:3.0:1786002528.843658:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00100000:3.0:1786002528.843665:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560989696:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1786002528.843773:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560989696:12345-0@lo:1000:mdt00_004.0 Request processed in 108us (217us total) trans 0 rc 1/1 00000100:00100000:3.0:1786002528.843779:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00100000:0.0:1786002528.843887:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560989696:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1786002528.843927:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 3/0,1 mode: --/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.843935:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 3/0,1 mode: --/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.843944:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 3/0,1 mode: --/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002528.843956:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560989824:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1786002528.843980:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002528.843997:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.844046:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560989824 00000100:00100000:3.0:1786002528.844060:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560989824 00000100:00100000:3.0:1786002528.844088:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00100000:3.0:1786002528.844094:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:14496:x1872758560989824:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1786002528.844103:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002528.844115:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153d5 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784153ce expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.844133:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153d5 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784153ce expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.844143:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153d5 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784153ce expref: 12 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002528.844150:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed245fed100) 00010000:00010000:3.0:1786002528.844154:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786002528.844156:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5aa00, rc 0) 00000100:00100000:3.0:1786002528.844193:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:14496:x1872758560989824:12345-0@lo:101:mdt00_004.0 Request processed in 98us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002528.844198:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00000100:00100000:1.0:1786002528.844346:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560989824:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1786002528.844355:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784153d5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.844365:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784153d5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.844386:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784153dc lrc: 3/0,1 mode: --/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.844394:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784153dc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.844401:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784153dc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.844418:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784153e3 lrc: 3/0,1 mode: --/EX res: [0x240000400:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.844425:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784153e3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.844432:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784153e3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.844449:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.844456:0:14496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.844463:0:14496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 3/0,1 mode: --/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002528.844474:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560989952:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1786002528.844498:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.844521:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1786002528.844567:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560989952 00000100:00100000:0.0:1786002528.844572:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560989952 00000100:00100000:0.0:1786002528.844603:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00100000:0.0:1786002528.844610:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:14496:x1872758560989952:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1786002528.844618:0:15596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002528.844629:0:15596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784153f1 lrc: 2/0,0 mode: --/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af5784153ea expref: -99 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.844644:0:15596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784153f1 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af5784153ea expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.844655:0:15596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784153f1 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af5784153ea expref: 13 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002528.844662:0:15596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:0.0:1786002528.844665:0:15596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002528.844667:0:15596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35200, rc 0) 00000100:00100000:0.0:1786002528.844694:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:14496:x1872758560989952:12345-0@lo:101:mdt00_004.0 Request processed in 85us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002528.844700:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00100000:1.0:1786002528.844763:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560989952:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1786002528.844772:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784153f1 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.844781:0:14496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784153f1 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002528.846125:0:14496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560990080:0@lo:403:mdt00_004.0 00000100:00100000:1.0:1786002528.846165:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.846184:0:14496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1786002528.846201:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560990080 00000100:00100000:1.0:1786002528.846205:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560990080 00000100:00100000:1.0:1786002528.846297:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015 00000100:00100000:1.0:1786002528.846307:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:14496:x1872758560990080:12345-0@lo:403:mdt00_004.0 00000100:00100000:1.0:1786002528.848728:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:14496:x1872758560990080:12345-0@lo:403:mdt00_004.0 Request processed in 2417us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.848738:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00100000:2.0:1786002528.849355:0:14496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:14496:1872758560990080:0@lo:403:mdt00_004.0 00000040:00080000:3.0:1786002528.850978:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].417, 960 off623552 00000040:00080000:3.0:1786002528.851182:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].416, 1040 off672536 00000004:00080000:3.0:1786002528.851190:0:14496:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245c66540 with version 796 00000004:00080000:1.0:1786002528.851307:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 796 rpc_version 796 00000020:00100000:1.0:1786002528.851338:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1786002528.851346:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed244d30380 x1872758560990336/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2624/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786002528.851366:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244d30380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560990336:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1786002528.851411:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.851477:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002528.851609:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560990336 00000100:00100000:3.0:1786002528.851617:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560990336 00000100:00100000:3.0:1786002528.851702:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016 00000100:00100000:3.0:1786002528.851720:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:7466:x1872758560990336:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002528.852109:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:7466:x1872758560990336:12345-0@lo:1000:osp_up0-1.0 Request processed in 397us (696us total) trans 4294983604 rc 0/0 00000100:00100000:3.0:1786002528.852116:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00100000:1.0:1786002528.852201:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244d30380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758560990336:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1786002528.852271:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x19a:0x0]: returning size 4096 00010000:00010000:2.0:1786002528.852291:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784153e3 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852301:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784153e3 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852309:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784153e3 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852316:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.852320:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784153e3 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852329:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784153e3 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852342:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x0 (ffff9ed244f15400) 00010000:00010000:2.0:1786002528.852346:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002528.852351:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784153e3 lrc: 2/0,0 mode: --/EX res: [0x240000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852357:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8d200/0x7cee4af5784153e3 lrc: 0/0,0 mode: --/EX res: [0x240000400:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852376:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784153f1 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852385:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 4/0,1 mode: EX/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784153f1 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852393:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784153f1 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852417:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002528.852424:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0xd6:0x0] 00010000:00010000:2.0:1786002528.852430:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784153dc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852437:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784153dc lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852444:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784153dc lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852449:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002528.852452:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784153dc lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852458:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784153dc lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852473:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed244f15100) 00010000:00010000:2.0:1786002528.852476:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002528.852479:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784153dc lrc: 2/0,0 mode: --/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852486:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8da00/0x7cee4af5784153dc lrc: 0/0,0 mode: --/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852498:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784153d5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852505:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784153d5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852512:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784153d5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852526:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1786002528.852533:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1786002528.852541:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002528.852546:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 2/0,0 mode: EX/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784153f1 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852553:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8cc00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002528.852557:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784153f1 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002528.852565:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 3/0,0 mode: EX/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784153f1 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852588:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 2/0,0 mode: --/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784153f1 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852595:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002528.852611:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 1/0,0 mode: --/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784153f1 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852618:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8cc00/0x7cee4af5784153ea lrc: 0/0,0 mode: --/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784153f1 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852630:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002528.852634:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784153d5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852639:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:2.0:1786002528.852642:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784153d5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002528.852649:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784153d5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852665:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 2/0,0 mode: --/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784153d5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852671:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786002528.852676:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 1/0,0 mode: --/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784153d5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852684:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed244f34000/0x7cee4af5784153ce lrc: 0/0,0 mode: --/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784153d5 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852696:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002528.852697:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002528.852699:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002528.852735:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560990464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002528.852766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.852788:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786002528.852794:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560990592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002528.852814:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002528.852837:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560990464 00000100:00100000:2.0:1786002528.852841:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560990464 00000100:00100000:2.0:1786002528.852890:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560990592 00000100:00100000:2.0:1786002528.852894:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560990592 00000100:00100000:2.0:1786002528.852917:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:2.0:1786002528.852924:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+15:3644:x1872758560990464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002528.852934:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002528.852950:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784153f1 lrc: 0/0,0 mode: --/EX res: [0x200000400:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784153ea expref: 15 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.852966:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0xd6:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:2.0:1786002528.852972:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002528.853000:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+14:3644:x1872758560990464:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.853007:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:2.0:1786002528.853020:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:2.0:1786002528.853026:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af76c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3644:x1872758560990592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002528.853033:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002528.853043:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af5784153d5 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784153ce expref: 13 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.853057:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x19a:0x0].0x0 (ffff9ed245fed100) 00010000:00010000:2.0:1786002528.853063:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002528.853083:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af76c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3644:x1872758560990592:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002528.853088:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:2.0:1786002528.853134:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560990592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002528.853142:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560990464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786002528.853163:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.853171:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.853179:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.853199:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1786002528.853204:0:14496:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1786002528.853209:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8ce00/0x7cee4af5784153c0 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784153c7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002528.853218:0:14496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8ce00/0x7cee4af5784153c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af5784153c7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002528.853275:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:18439:x1872758530925184:12345-192.168.203.49@tcp:36:rm.0 Request processed in 17669us (17879us total) trans 4294968596 rc 0/0 00000100:00100000:2.0:1786002528.853283:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23948 00010000:00010000:1.0:1786002528.853545:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002528.853551:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.853558:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:1.0:1786002528.853562:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002528.853570:0:6509:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.853590:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.853597:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002528.853620:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.853628:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed243d2ba00/0x7cee4af5784153b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784153b9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.853642:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002528.853643:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002528.853645:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002528.853650:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786002528.853659:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560990720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786002528.853686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002528.853705:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560990720 00000100:00100000:1.0:1786002528.853709:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560990720 00000100:00100000:1.0:1786002528.853746:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:1.0:1786002528.853753:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3647:x1872758560990720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002528.853761:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002528.853771:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af5784153b9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784153b2 expref: 12 pid: 15596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002528.853782:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002528.853785:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002528.853807:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3647:x1872758560990720:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002528.853813:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:1.0:1786002528.853839:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560990720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786002528.859369:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002529.194084:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002529.646194:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560990848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002529.646272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002529.646421:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560990848 00000100:00100000:3.0:1786002529.646429:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560990848 00000100:00100000:3.0:1786002529.646489:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1786002529.646498:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1872758560990848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786002529.646523:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67505600 pending 28672 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786002529.646565:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1872758560990848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002529.646572:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1786002529.646618:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560990848:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1786002529.646676:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002529.647240:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758560991232:0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.647272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002529.647290:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560991744:0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.647310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002529.647324:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560992256:0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.647339:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002529.647354:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786002529.647359:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560991360:0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.647377:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002529.647388:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560991872:0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.647404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002529.647431:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560991232 00000100:00100000:1.0:1786002529.647435:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560991232 00000100:00100000:1.0:1786002529.647464:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1786002529.647482:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758560991232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.647516:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758560991232:12345-0@lo:400:kworker.0 Request processed in 35us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002529.647523:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1786002529.647541:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560991744 00000100:00100000:1.0:1786002529.647544:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560991744 00000100:00100000:1.0:1786002529.647568:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560992256 00000100:00100000:1.0:1786002529.647570:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560992256 00000100:00100000:1.0:1786002529.647589:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560991872 00000100:00100000:1.0:1786002529.647591:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560991872 00000100:00100000:1.0:1786002529.647609:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1786002529.647615:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560991744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.647643:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560991744:12345-0@lo:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002529.647652:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1786002529.647663:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1786002529.647668:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560992256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.647689:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758560992256:12345-0@lo:400:kworker.0 Request processed in 21us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002529.647694:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1786002529.647712:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1786002529.647719:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560991872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.647744:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560991872:12345-0@lo:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002529.647750:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00080000:1.0:1786002529.647775:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002529.647778:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002529.647794:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969894 gen 2 00000004:00080000:1.0:1786002529.647799:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969883 committed transno 4294969894 00000004:00080000:1.0:1786002529.647812:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969885 committed transno 4294969894 00000004:00080000:1.0:1786002529.647820:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969887 committed transno 4294969894 00000004:00080000:1.0:1786002529.647831:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969890 committed transno 4294969894 00000004:00080000:1.0:1786002529.647838:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969893 committed transno 4294969894 00000004:00080000:1.0:1786002529.647870:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969894 committed transno 4294969894 00000100:00100000:1.0:1786002529.647883:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560991872:0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.647893:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758560991232:0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.647900:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969896 gen 2 00000004:00080000:1.0:1786002529.647904:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be7b80, transno 4294969889 00000004:00080000:1.0:1786002529.647912:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454cb100, transno 4294969895 00000004:00080000:1.0:1786002529.647916:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454cb800, transno 4294969896 00000100:00100000:1.0:1786002529.647919:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560991744:0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.647926:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969885 gen 2 00000004:00080000:1.0:1786002529.647929:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37137df80, transno 4294969885 00000100:00100000:1.0:1786002529.647936:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560992256:0@lo:400:kworker.0 00000004:00080000:1.0:1786002529.648024:0:8752:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 3 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:3.0:1786002529.648354:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758560991104:0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.648383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002529.648412:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758560991616:0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.648430:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002529.648445:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758560992128:0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.648462:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002529.648486:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1786002529.648491:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758560990976:0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.648512:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002529.648533:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758560991488:0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.648550:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002529.648563:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758560992000:0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.648582:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002529.648604:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560991360 00000100:00100000:3.0:1786002529.648608:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560991360 00000100:00100000:3.0:1786002529.648637:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00100000:3.0:1786002529.648644:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560991360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.648683:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758560991360:12345-0@lo:400:kworker.0 Request processed in 39us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002529.648689:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00000100:00100000:3.0:1786002529.648725:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560990976 00000100:00100000:3.0:1786002529.648729:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560990976 00000100:00100000:3.0:1786002529.648752:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1786002529.648759:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758560990976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.648790:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758560990976:12345-0@lo:400:kworker.0 Request processed in 31us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002529.648795:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1786002529.648825:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560991104 00000100:00100000:3.0:1786002529.648829:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560991104 00000100:00100000:3.0:1786002529.648843:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560991616 00000100:00100000:3.0:1786002529.648861:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560991616 00000100:00100000:3.0:1786002529.648883:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560992128 00000100:00100000:3.0:1786002529.648886:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560992128 00000100:00100000:3.0:1786002529.648897:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560991488 00000100:00100000:3.0:1786002529.648899:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560991488 00000100:00100000:3.0:1786002529.648909:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560992000 00000100:00100000:3.0:1786002529.648911:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560992000 00000100:00100000:3.0:1786002529.648925:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:3.0:1786002529.648931:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758560991104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.648964:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758560991104:12345-0@lo:400:kworker.0 Request processed in 33us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002529.648969:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:3.0:1786002529.648981:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1786002529.648987:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758560991616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.649013:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758560991616:12345-0@lo:400:kworker.0 Request processed in 26us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002529.649018:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1786002529.649028:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:3.0:1786002529.649034:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758560992128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.649071:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758560992128:12345-0@lo:400:kworker.0 Request processed in 36us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002529.649077:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:3.0:1786002529.649087:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:3.0:1786002529.649093:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758560991488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.649114:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758560991488:12345-0@lo:400:kworker.0 Request processed in 22us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002529.649123:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:3.0:1786002529.649132:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:3.0:1786002529.649138:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758560992000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.649158:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758560992000:12345-0@lo:400:kworker.0 Request processed in 21us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002529.649164:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00080000:3.0:1786002529.649176:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786002529.649179:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786002529.649198:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758560990976:0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.649208:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758560991488:0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.649216:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758560992000:0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.649224:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758560991104:0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.649369:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758560991616:0@lo:400:kworker.0 00000100:00100000:3.0:1786002529.649378:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758560992128:0@lo:400:kworker.0 00000100:00100000:1.0:1786002529.651371:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968572 gen 2 00000004:00080000:1.0:1786002529.651381:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968567 committed transno 4294968572 00000020:00080000:1.0:1786002529.651386:0:3646:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed345545000 refcount 2 committed 0 result 0 batchid 413 00000020:00080000:1.0:1786002529.651390:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455dfe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d3f6c0 00000020:00080000:1.0:1786002529.651393:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24298d600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed345545300 00000020:00080000:1.0:1786002529.651397:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].408 00000020:00080000:1.0:1786002529.651399:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24298df00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed34732ea00 00000020:00080000:1.0:1786002529.651402:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].408 00000004:00080000:1.0:1786002529.651428:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968568 committed transno 4294968572 00000020:00080000:1.0:1786002529.651431:0:3646:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed245d46f00 refcount 2 committed 0 result 0 batchid 414 00000020:00080000:1.0:1786002529.651434:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455dfa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed3821ffcc0 00000020:00080000:1.0:1786002529.651437:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455e6e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245d46600 00000020:00080000:1.0:1786002529.651439:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].409 00000020:00080000:1.0:1786002529.651441:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455e6200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed243fd5200 00000020:00080000:1.0:1786002529.651443:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].409 00000004:00080000:1.0:1786002529.651452:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968569 committed transno 4294968572 00000020:00080000:1.0:1786002529.651455:0:3646:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed245dcfd80 refcount 2 committed 0 result 0 batchid 415 00000020:00080000:1.0:1786002529.651458:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2410bf400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2434d2540 00000020:00080000:1.0:1786002529.651461:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebee00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245dcf300 00000020:00080000:1.0:1786002529.651464:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].410 00000020:00080000:1.0:1786002529.651474:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed3455df400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245657200 00000020:00080000:1.0:1786002529.651477:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].410 00000004:00080000:1.0:1786002529.651486:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968570 committed transno 4294968572 00000020:00080000:1.0:1786002529.651489:0:3646:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed2434d2e40 refcount 2 committed 0 result 0 batchid 416 00000020:00080000:1.0:1786002529.651492:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2410bf000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed3821ffcc0 00000020:00080000:1.0:1786002529.651495:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2410bfe00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2434d2480 00000020:00080000:1.0:1786002529.651497:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].411 00000020:00080000:1.0:1786002529.651499:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed2410bfc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2436ff000 00000020:00080000:1.0:1786002529.651501:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].411 00000004:00080000:1.0:1786002529.651510:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968571 committed transno 4294968572 00000020:00080000:1.0:1786002529.651513:0:3646:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed345545600 refcount 2 committed 0 result 0 batchid 417 00000020:00080000:1.0:1786002529.651515:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24298dc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed366d7de40 00000020:00080000:1.0:1786002529.651518:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24298d500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed345545f00 00000020:00080000:1.0:1786002529.651520:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].412 00000020:00080000:1.0:1786002529.651522:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed24298d800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2436fec00 00000020:00080000:1.0:1786002529.651524:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].412 00000004:00080000:1.0:1786002529.651534:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968572 committed transno 4294968572 00000020:00080000:1.0:1786002529.651537:0:3646:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ed357b3e6c0 refcount 2 committed 0 result 0 batchid 418 00000020:00080000:1.0:1786002529.651540:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebe000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245e3dc00 00000020:00080000:1.0:1786002529.651542:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebed00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed357b3e300 00000020:00080000:1.0:1786002529.651545:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].413 00000020:00080000:1.0:1786002529.651547:0:3646:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebe600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed2423d5400 00000020:00080000:1.0:1786002529.651550:0:3646:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].413 00000100:00100000:1.0:1786002529.651565:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758560991360:0@lo:400:kworker.0 00000020:00080000:2.0:1786002529.651676:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 418 committed batchid 412 00000020:00080000:2.0:1786002529.651746:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 412 00000100:00100000:2.0:1786002529.663682:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560992384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002529.663762:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002529.663869:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560992384 00000100:00100000:1.0:1786002529.663876:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560992384 00000100:00100000:1.0:1786002529.663922:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1786002529.663931:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560992384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786002529.663952:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67505600 pending 28672 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786002529.674301:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758560992384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 10361us (10529us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002529.674315:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1786002529.677028:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560992384:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1786002530.221476:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002531.183166:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002531.183188:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560992512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786002531.183251:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002531.183421:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560992512 00000100:00100000:3.0:1786002531.183428:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560992512 00000100:00100000:3.0:1786002531.183480:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00100000:3.0:1786002531.183490:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758560992512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002531.183520:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445072896 avail 1298833408 00000100:00100000:3.0:1786002531.183572:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758560992512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002531.183580:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00000100:00100000:0.0:1786002531.183666:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560992512:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786002531.242119:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002532.269583:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786002533.227040:0:8753:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 893408190557ns, next at 894408187630ns, rc = 0 00000100:00100000:0.0:1786002533.227124:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560992640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002533.227191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002533.227772:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560992640 00000100:00100000:1.0:1786002533.227780:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560992640 00000100:00100000:1.0:1786002533.227827:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1786002533.227837:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758560992640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002533.227878:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1786002533.227921:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758560992640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002533.227927:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1786002533.227969:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560992640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786002533.228068:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002533.228077:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560992768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002533.228104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002533.228217:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560992768 00000100:00100000:1.0:1786002533.228221:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560992768 00000100:00100000:1.0:1786002533.228252:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1786002533.228259:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560992768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786002533.228269:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1786002533.228300:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560992768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002533.228306:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1786002533.228329:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560992768:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786002533.231370:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786002533.291980:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002533.723309:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002533.723352:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002533.723382:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002533.723407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002533.723442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002533.723471:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530925824 00000100:00100000:3.0:1786002533.723480:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530925824 00000100:00100000:3.0:1786002533.723524:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530925952 00000100:00100000:3.0:1786002533.723526:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530925952 00000100:00100000:3.0:1786002533.723547:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 470 00000100:00100000:3.0:1786002533.723557:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2411:x1872758530925824:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002533.723618:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2411:x1872758530925824:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 62us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002533.723625:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 470 00000100:00100000:3.0:1786002533.723643:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 471 00000100:00100000:3.0:1786002533.723649:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2411:x1872758530925952:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002533.723672:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2411:x1872758530925952:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002533.723689:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 471 00000100:00080000:3.0:1786002533.723802:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786002533.723806:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002533.723880:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530925440 00000100:00100000:0.0:1786002533.723885:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530925440 00000100:00100000:0.0:1786002533.723920:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 515 00000100:00100000:0.0:1786002533.723928:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758530925440:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002533.723958:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758530925440:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 32us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002533.723965:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 515 00000100:00100000:2.0:1786002533.724188:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530925568 00000100:00100000:2.0:1786002533.724192:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530925568 00000100:00100000:2.0:1786002533.724232:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530925696 00000100:00100000:2.0:1786002533.724235:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530925696 00000100:00100000:2.0:1786002533.724253:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 876 00000100:00100000:2.0:1786002533.724260:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2411:x1872758530925568:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002533.724288:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2411:x1872758530925568:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 29us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002533.724294:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 876 00000100:00100000:2.0:1786002533.724305:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 877 00000100:00100000:2.0:1786002533.724311:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:2411:x1872758530925696:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002533.724333:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:2411:x1872758530925696:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 22us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002533.724339:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 877 00000100:00080000:0.0:1786002533.724622:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786002533.724625:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1786002533.744915:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969891 is committed 00000001:00080000:1.0:1786002533.744928:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969889 is committed 00000100:00100000:1.0:1786002533.747240:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560992896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002533.747310:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002533.747483:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560992896 00000100:00100000:3.0:1786002533.747491:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560992896 00000100:00100000:3.0:1786002533.747537:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00100000:3.0:1786002533.747545:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b57b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:3647:x1872758560992896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786002533.747578:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444065280 avail 1297825792 00000100:00100000:3.0:1786002533.747669:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b57b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:3647:x1872758560992896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002533.747689:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000100:00100000:2.0:1786002533.755013:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560992896:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1786002534.314402:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002534.765113:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560993024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002534.765177:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002534.765242:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560993024 00000100:00100000:3.0:1786002534.765249:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560993024 00000100:00100000:3.0:1786002534.765294:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1786002534.765303:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560993024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786002534.765329:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923472384 avail 3691950080 00000100:00100000:3.0:1786002534.765367:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758560993024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.765374:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1786002534.765406:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969891 gen 2 00000004:00080000:3.0:1786002534.765411:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969890 committed transno 4294969891 00000004:00080000:3.0:1786002534.765426:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969891 committed transno 4294969891 00000100:00100000:3.0:1786002534.765443:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560993024:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786002534.765904:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002534.766016:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758560993280:0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766050:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.766072:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758560993792:0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766094:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.766111:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758560994304:0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766131:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.766149:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1786002534.766154:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560993408:0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.766239:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758560993920:0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766260:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.766276:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758560994432:0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.766335:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560993280 00000100:00100000:0.0:1786002534.766340:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560993280 00000100:00100000:0.0:1786002534.766369:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560993792 00000100:00100000:0.0:1786002534.766372:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560993792 00000100:00100000:0.0:1786002534.766393:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560994304 00000100:00100000:0.0:1786002534.766396:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560994304 00000100:00100000:0.0:1786002534.766409:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560993920 00000100:00100000:0.0:1786002534.766411:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560993920 00000100:00100000:0.0:1786002534.766422:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560994432 00000100:00100000:0.0:1786002534.766425:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560994432 00000100:00100000:0.0:1786002534.766440:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1786002534.766447:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758560993280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766489:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758560993280:12345-0@lo:400:kworker.0 Request processed in 42us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002534.766496:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1786002534.766511:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1786002534.766517:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758560993792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766542:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758560993792:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002534.766548:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1786002534.766559:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1786002534.766565:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758560994304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766589:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758560994304:12345-0@lo:400:kworker.0 Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002534.766595:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1786002534.766605:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1786002534.766611:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758560993920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766633:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758560993920:12345-0@lo:400:kworker.0 Request processed in 22us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002534.766638:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1786002534.766647:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:0.0:1786002534.766652:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758560994432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766684:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758560994432:12345-0@lo:400:kworker.0 Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002534.766689:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00080000:0.0:1786002534.766709:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786002534.766712:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002534.766731:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758560993920:0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766740:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758560994432:0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766748:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758560993280:0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766757:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758560993792:0@lo:400:kworker.0 00000100:00100000:0.0:1786002534.766765:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758560994304:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.767292:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560993408 00000100:00100000:3.0:1786002534.767297:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560993408 00000100:00100000:3.0:1786002534.767327:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00100000:3.0:1786002534.767333:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:3646:x1872758560993408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.767377:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:3646:x1872758560993408:12345-0@lo:400:kworker.0 Request processed in 43us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.767383:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000100:00100000:3.0:1786002534.767402:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758560993152:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.767429:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002534.767450:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560993664:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.767483:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002534.767497:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560994176:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.767516:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002534.767532:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1786002534.767538:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758560993536:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.767559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002534.767575:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560994048:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.767595:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002534.767609:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560994560:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.767627:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002534.767652:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560993152 00000100:00100000:3.0:1786002534.767655:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560993152 00000100:00100000:3.0:1786002534.767693:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1786002534.767701:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758560993152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.767732:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758560993152:12345-0@lo:400:kworker.0 Request processed in 32us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.767738:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1786002534.767763:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560993664 00000100:00100000:3.0:1786002534.767767:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560993664 00000100:00100000:3.0:1786002534.767790:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:3.0:1786002534.767796:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758560993664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.767823:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758560993664:12345-0@lo:400:kworker.0 Request processed in 27us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.767828:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000100:00100000:3.0:1786002534.767864:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560994176 00000100:00100000:3.0:1786002534.767868:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560994176 00000100:00100000:3.0:1786002534.767899:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560994048 00000100:00100000:3.0:1786002534.767902:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560994048 00000100:00100000:3.0:1786002534.767916:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560994560 00000100:00100000:3.0:1786002534.767918:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560994560 00000100:00100000:3.0:1786002534.767935:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1786002534.767940:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758560994176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.767966:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758560994176:12345-0@lo:400:kworker.0 Request processed in 25us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.767971:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1786002534.767981:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1786002534.767986:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758560994048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.768007:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758560994048:12345-0@lo:400:kworker.0 Request processed in 22us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.768012:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1786002534.768021:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1786002534.768027:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758560994560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.768051:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758560994560:12345-0@lo:400:kworker.0 Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.768057:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1786002534.768110:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560994048:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.768120:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560994560:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.768129:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758560993152:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.768138:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560993664:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.768147:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758560994176:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.768173:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560993536 00000100:00100000:3.0:1786002534.768175:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560993536 00000100:00100000:3.0:1786002534.768197:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:3.0:1786002534.768203:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758560993536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.768236:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758560993536:12345-0@lo:400:kworker.0 Request processed in 34us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.768242:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:3.0:1786002534.768271:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758560993536:0@lo:400:kworker.0 00000100:00100000:3.0:1786002534.768294:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560993408:0@lo:400:kworker.0 00000004:00080000:1.0:1786002534.769236:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 6 committed 00010000:00010000:1.0:1786002534.769277:0:7451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8ce00/0x7cee4af5784153c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af5784153c7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002534.769291:0:7451:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8ce00/0x7cee4af5784153c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af5784153c7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.769326:0:7451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8ce00/0x7cee4af5784153c0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784153c7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.769333:0:7451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786002534.769347:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245c8ce00/0x7cee4af5784153c0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af5784153c7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002534.769364:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968596 is committed 00000004:00080000:1.0:1786002534.769376:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 5 committed 00010000:00010000:1.0:1786002534.769401:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578415285 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.769413:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578415285 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.769421:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578415285 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.769427:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002534.769431:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578415285 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.769438:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578415285 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.769449:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x18618557 (ffff9ed2456ef500) 00010000:00010000:1.0:1786002534.769452:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002534.769456:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578415285 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.769462:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578415285 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.769479:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af5784152bd lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.769485:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af5784152bd lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.769490:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af5784152bd lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770576:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002534.770584:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af5784152bd lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770594:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af5784152bd lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770605:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xbc0ca3a9 (ffff9ed244f15900) 00010000:00010000:1.0:1786002534.770608:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002534.770612:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af5784152bd lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770618:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245c8c200/0x7cee4af5784152bd lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770639:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784152f5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770645:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784152f5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770651:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784152f5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770656:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002534.770659:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784152f5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770665:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784152f5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770683:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x84832a57 (ffff9ed2456ef700) 00010000:00010000:1.0:1786002534.770686:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002534.770690:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784152f5 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770696:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784152f5 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770709:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841532d lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770716:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841532d lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770721:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841532d lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770726:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002534.770729:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841532d lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770735:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841532d lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770742:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xdcc87686 (ffff9ed245fed500) 00010000:00010000:1.0:1786002534.770745:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002534.770748:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841532d lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770753:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed35a228200/0x7cee4af57841532d lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770771:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578415365 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770783:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578415365 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770788:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578415365 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770793:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002534.770796:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578415365 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770802:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578415365 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770809:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0xb62e0cbf (ffff9ed2456ef600) 00010000:00010000:1.0:1786002534.770811:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002534.770814:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578415365 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770819:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578415365 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770832:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ac00/0x7cee4af57841539d lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770839:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ac00/0x7cee4af57841539d lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770844:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ac00/0x7cee4af57841539d lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770876:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5ac00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002534.770879:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ac00/0x7cee4af57841539d lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770885:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ac00/0x7cee4af57841539d lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770893:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0xd3:0x0].0x391d5834 (ffff9ed245fede00) 00010000:00010000:1.0:1786002534.770896:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002534.770898:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ac00/0x7cee4af57841539d lrc: 2/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.770904:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f5ac00/0x7cee4af57841539d lrc: 0/0,0 mode: --/TXN res: [0x240000400:0xd3:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002534.772122:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560994944:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1786002534.772186:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.772223:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002534.772230:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560994816:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1786002534.772251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.772282:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560994944 00000100:00100000:0.0:1786002534.772288:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560994944 00000100:00100000:0.0:1786002534.772324:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560994816 00000100:00100000:0.0:1786002534.772327:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560994816 00000100:00100000:0.0:1786002534.772344:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5232 00000100:00100000:0.0:1786002534.772352:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1872758560994944:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1786002534.772375:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2504 count 1 00010000:00010000:0.0:1786002534.772395:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.772415:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c03ff8f/0x7cee4af57841489f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaba expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.772424:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1786002534.772428:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002534.772433:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.772474:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c03ff8f/0x7cee4af57841489f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaba expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.772488:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c03ff8f/0x7cee4af57841489f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaba expref: 10 pid: 8435 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002534.772500:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1872758560995200:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002534.772555:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786002534.772572:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5233 00000100:00100000:0.0:1786002534.772580:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3647:x1872758560994816:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1786002534.772594:0:14678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2505 count 1 00010000:00010000:0.0:1786002534.772604:0:14678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.772615:0:14678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da9092e7/0x7cee4af578414932 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab00 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.772622:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=9s v=(0 0) 00010000:00010000:0.0:1786002534.772625:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002534.772628:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.772644:0:14678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da9092e7/0x7cee4af578414932 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab00 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.772653:0:14678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da9092e7/0x7cee4af578414932 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab00 expref: 10 pid: 8436 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002534.772668:0:14678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14678:1872758560995328:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002534.772701:0:14678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46300 going to sleep for 11 seconds 00000100:00080000:0.0:1786002534.772815:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002534.773384:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560995072:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1786002534.773413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002534.773434:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786002534.773440:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560994688:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1786002534.773474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002534.773491:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560995456:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786002534.773510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002534.773534:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560995072 00000100:00100000:3.0:1786002534.773538:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560995072 00000100:00100000:3.0:1786002534.773563:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560995456 00000100:00100000:3.0:1786002534.773567:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560995456 00000100:00100000:3.0:1786002534.773586:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5234 00000100:00100000:3.0:1786002534.773594:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+7:3644:x1872758560995072:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1786002534.773607:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2506 count 1 00010000:00010000:3.0:1786002534.773622:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.773641:0:14685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af5784150f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac81 expref: 10 pid: 14665 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.773648:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1786002534.773651:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.773655:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.773688:0:14685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af5784150f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac81 expref: 10 pid: 14665 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.773698:0:14685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af5784150f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac81 expref: 10 pid: 14665 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002534.773709:0:14685:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14685:1872758560995840:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002534.773747:0:14685:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed347d3de40 going to sleep for 11 seconds 00000100:00100000:3.0:1786002534.773760:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560994688 00000100:00100000:3.0:1786002534.773764:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560994688 00000100:00100000:3.0:1786002534.773794:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:3.0:1786002534.773800:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3644:x1872758560994688:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1786002534.773809:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002534.773828:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af5784153c7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x50441c1 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af5784153c0 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.773842:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50441c1 (ffff9ed35363d100) 00010000:00010000:3.0:1786002534.773871:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002534.773996:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3644:x1872758560994688:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 194us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.774004:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:3.0:1786002534.774085:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5235 00000100:00100000:3.0:1786002534.774092:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758560995456:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1786002534.774107:0:14676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2508 count 1 00010000:00010000:3.0:1786002534.774161:0:14676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.774174:0:14676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af578415207 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acf1 expref: 9 pid: 14685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.774181:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1786002534.774184:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.774188:0:14676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.774209:0:14676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af578415207 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acf1 expref: 9 pid: 14685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.774218:0:14676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af578415207 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acf1 expref: 9 pid: 14685 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002534.774229:0:14676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14676:1872758560995968:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002534.774258:0:14676:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed347d3dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786002534.774291:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560994688:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1786002534.774317:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560995584:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786002534.774339:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002534.774365:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002534.774370:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560995712:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1786002534.774388:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002534.774410:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560995584 00000100:00100000:3.0:1786002534.774413:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560995584 00000100:00100000:3.0:1786002534.774429:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560995712 00000100:00100000:3.0:1786002534.774431:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560995712 00000100:00100000:3.0:1786002534.774443:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5236 00000100:00100000:3.0:1786002534.774448:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3646:x1872758560995584:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1786002534.774570:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5237 00000100:00100000:1.0:1786002534.774579:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+7:3646:x1872758560995712:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:1.0:1786002534.774592:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2509 count 1 00010000:00010000:1.0:1786002534.774604:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.774615:0:14686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af578415174 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acab expref: 9 pid: 14686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.774622:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1786002534.774625:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002534.774629:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.774646:0:14686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af578415174 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acab expref: 9 pid: 14686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.774656:0:14686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af578415174 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acab expref: 9 pid: 14686 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002534.774666:0:14686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c42680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14686:1872758560996096:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002534.774715:0:14686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed3455453c0 going to sleep for 11 seconds 00000004:00080000:0.0:1786002534.774940:0:9829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 894956091749ns, next at 895956089702ns, rc = 0 00000100:00100000:1.0:1786002534.774969:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786002534.774978:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560996224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002534.775005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002534.775030:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560996224 00000100:00100000:1.0:1786002534.775039:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560996224 00000100:00100000:1.0:1786002534.775067:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1786002534.775073:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3645:x1872758560996224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786002534.775086:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923472384 avail 3691950080 00000100:00100000:1.0:1786002534.775121:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3645:x1872758560996224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002534.775127:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1786002534.775156:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560996224:0@lo:13:osp-pre-1-1.0 00002000:00080000:3.0:1786002534.775394:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2507 count 1 00010000:00010000:3.0:1786002534.775406:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.775418:0:14687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c72fde03/0x7cee4af578415135 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac96 expref: 9 pid: 14676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.775425:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1786002534.775428:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.775431:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.775449:0:14687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c72fde03/0x7cee4af578415135 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac96 expref: 9 pid: 14676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.775520:0:14687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c72fde03/0x7cee4af578415135 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac96 expref: 9 pid: 14676 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002534.775530:0:14687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14687:1872758560996352:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002534.775607:0:14687:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed2434d2540 going to sleep for 11 seconds 00000020:00080000:0.0:1786002534.788062:0:6499:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 418 batchid updated 00000001:00080000:0.0:1786002534.788086:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983604 is committed 00000020:00080000:0.0:1786002534.788099:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 418 00000004:00080000:0.0:1786002534.788155:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245d46000 with version 786 00000020:00080000:0.0:1786002534.788166:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 413 cancel update log [0x240000401:0x3:0x0].408: rc = 0 00000020:00080000:0.0:1786002534.788235:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 413 cancel update log [0x200000400:0x3:0x0].408: rc = 0 00000004:00080000:0.0:1786002534.788256:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245d46540 with version 787 00000020:00080000:0.0:1786002534.788259:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 414 cancel update log [0x240000401:0x3:0x0].409: rc = 0 00000020:00080000:0.0:1786002534.788277:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 414 cancel update log [0x200000400:0x3:0x0].409: rc = 0 00000004:00080000:0.0:1786002534.788297:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245d46f00 with version 788 00000020:00080000:0.0:1786002534.788299:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 415 cancel update log [0x240000401:0x3:0x0].410: rc = 0 00000020:00080000:0.0:1786002534.788317:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 415 cancel update log [0x200000400:0x3:0x0].410: rc = 0 00000004:00080000:0.0:1786002534.788341:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245d46c00 with version 789 00000020:00080000:0.0:1786002534.788344:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 416 cancel update log [0x240000401:0x3:0x0].411: rc = 0 00000020:00080000:0.0:1786002534.788362:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 416 cancel update log [0x200000400:0x3:0x0].411: rc = 0 00000004:00080000:0.0:1786002534.788382:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245d46b40 with version 790 00000020:00080000:0.0:1786002534.788385:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 417 cancel update log [0x240000401:0x3:0x0].412: rc = 0 00000020:00080000:0.0:1786002534.788403:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 417 cancel update log [0x200000400:0x3:0x0].412: rc = 0 00000004:00080000:0.0:1786002534.788420:0:6552:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9ed245d460c0 with version 791 00000020:00080000:0.0:1786002534.788423:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 418 cancel update log [0x240000401:0x3:0x0].413: rc = 0 00000020:00080000:0.0:1786002534.788442:0:6552:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 418 cancel update log [0x200000400:0x3:0x0].413: rc = 0 00000020:00080000:0.0:1786002534.788447:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 418 00000004:00080000:0.0:1786002534.788468:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 786 rpc_version 786 00000020:00100000:0.0:1786002534.788498:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002534.788508:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2448fd880 x1872758560996608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002534.788532:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fd880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560996608:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002534.788594:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.788624:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d46d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786002534.788644:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560996608 00000100:00100000:0.0:1786002534.788651:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560996608 00000100:00100000:0.0:1786002534.788707:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00000100:00100000:0.0:1786002534.788717:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7805:x1872758560996608:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002534.788832:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7805:x1872758560996608:12345-0@lo:1000:osp_up1-0.0 Request processed in 115us (237us total) trans 4294968597 rc 0/0 00000100:00100000:0.0:1786002534.788839:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000100:00100000:0.0:1786002534.788917:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fd880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560996608:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786002534.788927:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 787 rpc_version 787 00000020:00100000:0.0:1786002534.788938:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002534.788943:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2448fca80 x1872758560996864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002534.788956:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560996864:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002534.788980:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.788999:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002534.799009:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560996864 00000100:00100000:2.0:1786002534.799022:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560996864 00000100:00100000:2.0:1786002534.799081:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:2.0:1786002534.799092:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1872758560996864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002534.799274:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560996864:12345-0@lo:1000:osp_up1-0.0 Request processed in 185us (10292us total) trans 4294968598 rc 0/0 00000100:00100000:2.0:1786002534.799282:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:0.0:1786002534.799389:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560996864:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786002534.799403:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 788 rpc_version 788 00000020:00100000:0.0:1786002534.799424:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002534.799431:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2448fe300 x1872758560997120/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002534.799450:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fe300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560997120:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002534.799484:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.799514:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002534.799557:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560997120 00000100:00100000:2.0:1786002534.799562:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560997120 00000100:00100000:2.0:1786002534.799594:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:2.0:1786002534.799601:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7805:x1872758560997120:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002534.799682:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560997120:12345-0@lo:1000:osp_up1-0.0 Request processed in 70us (185us total) trans 4294968599 rc 0/0 00000100:00100000:2.0:1786002534.799688:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:0.0:1786002534.799746:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fe300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560997120:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786002534.799753:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 789 rpc_version 789 00000020:00100000:0.0:1786002534.799764:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002534.799768:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2454c3480 x1872758560997376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002534.799781:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560997376:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002534.799804:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.799825:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002534.800007:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560997376 00000100:00100000:2.0:1786002534.800012:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560997376 00000100:00100000:2.0:1786002534.800040:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:2.0:1786002534.800047:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7805:x1872758560997376:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1786002534.800121:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560997376:12345-0@lo:1000:osp_up1-0.0 Request processed in 75us (316us total) trans 4294968600 rc 0/0 00000100:00100000:2.0:1786002534.800128:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:0.0:1786002534.800227:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560997376:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786002534.800235:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 790 rpc_version 790 00000020:00100000:0.0:1786002534.800247:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002534.800252:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2454c3100 x1872758560997632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002534.800265:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560997632:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002534.800291:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.800307:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002534.800318:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560997632 00000100:00100000:0.0:1786002534.800322:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560997632 00000100:00100000:0.0:1786002534.800345:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:0.0:1786002534.800351:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7805:x1872758560997632:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002534.800423:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560997632:12345-0@lo:1000:osp_up1-0.0 Request processed in 72us (131us total) trans 4294968601 rc 0/0 00000100:00100000:0.0:1786002534.800430:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:0.0:1786002534.800463:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560997632:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1786002534.800470:0:7805:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed37b959840 version 791 rpc_version 791 00000020:00100000:0.0:1786002534.800482:0:7805:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002534.800487:0:7805:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2465ffb80 x1872758560997888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002534.800498:0:7805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465ffb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560997888:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002534.800522:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002534.800539:0:7805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002534.800550:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560997888 00000100:00100000:0.0:1786002534.800553:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560997888 00000100:00100000:0.0:1786002534.800574:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:0.0:1786002534.800580:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7805:x1872758560997888:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1786002534.800647:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:7805:x1872758560997888:12345-0@lo:1000:osp_up1-0.0 Request processed in 66us (123us total) trans 4294968602 rc 0/0 00000100:00100000:0.0:1786002534.800653:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00100000:0.0:1786002534.800697:0:7805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465ffb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7805:1872758560997888:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1786002534.802519:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002534.802539:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002534.802557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002534.802572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002534.802604:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002534.802622:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530926336 00000100:00100000:3.0:1786002534.802628:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530926336 00010000:00010000:3.0:1786002534.802654:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af578415207 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acf1 expref: 10 pid: 14685 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002534.802687:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530926080 00000100:00100000:3.0:1786002534.802690:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530926080 00010000:00010000:3.0:1786002534.802702:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c03ff8f/0x7cee4af57841489f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaba expref: 11 pid: 8435 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002534.802713:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530926464 00000100:00100000:3.0:1786002534.802716:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530926464 00010000:00010000:3.0:1786002534.802724:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af578415174 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acab expref: 11 pid: 14686 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002534.802739:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530926208 00000100:00100000:3.0:1786002534.802741:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530926208 00010000:00010000:3.0:1786002534.802750:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af5784150f6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac81 expref: 12 pid: 14665 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002534.802760:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530926592 00000100:00100000:3.0:1786002534.802762:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530926592 00010000:00010000:3.0:1786002534.802772:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da9092e7/0x7cee4af578414932 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab00 expref: 13 pid: 8436 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002534.802786:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1690 00000100:00100000:3.0:1786002534.802795:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2411:x1872758530926336:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002534.802807:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002534.802812:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af578415207 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acf1 expref: 11 pid: 14685 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.802823:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af578415207 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acf1 expref: 11 pid: 14685 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.802882:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.803617:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.803624:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.803636:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.803658:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002534.803716:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2411:x1872758530926336:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 920us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.803724:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1690 00000100:00100000:3.0:1786002534.803746:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1691 00000100:00100000:3.0:1786002534.803754:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758530926080:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002534.803764:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002534.803770:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c03ff8f/0x7cee4af57841489f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaba expref: 13 pid: 8435 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.803782:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c03ff8f/0x7cee4af57841489f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaba expref: 13 pid: 8435 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.803796:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.803800:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.803804:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.803813:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.803825:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002534.803841:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758530926080:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 88us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.803869:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1691 00000100:00100000:3.0:1786002534.803883:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1692 00000100:00100000:3.0:1786002534.804944:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758530926464:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002534.804958:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002534.804966:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af578415174 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acab expref: 10 pid: 14686 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.804977:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af578415174 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acab expref: 10 pid: 14686 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.804993:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.804997:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.805002:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805009:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805023:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002534.805047:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758530926464:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 1158us (2489us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.805054:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1692 00000100:00100000:3.0:1786002534.805073:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1693 00000100:00100000:3.0:1786002534.805080:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530926208:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002534.805089:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002534.805094:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af5784150f6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac81 expref: 12 pid: 14665 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805102:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af5784150f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac81 expref: 12 pid: 14665 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805114:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.805117:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.805122:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805129:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805140:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002534.805157:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758530926208:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 78us (2584us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.805163:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1693 00000100:00100000:3.0:1786002534.805177:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1694 00000100:00100000:3.0:1786002534.805184:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530926592:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002534.805191:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002534.805197:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da9092e7/0x7cee4af578414932 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab00 expref: 11 pid: 8436 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805212:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da9092e7/0x7cee4af578414932 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab00 expref: 11 pid: 8436 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805224:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.805226:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002534.805231:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805238:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805250:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002534.805267:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758530926592:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 83us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002534.805273:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1694 00010000:00010000:3.0:1786002534.805463:0:14678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da9092e7/0x7cee4af578414932 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ab00 expref: 10 pid: 8436 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002534.805479:0:14678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:14678:1872758560995328:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002534.805498:0:14678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805508:0:14678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805521:0:14678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805532:0:14678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805541:0:14678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805564:0:14678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786002534.805734:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3647:x1872758560994816:12345-0@lo:6:osp-syn-1-1.0 Request processed in 33155us (33481us total) trans 4294969892 rc 0/0 00000100:00100000:3.0:1786002534.805743:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5233 00010000:00010000:3.0:1786002534.805767:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002534.805773:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805781:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002534.805785:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805795:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805808:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805817:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d70d5aff/0x7cee4af5784153ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.805833:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002534.805835:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002534.805836:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002534.805875:0:14676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090e1f129/0x7cee4af578415207 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acf1 expref: 9 pid: 14685 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.807028:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c03ff8f/0x7cee4af57841489f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aaba expref: 9 pid: 8435 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002534.807044:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1872758560995200:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002534.807060:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.807071:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.807079:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.807088:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.807097:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.807115:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786002534.807210:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3647:x1872758560994944:12345-0@lo:6:osp-syn-1-1.0 Request processed in 34858us (35023us total) trans 4294969893 rc 0/0 00000100:00100000:0.0:1786002534.807218:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5232 00010000:00010000:0.0:1786002534.807240:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002534.807245:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.807254:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002534.807258:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.807272:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.807285:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.807292:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e676e01/0x7cee4af5784153f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.807307:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002534.807309:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002534.807311:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002534.808113:0:14676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14676:1872758560995968:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002534.808133:0:14676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.808144:0:14676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.808152:0:14676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.808161:0:14676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.808168:0:14676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.808194:0:14676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786002534.808315:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3644:x1872758560995456:12345-0@lo:6:osp-syn-0-1.0 Request processed in 34222us (34802us total) trans 4294969897 rc 0/0 00000100:00100000:3.0:1786002534.808322:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5235 00000004:00080000:3.0:1786002534.808365:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245c40700/2, rc 0, transno 4294969892 00000100:00100000:3.0:1786002534.808376:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560994816:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1786002534.808386:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245c43b80/2, rc 0, transno 4294969893 00000100:00100000:3.0:1786002534.808389:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560994944:0@lo:6:osp-syn-1-1.0 00000004:00080000:3.0:1786002534.808448:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f3a1c00/2, rc 0, transno 4294969897 00000100:00100000:3.0:1786002534.808453:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560995456:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1786002534.808522:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002534.808529:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.808537:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002534.808541:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.808549:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.808564:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.808576:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076e25387/0x7cee4af57841540d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.808592:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002534.808594:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002534.808595:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002534.809027:0:14686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004d0e1ad/0x7cee4af578415174 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acab expref: 8 pid: 14686 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002534.809039:0:14686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c42680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:14686:1872758560996096:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002534.809064:0:14686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.809073:0:14686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.809080:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.809088:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.809096:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.809117:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786002534.809209:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3646:x1872758560995712:12345-0@lo:6:osp-syn-0-1.0 Request processed in 34630us (34818us total) trans 4294969898 rc 0/0 00000100:00100000:0.0:1786002534.809217:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5237 00000004:00080000:0.0:1786002534.809249:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f3a2300/2, rc 0, transno 4294969898 00000100:00100000:0.0:1786002534.809254:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560995712:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1786002534.809692:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002534.809698:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.809707:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002534.809710:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.809719:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.809731:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.809744:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006411a76d/0x7cee4af578415414 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002534.809758:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002534.809760:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002534.809762:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002534.811008:0:14685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9fdfebb/0x7cee4af5784150f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac81 expref: 8 pid: 14665 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002534.811035:0:14685:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:14685:1872758560995840:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002534.811052:0:14685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002534.811060:0:14685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002534.811066:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002534.811074:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002534.811080:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002534.811101:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786002534.811213:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:3644:x1872758560995072:12345-0@lo:6:osp-syn-1-1.0 Request processed in 37619us (37798us total) trans 4294969894 rc 0/0 00000100:00100000:2.0:1786002534.811220:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5234 00010000:00010000:0.0:1786002534.811372:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002534.811378:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.811386:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5ba00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002534.811389:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.811396:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.811408:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.811414:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9d43255/0x7cee4af578415406 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.811427:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002534.811428:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002534.811430:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786002534.811500:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245c41880/2, rc 0, transno 4294969894 00000100:00100000:3.0:1786002534.811518:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560995072:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1786002534.816286:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002534.816355:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530926720 00000100:00100000:1.0:1786002534.816364:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530926720 00010000:00010000:1.0:1786002534.816401:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c72fde03/0x7cee4af578415135 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac96 expref: 8 pid: 14676 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002534.816445:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1695 00000100:00100000:1.0:1786002534.816456:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2410:x1872758530926720:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002534.816471:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002534.816477:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c72fde03/0x7cee4af578415135 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac96 expref: 8 pid: 14676 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.816492:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c72fde03/0x7cee4af578415135 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac96 expref: 8 pid: 14676 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.816516:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002534.816521:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002534.816527:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.816537:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.816557:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002534.816603:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2410:x1872758530926720:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 149us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002534.816611:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1695 00010000:00010000:0.0:1786002534.816761:0:14687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c72fde03/0x7cee4af578415135 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ac96 expref: 7 pid: 14676 timeout: 994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002534.816775:0:14687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:14687:1872758560996352:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002534.816793:0:14687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.816803:0:14687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.816810:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.816819:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.816826:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002534.816873:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786002534.817070:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3646:x1872758560995584:12345-0@lo:6:osp-syn-0-1.0 Request processed in 42619us (42728us total) trans 4294969899 rc 0/0 00000100:00100000:0.0:1786002534.817078:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5236 00000004:00080000:0.0:1786002534.817112:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f3a0700/2, rc 0, transno 4294969899 00000100:00100000:0.0:1786002534.817118:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758560995584:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1786002534.817772:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002534.817779:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.817789:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002534.817793:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.817810:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.817823:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.817830:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073ac02cd/0x7cee4af57841541b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002534.818071:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002534.818074:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002534.818076:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002535.338079:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002536.298273:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786002536.298295:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560998016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002536.298358:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002536.298542:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560998016 00000100:00100000:0.0:1786002536.298550:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560998016 00000100:00100000:0.0:1786002536.298607:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:0.0:1786002536.298617:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:3644:x1872758560998016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1786002536.298653:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445072896 avail 1298833408 00000100:00100000:0.0:1786002536.298729:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:3644:x1872758560998016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002536.298736:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:3.0:1786002536.298824:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758560998016:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1786002536.362032:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002537.386109:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002538.353567:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002538.353588:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560998144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002538.353665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002538.353726:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560998144 00000100:00100000:2.0:1786002538.353733:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560998144 00000100:00100000:2.0:1786002538.353780:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1786002538.353790:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37c0f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560998144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786002538.353817:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002538.353879:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37c0f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560998144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002538.353896:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1786002538.354097:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560998144:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786002538.354915:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002538.367285:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560998272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002538.367350:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002538.367771:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560998272 00000100:00100000:3.0:1786002538.367780:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560998272 00000100:00100000:3.0:1786002538.367876:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00080000:0.0:1786002538.368066:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002538.368185:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3647:x1872758560998272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786002538.368207:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1786002538.374859:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3647:x1872758560998272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6656us (7485us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002538.374873:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1786002538.383204:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758560998272:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1786002538.385422:0:21189:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_60i skipping SLOW test 60i 00010000:00010000:1.0:1786002538.428938:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002538.840530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002538.840570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002538.840600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002538.840628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002538.840657:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002538.840687:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530927360 00000100:00100000:0.0:1786002538.840696:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530927360 00000100:00100000:0.0:1786002538.840747:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530927232 00000100:00100000:0.0:1786002538.840750:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530927232 00000100:00100000:0.0:1786002538.840777:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 475 00000100:00100000:0.0:1786002538.840787:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758530927360:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002538.840879:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758530927360:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 93us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002538.840888:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 475 00000100:00100000:0.0:1786002538.840906:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 476 00000100:00100000:0.0:1786002538.840913:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758530927232:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002538.840938:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758530927232:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 27us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002538.840944:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 476 00000100:00080000:0.0:1786002538.840960:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786002538.840964:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002538.841338:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530927104 00000100:00100000:1.0:1786002538.841343:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530927104 00000100:00100000:1.0:1786002538.841396:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530926976 00000100:00100000:1.0:1786002538.841399:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530926976 00000100:00100000:1.0:1786002538.841421:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 884 00000100:00100000:1.0:1786002538.841427:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758530927104:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002538.841458:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758530927104:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 32us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002538.841464:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 884 00000100:00100000:1.0:1786002538.841477:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 885 00000100:00100000:1.0:1786002538.841482:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758530926976:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002538.841503:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758530926976:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 21us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002538.841510:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 885 00000100:00080000:2.0:1786002538.841607:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786002538.841611:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786002538.841669:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530926848 00000100:00100000:3.0:1786002538.841674:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530926848 00000100:00100000:3.0:1786002538.841709:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 517 00000100:00100000:3.0:1786002538.841717:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758530926848:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002538.841745:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758530926848:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 29us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002538.841751:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 517 00000100:00100000:3.0:1786002538.858063:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786002538.858094:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560998400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786002538.858166:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002538.859242:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560998400 00000100:00100000:0.0:1786002538.859252:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560998400 00000100:00100000:0.0:1786002538.859307:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:0.0:1786002538.859317:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758560998400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002538.859351:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444065280 avail 1297825792 00000100:00100000:0.0:1786002538.859424:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758560998400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002538.859431:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000100:00100000:3.0:1786002538.860520:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983604 gen 2 00000004:00080000:3.0:1786002538.860527:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983604 committed transno 4294983604 00000020:00080000:3.0:1786002538.860532:0:3645:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed245c66b40 refcount 2 committed 0 result 0 batchid 419 00000020:00080000:3.0:1786002538.860536:0:3645:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245c66540 00000020:00080000:3.0:1786002538.860539:0:3645:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].416 00000020:00080000:3.0:1786002538.860541:0:3645:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed37bcb3e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245efda00 00000020:00080000:3.0:1786002538.860544:0:3645:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].417 00000100:00100000:3.0:1786002538.860583:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560998400:0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1786002538.860637:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 419 committed batchid 418 00000020:00080000:1.0:1786002538.860699:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 418 00010000:00010000:0.0:1786002539.434056:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786002539.883586:0:9829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 900064734714ns, next at 901064732208ns, rc = 0 00000100:00100000:1.0:1786002539.883999:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560998528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002539.884059:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002539.885812:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560998912:0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.885877:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002539.885901:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758560999424:0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.885925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002539.885941:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758560999936:0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.885961:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002539.885999:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1786002539.886005:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872758560999040:0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.886027:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002539.886042:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560999552:0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.886061:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002539.886074:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561000064:0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.886090:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002539.886119:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560999552 00000100:00100000:3.0:1786002539.886125:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560999552 00000100:00100000:3.0:1786002539.886162:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561000064 00000100:00100000:3.0:1786002539.886165:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561000064 00000100:00100000:3.0:1786002539.886193:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1786002539.886202:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3644:x1872758560999552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.886250:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3644:x1872758560999552:12345-0@lo:400:kworker.0 Request processed in 49us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002539.886257:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1786002539.886275:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1786002539.886491:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560998528 00000100:00100000:0.0:1786002539.886496:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560998528 00000100:00100000:0.0:1786002539.886524:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1786002539.886531:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3645:x1872758560998528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786002539.886552:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923484672 avail 3691962368 00000100:00100000:0.0:1786002539.886588:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+8:3645:x1872758560998528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002539.886597:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1786002539.886616:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758560998784:0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.886650:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002539.886668:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758560999296:0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.886688:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002539.886704:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758560999808:0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.886723:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002539.886735:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1786002539.886740:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758560998656:0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.886765:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002539.886786:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560999168:0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.886809:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002539.886826:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560999680:0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.886862:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002539.886888:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560998912 00000100:00100000:0.0:1786002539.886892:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560998912 00000100:00100000:0.0:1786002539.886915:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560999168 00000100:00100000:0.0:1786002539.886918:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560999168 00000100:00100000:0.0:1786002539.886934:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:0.0:1786002539.886940:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758560998912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.886986:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758560998912:12345-0@lo:400:kworker.0 Request processed in 33us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002539.886992:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:0.0:1786002539.887004:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:0.0:1786002539.887010:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:3647:x1872758560999168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.887043:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:3647:x1872758560999168:12345-0@lo:400:kworker.0 Request processed in 32us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002539.887049:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00000100:00100000:0.0:1786002539.887067:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560999424 00000100:00100000:0.0:1786002539.887070:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560999424 00000100:00100000:0.0:1786002539.887089:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560999936 00000100:00100000:0.0:1786002539.887092:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560999936 00000100:00100000:0.0:1786002539.887103:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560999040 00000100:00100000:0.0:1786002539.887106:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560999040 00000100:00100000:0.0:1786002539.887115:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560998784 00000100:00100000:0.0:1786002539.887118:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560998784 00000100:00100000:0.0:1786002539.887127:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560999296 00000100:00100000:0.0:1786002539.887129:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560999296 00000100:00100000:0.0:1786002539.887140:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560999808 00000100:00100000:0.0:1786002539.887142:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560999808 00000100:00100000:0.0:1786002539.887157:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1786002539.887164:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758560999424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.887192:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758560999424:12345-0@lo:400:kworker.0 Request processed in 28us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002539.887198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1786002539.887209:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:0.0:1786002539.887215:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758560999936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.887240:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758560999936:12345-0@lo:400:kworker.0 Request processed in 26us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002539.887246:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:0.0:1786002539.887257:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:0.0:1786002539.887263:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872758560999040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.887301:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872758560999040:12345-0@lo:400:kworker.0 Request processed in 38us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002539.887308:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:0.0:1786002539.887320:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1786002539.887325:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758560998784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.887349:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758560998784:12345-0@lo:400:kworker.0 Request processed in 24us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002539.887354:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1786002539.887365:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:0.0:1786002539.887371:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758560999296:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786002539.887566:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786002539.887570:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786002539.887573:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002539.887604:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560999680 00000100:00100000:2.0:1786002539.887608:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560999680 00000100:00100000:2.0:1786002539.887634:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1786002539.887652:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560999680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002539.887685:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758560999680:12345-0@lo:400:kworker.0 Request processed in 35us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002539.887691:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1786002539.887716:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1786002539.887723:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758560999808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002539.887752:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758560999808:12345-0@lo:400:kworker.0 Request processed in 29us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002539.887758:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1786002539.887801:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758560998528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002539.887877:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872758560999040:0@lo:400:kworker.0 00000100:00100000:2.0:1786002539.887889:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560999552:0@lo:400:kworker.0 00000100:00100000:2.0:1786002539.887898:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758560998912:0@lo:400:kworker.0 00000100:00100000:2.0:1786002539.887906:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758560999424:0@lo:400:kworker.0 00000100:00100000:2.0:1786002539.887914:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758560999936:0@lo:400:kworker.0 00000100:00100000:2.0:1786002539.887955:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758560998656 00000100:00100000:2.0:1786002539.887959:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758560998656 00000100:00100000:2.0:1786002539.887986:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1786002539.887992:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758560998656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002539.888022:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758560998656:12345-0@lo:400:kworker.0 Request processed in 30us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002539.888028:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1786002539.888256:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561000064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.888305:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561000064:12345-0@lo:400:kworker.0 Request processed in 2024us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002539.888311:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1786002539.888349:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758560998656:0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.888360:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560999168:0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.888369:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758560999680:0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.888378:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758560998784:0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.888592:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758560999808:0@lo:400:kworker.0 00000100:00100000:3.0:1786002539.888608:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786002539.888617:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561000192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002539.888655:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002539.888682:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561000192 00000100:00100000:3.0:1786002539.888686:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561000192 00000100:00100000:3.0:1786002539.888709:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1786002539.888715:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561000192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786002539.888726:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923484672 avail 3691962368 00000100:00100000:3.0:1786002539.888757:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561000192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002539.888763:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1786002539.888790:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561000192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002539.890722:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758560999296:12345-0@lo:400:kworker.0 Request processed in 3344us (4025us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002539.890735:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:2.0:1786002539.890967:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561000064:0@lo:400:kworker.0 00000004:00080000:3.0:1786002539.894719:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 7 committed 00000020:00080000:3.0:1786002539.894747:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 419 batchid updated 00000001:00080000:3.0:1786002539.894770:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968602 is committed 00000004:00080000:3.0:1786002539.894782:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 6 committed 00000020:00080000:2.0:1786002539.894843:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 419 00000004:00080000:2.0:1786002539.894934:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed36e7ab600 with version 797 00000020:00080000:2.0:1786002539.894943:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 419 cancel update log [0x200000401:0x3:0x0].416: rc = 0 00000020:00080000:2.0:1786002539.895030:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 419 cancel update log [0x240000400:0x3:0x0].417: rc = 0 00000020:00080000:2.0:1786002539.895038:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 419 00000004:00080000:3.0:1786002539.895163:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 797 rpc_version 797 00000020:00100000:3.0:1786002539.895193:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002539.895204:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed366d6f800 x1872758561000448/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002539.895227:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758561000448:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002539.895304:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002539.895340:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245dcf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002539.896208:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561000448 00000100:00100000:2.0:1786002539.896217:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561000448 00000100:00100000:2.0:1786002539.896271:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:2.0:1786002539.896290:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7466:x1872758561000448:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1786002539.896546:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7466:x1872758561000448:12345-0@lo:1000:osp_up0-1.0 Request processed in 265us (1240us total) trans 4294983605 rc 0/0 00000100:00100000:2.0:1786002539.896555:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00100000:3.0:1786002539.896663:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758561000448:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002539.897124:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002539.897137:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561000704:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1786002539.897173:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002539.897203:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561000704 00000100:00100000:0.0:1786002539.897207:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561000704 00000100:00100000:0.0:1786002539.897237:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5238 00000100:00100000:0.0:1786002539.897244:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3645:x1872758561000704:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1786002539.897263:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2507 count 1 00010000:00010000:0.0:1786002539.897296:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002539.897317:0:14687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a8598c9/0x7cee4af5784151b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acc0 expref: 7 pid: 14691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002539.897332:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=12s v=(0 0) 00010000:00010000:0.0:1786002539.897336:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002539.897341:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002539.897367:0:14687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a8598c9/0x7cee4af5784151b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acc0 expref: 7 pid: 14691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002539.897381:0:14687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a8598c9/0x7cee4af5784151b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acc0 expref: 7 pid: 14691 timeout: 1000 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002539.898458:0:14687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14687:1872758561000832:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002539.898522:0:14687:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786002539.901118:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786002539.901142:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561000576:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1786002539.901200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002539.901959:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758560999296:0@lo:400:kworker.0 00000100:00100000:0.0:1786002539.902161:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561000576 00000100:00100000:0.0:1786002539.902169:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561000576 00000100:00100000:0.0:1786002539.902217:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5239 00000100:00100000:0.0:1786002539.902226:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561000576:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1786002539.902253:0:8764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2508 count 1 00010000:00010000:0.0:1786002539.902276:0:8764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002539.902306:0:8764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000515dfc57/0x7cee4af578415246 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad06 expref: 7 pid: 14678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002539.902321:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=12s v=(0 0) 00010000:00010000:0.0:1786002539.902326:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002539.902331:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002539.902363:0:8764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000515dfc57/0x7cee4af578415246 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad06 expref: 7 pid: 14678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002539.902376:0:8764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000515dfc57/0x7cee4af578415246 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad06 expref: 7 pid: 14678 timeout: 1000 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002539.902989:0:8764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8764:1872758561000960:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002539.903053:0:8764:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f600 going to sleep for 11 seconds 00000100:00100000:1.0:1786002539.907696:0:14687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:14687:1872758561000832:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002539.907724:0:14687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002539.907788:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002539.907870:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530927488 00000100:00100000:2.0:1786002539.907876:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530927488 00010000:00010000:2.0:1786002539.907910:0:10399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a8598c9/0x7cee4af5784151b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acc0 expref: 8 pid: 14691 timeout: 1000 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002539.907947:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1696 00000100:00100000:2.0:1786002539.907958:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2411:x1872758530927488:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002539.907971:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002539.907992:0:10399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a8598c9/0x7cee4af5784151b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acc0 expref: 8 pid: 14691 timeout: 1000 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.908006:0:10399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a8598c9/0x7cee4af5784151b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acc0 expref: 8 pid: 14691 timeout: 1000 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.908029:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a8598c9/0x7cee4af5784151b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3acc0 expref: 8 pid: 14691 timeout: 1000 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.908046:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002539.908050:0:10399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002539.908055:0:10399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.908063:0:10399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.908264:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002539.908319:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530927488:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 362us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002539.908326:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1696 00000001:00080000:2.0:1786002539.910259:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983605 is committed 00000100:00100000:2.0:1786002539.918142:0:8764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8764:1872758561000960:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002539.918173:0:8764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.919511:0:14687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.919523:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.919535:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.919546:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.919605:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786002539.919805:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3645:x1872758561000704:12345-0@lo:6:osp-syn-1-1.0 Request processed in 22559us (22628us total) trans 4294969895 rc 0/0 00000100:00100000:1.0:1786002539.919814:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5238 00000004:00080000:3.0:1786002539.923206:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2465fc700/2, rc 0, transno 4294969895 00000100:00100000:3.0:1786002539.923220:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561000704:0@lo:6:osp-syn-1-1.0 00000001:00080000:0.0:1786002539.925021:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969895 is committed 00010000:00010000:2.0:1786002539.925222:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002539.925231:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.925244:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002539.925248:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.925259:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.925343:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.925352:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000258bdc76/0x7cee4af578415422 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.925374:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002539.925376:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002539.925378:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002539.933543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002539.939734:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530927616 00000100:00100000:1.0:1786002539.939748:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530927616 00010000:00010000:1.0:1786002539.939795:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000515dfc57/0x7cee4af578415246 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad06 expref: 7 pid: 14678 timeout: 1000 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002539.939842:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1697 00000100:00100000:1.0:1786002539.939886:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758530927616:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002539.939899:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002539.939904:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000515dfc57/0x7cee4af578415246 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad06 expref: 7 pid: 14678 timeout: 1000 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.939917:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000515dfc57/0x7cee4af578415246 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad06 expref: 7 pid: 14678 timeout: 1000 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.939939:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000515dfc57/0x7cee4af578415246 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad06 expref: 7 pid: 14678 timeout: 1000 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.939952:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002539.939956:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002539.939960:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.939969:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.939998:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002539.940048:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758530927616:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 164us (6519us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002539.940054:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1697 00010000:00010000:2.0:1786002539.940141:0:8764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.940150:0:8764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.940164:0:8764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.940170:0:8764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002539.940189:0:8764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786002539.940361:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3646:x1872758561000576:12345-0@lo:6:osp-syn-1-1.0 Request processed in 38135us (39160us total) trans 4294969896 rc 0/0 00000100:00100000:2.0:1786002539.940368:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5239 00000100:00100000:2.0:1786002539.940404:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969895 gen 2 00000004:00080000:2.0:1786002539.940408:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245c40700, transno 4294969892 00000004:00080000:2.0:1786002539.940417:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245c43b80, transno 4294969893 00000004:00080000:2.0:1786002539.940419:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245c41880, transno 4294969894 00000004:00080000:2.0:1786002539.940421:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2465fc700, transno 4294969895 00000100:00100000:2.0:1786002539.940427:0:3646:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed2465fe300 x1872758561000576/t4294969896(4294969896) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786002555 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1786002539.940437:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2465fe300/2, rc 0, transno 4294969896 00000100:00100000:2.0:1786002539.940443:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561000576:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1786002539.940519:0:9828:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 1 in progress, 0 in flight, 4 done 00010000:00010000:1.0:1786002539.940744:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002539.940750:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.940758:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002539.940762:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.940770:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.940781:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.940788:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0a9427a/0x7cee4af578415429 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002539.940804:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002539.940805:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002539.940806:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002540.459534:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786002540.908607:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969899 is committed 00000001:02000400:3.0:1786002541.324535:0:21240:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 60j: llog_reader reports corruptions ====== 03:48:58 (1786002538) 00000100:00100000:1.0:1786002541.417959:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002541.417984:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561001088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002541.418051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002541.418228:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561001088 00000100:00100000:3.0:1786002541.418236:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561001088 00000100:00100000:3.0:1786002541.418288:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:3.0:1786002541.418296:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561001088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002541.418326:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445072896 avail 1298833408 00000100:00100000:3.0:1786002541.418370:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561001088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002541.418377:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00100000:3.0:1786002541.418410:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968602 gen 2 00000004:00080000:3.0:1786002541.418415:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968597 committed transno 4294968602 00000004:00080000:3.0:1786002541.418430:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968598 committed transno 4294968602 00000004:00080000:3.0:1786002541.418438:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968599 committed transno 4294968602 00000004:00080000:3.0:1786002541.418445:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968600 committed transno 4294968602 00000004:00080000:3.0:1786002541.418452:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968601 committed transno 4294968602 00000004:00080000:3.0:1786002541.418458:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968602 committed transno 4294968602 00000100:00100000:3.0:1786002541.418482:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561001088:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1786002541.488787:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002542.508484:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786002542.545234:0:21288:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:2.0:1786002543.473424:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561001216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786002543.473492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002543.477175:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561001216 00000100:00100000:3.0:1786002543.477189:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561001216 00000100:00100000:3.0:1786002543.477262:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1786002543.477276:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561001216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786002543.477311:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1786002543.477384:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561001216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (3891us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002543.477392:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00080000:3.0:1786002543.479334:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002543.479434:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969899 gen 2 00000004:00080000:2.0:1786002543.479442:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f3a1c00, transno 4294969897 00000004:00080000:2.0:1786002543.479461:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f3a2300, transno 4294969898 00000004:00080000:2.0:1786002543.479464:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f3a0700, transno 4294969899 00000100:00100000:2.0:1786002543.479481:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561001216:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1786002543.480926:0:8752:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1786002543.482156:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786002543.482174:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561001344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002543.482238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002543.482301:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561001344 00000100:00100000:1.0:1786002543.482308:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561001344 00000100:00100000:1.0:1786002543.482352:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1786002543.482360:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561001344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786002543.482382:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002543.482418:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561001344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002543.482426:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1786002543.482465:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561001344:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786002543.482483:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786002543.573366:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002543.954971:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002543.955058:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002543.956719:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530927872 00000100:00100000:3.0:1786002543.956729:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530927872 00000100:00100000:3.0:1786002543.956811:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 892 00000100:00100000:3.0:1786002543.956821:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2411:x1872758530927872:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002543.956917:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2411:x1872758530927872:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 97us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002543.956925:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 892 00000100:00080000:1.0:1786002543.957368:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002543.959415:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002543.959462:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002543.959572:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530928128 00000100:00100000:1.0:1786002543.959580:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530928128 00000100:00100000:1.0:1786002543.959668:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 480 00000100:00100000:1.0:1786002543.959677:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530928128:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002543.959738:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530928128:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 62us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002543.959744:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 480 00000100:00100000:3.0:1786002543.960071:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530928000 00000100:00100000:3.0:1786002543.960076:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530928000 00000100:00100000:3.0:1786002543.960112:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 893 00000100:00100000:3.0:1786002543.960120:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758530928000:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002543.960165:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758530928000:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 45us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002543.960172:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 893 00000100:00080000:0.0:1786002543.960548:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786002543.960553:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002543.960890:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002543.960954:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530928256 00000100:00100000:3.0:1786002543.960959:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530928256 00000100:00100000:3.0:1786002543.960998:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 481 00000100:00100000:3.0:1786002543.961005:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758530928256:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002543.961038:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758530928256:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 33us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002543.961044:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 481 00000100:00080000:0.0:1786002543.961258:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002543.961509:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530927744 00000100:00100000:2.0:1786002543.961514:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530927744 00000100:00100000:3.0:1786002543.961629:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 519 00000100:00100000:3.0:1786002543.961636:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758530927744:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002543.961675:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758530927744:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 40us (6713us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002543.961682:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 519 00000100:00100000:1.0:1786002543.979223:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561001472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002543.979287:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002543.979381:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561001472 00000100:00100000:1.0:1786002543.979387:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561001472 00000100:00100000:1.0:1786002543.979445:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00100000:1.0:1786002543.979452:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561001472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786002543.979486:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444065280 avail 1297825792 00000100:00100000:1.0:1786002543.979539:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561001472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002543.979544:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:00100000:1.0:1786002543.979579:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294983605 gen 2 00000004:00080000:1.0:1786002543.979585:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294983605 committed transno 4294983605 00000100:00100000:1.0:1786002543.979617:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561001472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786002544.483302:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002544.484748:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530928384 00000100:00100000:0.0:1786002544.484758:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530928384 00000100:00100000:0.0:1786002544.484955:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23949 00000100:00100000:0.0:1786002544.484966:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:19224:x1872758530928384:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1786002544.484995:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002544.485015:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415430 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad14 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.485066:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578415437 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.485076:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578415437 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.485085:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578415437 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002544.485121:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:0.0:1786002544.485124:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786002544.485828:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578415437 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.485883:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415430 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad14 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.485900:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578415437 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad14 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.485908:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002544.485912:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786002544.485915:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34800, rc 0) 00000100:00100000:0.0:1786002544.487590:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:19224:x1872758530928384:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 2619us (4290us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002544.487614:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23949 00000100:00100000:1.0:1786002544.498074:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002544.498154:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530928512 00000100:00100000:2.0:1786002544.498163:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530928512 00000100:00100000:2.0:1786002544.498232:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23950 00000100:00100000:2.0:1786002544.498242:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:19224:x1872758530928512:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002544.498261:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002544.498291:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841543e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad1b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498353:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415445 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498365:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415445 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498375:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415445 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498389:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af57841544c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498396:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af57841544c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498401:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af57841544c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498452:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415445 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498457:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415445 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498461:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415445 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498464:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415445 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498468:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002544.498470:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415445 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498475:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415445 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498483:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002544.498485:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002544.498488:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415445 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498492:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415445 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498498:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af57841544c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498502:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af57841544c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498505:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af57841544c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498508:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002544.498510:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af57841544c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498513:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af57841544c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498516:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff9ed35363db00) 00010000:00010000:2.0:1786002544.498518:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002544.498519:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af57841544c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498522:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af57841544c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498543:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841543e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad1b expref: 10 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498549:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002544.498550:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002544.498552:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841543e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad1b expref: 10 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002544.498557:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a600, rc 0) 00000100:00100000:2.0:1786002544.498613:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:19224:x1872758530928512:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 365us (539us total) trans 0 rc 301/301 00000100:00100000:2.0:1786002544.498623:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23950 00000100:00100000:1.0:1786002544.520831:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002544.521203:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530928768 00000100:00100000:0.0:1786002544.521212:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530928768 00000100:00100000:0.0:1786002544.521318:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23951 00000100:00100000:0.0:1786002544.521330:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:19224:x1872758530928768:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:0.0:1786002544.521384:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002544.521409:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af578415437 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad14 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.521428:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002544.521433:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002544.521513:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415453 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.521526:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415453 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.521535:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415453 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.521550:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841545a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.521556:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841545a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.521567:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841545a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522394:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415461 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522406:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522414:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002544.522429:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9bd1284 reply state 000000002db0e592 transno 4294983606 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522438:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415461 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522445:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed2456f9000) 00010000:00010000:0.0:1786002544.522448:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002544.522450:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1786002544.522454:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1546:0x0]: returning size 4096 00010000:00010000:0.0:1786002544.522462:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415453 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522468:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415453 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522473:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415453 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522479:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415453 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522486:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002544.522490:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415453 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522498:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415453 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522506:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002544.522509:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002544.522512:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415453 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522518:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415453 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002544.522529:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9bd1284 reply state 000000002db0e592 transno 4294983606 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841545a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522537:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841545a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002544.522542:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff9ed2456f9300) 00010000:00010000:0.0:1786002544.522545:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002544.522546:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1786002544.522636:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:19224:x1872758530928768:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 1306us (1811us total) trans 4294983606 rc 0/0 00000100:00100000:0.0:1786002544.522644:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23951 00010000:00010000:1.0:1786002544.625796:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002545.004021:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786002545.004043:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561001600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002545.004112:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002545.004174:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561001600 00000100:00100000:3.0:1786002545.004181:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561001600 00000100:00100000:3.0:1786002545.004232:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1786002545.004241:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561001600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786002545.004267:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1786002545.004308:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561001600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002545.004314:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00080000:3.0:1786002545.004335:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002545.004368:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561001600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002545.004722:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561002112:0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.004755:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002545.004783:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561002624:0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.004806:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002545.004825:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561003136:0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.004843:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002545.004883:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1786002545.004889:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561001984:0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.004913:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002545.004927:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561002496:0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.004958:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002545.004976:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561003008:0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.004995:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002545.005019:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561002624 00000100:00100000:0.0:1786002545.005023:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561002624 00000100:00100000:0.0:1786002545.005050:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561003136 00000100:00100000:0.0:1786002545.005053:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561003136 00000100:00100000:0.0:1786002545.005070:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1786002545.005077:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561002624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.005113:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561002624:12345-0@lo:400:kworker.0 Request processed in 37us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002545.005120:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1786002545.005133:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1786002545.005139:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1872758561003136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.005164:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1872758561003136:12345-0@lo:400:kworker.0 Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002545.005170:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1786002545.005190:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561002112 00000100:00100000:0.0:1786002545.005194:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561002112 00000100:00100000:0.0:1786002545.005217:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561002496 00000100:00100000:0.0:1786002545.005219:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561002496 00000100:00100000:0.0:1786002545.005236:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561003008 00000100:00100000:0.0:1786002545.005239:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561003008 00000100:00100000:0.0:1786002545.005253:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:0.0:1786002545.005259:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561002112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.005288:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561002112:12345-0@lo:400:kworker.0 Request processed in 29us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002545.005294:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:0.0:1786002545.005306:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:0.0:1786002545.005312:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561002496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.005338:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561002496:12345-0@lo:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002545.005343:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:0.0:1786002545.005355:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1786002545.005360:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561003008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.005385:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561003008:12345-0@lo:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002545.005390:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1786002545.005622:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561002496:0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.005636:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561003008:0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.005645:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561002112:0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.005654:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561002624:0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.005662:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561003136:0@lo:400:kworker.0 00000100:00100000:3.0:1786002545.005739:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561001728:0@lo:400:kworker.0 00000100:00100000:3.0:1786002545.005771:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002545.005804:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561002240:0@lo:400:kworker.0 00000100:00100000:3.0:1786002545.005826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002545.005869:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561002752:0@lo:400:kworker.0 00000100:00100000:3.0:1786002545.005890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002545.005910:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1786002545.005916:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561001856:0@lo:400:kworker.0 00000100:00100000:1.0:1786002545.006024:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561001984 00000100:00100000:1.0:1786002545.006029:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561001984 00000100:00100000:1.0:1786002545.006054:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561002240 00000100:00100000:1.0:1786002545.006057:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561002240 00000100:00100000:1.0:1786002545.006073:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00100000:1.0:1786002545.006079:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561001984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002545.006118:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561001984:12345-0@lo:400:kworker.0 Request processed in 38us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002545.006125:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00000100:00100000:1.0:1786002545.006138:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00000100:00100000:1.0:1786002545.006143:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561002240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002545.006169:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561002240:12345-0@lo:400:kworker.0 Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002545.006175:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00000100:00100000:1.0:1786002545.006206:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561001984:0@lo:400:kworker.0 00000100:00100000:3.0:1786002545.006239:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002545.006267:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561002368:0@lo:400:kworker.0 00000100:00100000:3.0:1786002545.006291:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002545.006308:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561002880:0@lo:400:kworker.0 00000100:00100000:3.0:1786002545.006327:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002545.006348:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561002240:0@lo:400:kworker.0 00000100:00100000:3.0:1786002545.006374:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561001856 00000100:00100000:3.0:1786002545.006377:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561001856 00000100:00100000:3.0:1786002545.006394:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561002368 00000100:00100000:3.0:1786002545.006397:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561002368 00000100:00100000:1.0:1786002545.006516:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561002880 00000100:00100000:1.0:1786002545.006520:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561002880 00000100:00100000:1.0:1786002545.006539:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1786002545.006545:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561001856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002545.006581:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561001856:12345-0@lo:400:kworker.0 Request processed in 37us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002545.006587:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1786002545.006613:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:1.0:1786002545.006621:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561002880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002545.006647:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561002880:12345-0@lo:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002545.006654:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:1.0:1786002545.006676:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561001856:0@lo:400:kworker.0 00000100:00100000:1.0:1786002545.006685:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561002880:0@lo:400:kworker.0 00000100:00100000:3.0:1786002545.006774:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1786002545.006782:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561002368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002545.006818:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561002368:12345-0@lo:400:kworker.0 Request processed in 38us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002545.006824:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:0.0:1786002545.006884:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561001728 00000100:00100000:0.0:1786002545.006889:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561001728 00000100:00100000:0.0:1786002545.006916:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1786002545.006922:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561001728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002545.006964:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561001728:12345-0@lo:400:kworker.0 Request processed in 42us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002545.006971:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1786002545.011580:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002545.011621:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561003264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002545.011686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002545.011735:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561003264 00000100:00100000:2.0:1786002545.011742:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561003264 00000100:00100000:2.0:1786002545.011796:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1786002545.011805:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872758561003264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002545.011826:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1786002545.011891:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872758561003264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002545.011898:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1786002545.011955:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561003264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002545.013108:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561002752 00000100:00100000:2.0:1786002545.013115:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561002752 00000100:00100000:2.0:1786002545.013158:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1786002545.013166:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561002752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002545.013214:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561002752:12345-0@lo:400:kworker.0 Request processed in 49us (7322us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002545.013221:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00080000:2.0:1786002545.013242:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786002545.013247:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786002545.013250:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786002545.013251:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002545.014647:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561002368:0@lo:400:kworker.0 00000100:00100000:3.0:1786002545.014662:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561001728:0@lo:400:kworker.0 00000100:00100000:3.0:1786002545.014674:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561002752:0@lo:400:kworker.0 00010000:00010000:1.0:1786002545.650183:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786002546.031865:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969896 is committed 00000100:00100000:3.0:1786002546.539086:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002546.539109:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561003392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786002546.539234:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002546.539486:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561003392 00000100:00100000:1.0:1786002546.539493:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561003392 00000100:00100000:1.0:1786002546.539543:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037 00000100:00100000:1.0:1786002546.539552:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561003392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786002546.539581:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445072896 avail 1298833408 00000100:00100000:1.0:1786002546.539635:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561003392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002546.539644:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037 00000100:00100000:1.0:1786002546.539680:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561003392:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1786002546.673034:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786002547.508188:0:21483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00010000:00010000:1.0:1786002547.694243:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002548.598868:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002548.598889:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561003520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002548.598980:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002548.599045:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561003648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002548.599069:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002548.599413:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561003520 00000100:00100000:2.0:1786002548.599421:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561003520 00000100:00100000:2.0:1786002548.599492:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561003648 00000100:00100000:2.0:1786002548.599496:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561003648 00000100:00100000:2.0:1786002548.599514:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1786002548.599523:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561003520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786002548.599564:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002548.599619:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561003520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002548.599626:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1786002548.599643:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1786002548.599650:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561003648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786002548.599660:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002548.599685:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561003648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002548.599690:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00080000:0.0:1786002548.599763:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002548.621681:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561003648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002548.621704:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561003520:0@lo:13:osp-pre-0-1.0 00000020:00000080:2.0:1786002548.701365:0:21531:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffe724129c0 00000004:00000080:2.0:1786002548.701380:0:21531:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff9ed382059000 uarg=0000000000000000 00000004:00000080:2.0:1786002548.701419:0:21531:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff9ed382059000 00000040:00080000:2.0:1786002548.708063:0:21531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786002548.708214:0:21531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1786002548.708304:0:21531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 80 off8272 00000004:00000080:2.0:1786002548.708323:0:21531:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl1', mask 0x0 00000004:02000000:2.0:1786002548.708327:0:21531:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00010000:00010000:1.0:1786002548.717350:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002549.078581:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002549.078680:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002549.078714:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002549.078732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002549.078752:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002549.078776:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530929408 00000100:00100000:1.0:1786002549.078785:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530929408 00000100:00100000:1.0:1786002549.078834:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530929280 00000100:00100000:1.0:1786002549.078837:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530929280 00000100:00100000:1.0:1786002549.078884:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 485 00000100:00100000:1.0:1786002549.078894:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758530929408:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002549.079492:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530929152 00000100:00100000:3.0:1786002549.079497:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530929152 00000100:00100000:3.0:1786002549.079615:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530929024 00000100:00100000:3.0:1786002549.079618:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530929024 00000100:00100000:3.0:1786002549.079639:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 900 00000100:00100000:3.0:1786002549.079646:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530929152:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002549.079708:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530929152:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 61us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002549.079719:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 900 00000100:00100000:3.0:1786002549.079740:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 901 00000100:00100000:3.0:1786002549.079747:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2411:x1872758530929024:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002549.079776:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2411:x1872758530929024:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 29us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002549.079782:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 901 00000100:00100000:3.0:1786002549.079900:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 486 00000100:00100000:3.0:1786002549.079909:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530929280:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002549.080451:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758530929408:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 1556us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002549.080459:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 485 00000100:00100000:2.0:1786002549.080571:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530928896 00000100:00100000:2.0:1786002549.080587:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530928896 00000100:00100000:2.0:1786002549.080620:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 521 00000100:00100000:2.0:1786002549.080628:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758530928896:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002549.085326:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530929280:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 5408us (6561us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002549.085339:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 486 00000100:00080000:3.0:1786002549.085388:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786002549.085393:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786002549.085396:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786002549.085398:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002549.100295:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561003776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002549.100455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002549.100518:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561003776 00000100:00100000:1.0:1786002549.100525:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561003776 00000100:00100000:1.0:1786002549.100565:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038 00000100:00100000:1.0:1786002549.100581:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561003776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786002549.100612:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444028416 avail 1297788928 00000100:00100000:1.0:1786002549.100653:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561003776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002549.100660:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038 00000100:00100000:1.0:1786002549.100702:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561003776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002549.104254:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758530928896:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23619us (25680us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002549.104267:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 521 00000001:00080000:2.0:1786002549.611460:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983606 is committed 00010000:00010000:0.0:1786002549.611768:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841545a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.611781:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841545a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.611789:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841545a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.611796:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002549.611801:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841545a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.611809:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841545a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.611831:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff9ed2456f9300) 00010000:00010000:0.0:1786002549.611835:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002549.611839:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841545a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.612927:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af57841545a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.612983:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415461 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.612991:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415461 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.612998:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415461 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.613004:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002549.613007:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415461 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.613014:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415461 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.613024:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed2456f9000) 00010000:00010000:0.0:1786002549.613027:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002549.613031:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415461 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002549.613036:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578415461 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002549.742174:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002550.123035:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786002550.123059:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561003904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002550.123145:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002550.123324:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561003904 00000100:00100000:1.0:1786002550.123330:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561003904 00000100:00100000:1.0:1786002550.123384:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1786002550.123392:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561003904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786002550.123415:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1786002550.123455:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561003904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002550.123461:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1786002550.123480:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561004032:0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.123518:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002550.123538:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561004544:0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.123557:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002550.123583:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561005056:0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.123605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002550.123660:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1786002550.123667:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561004160:0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.123693:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002550.123711:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561004672:0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.123730:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002550.123743:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561005184:0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.123759:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786002550.123782:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002550.123795:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561004032 00000100:00100000:1.0:1786002550.123798:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561004032 00000100:00100000:1.0:1786002550.123822:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1786002550.123828:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561004032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.123884:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561004032:12345-0@lo:400:kworker.0 Request processed in 55us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002550.123890:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1786002550.124074:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561004544 00000100:00100000:1.0:1786002550.124078:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561004544 00000100:00100000:1.0:1786002550.124213:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039 00000100:00100000:1.0:1786002550.124220:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561004544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.124255:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561004544:12345-0@lo:400:kworker.0 Request processed in 36us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002550.124260:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039 00000100:00100000:1.0:1786002550.124278:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561005056 00000100:00100000:1.0:1786002550.124281:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561005056 00000100:00100000:1.0:1786002550.124311:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1786002550.124317:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561005056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.124452:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561005056:12345-0@lo:400:kworker.0 Request processed in 29us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002550.124459:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1786002550.124479:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561004160 00000100:00100000:1.0:1786002550.124482:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561004160 00000100:00100000:1.0:1786002550.124507:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561004672 00000100:00100000:1.0:1786002550.124510:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561004672 00000100:00100000:1.0:1786002550.124597:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561005184 00000100:00100000:1.0:1786002550.124601:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561005184 00000100:00100000:1.0:1786002550.124617:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1786002550.124622:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561004160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.124651:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561004160:12345-0@lo:400:kworker.0 Request processed in 29us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002550.124657:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1786002550.124727:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:1.0:1786002550.124734:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561004672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.124763:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561004672:12345-0@lo:400:kworker.0 Request processed in 30us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002550.124768:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:1.0:1786002550.124779:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1786002550.124784:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561005184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.124807:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561005184:12345-0@lo:400:kworker.0 Request processed in 23us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002550.124812:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00080000:1.0:1786002550.124862:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786002550.124865:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002550.124878:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561004288:0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.124903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002550.126995:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561004160:0@lo:400:kworker.0 00000100:00100000:0.0:1786002550.127009:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561004672:0@lo:400:kworker.0 00000100:00100000:0.0:1786002550.127018:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561005184:0@lo:400:kworker.0 00000100:00100000:0.0:1786002550.127025:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561004032:0@lo:400:kworker.0 00000100:00100000:0.0:1786002550.127034:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561004544:0@lo:400:kworker.0 00000100:00100000:0.0:1786002550.127042:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561005056:0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.127650:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561004800:0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.127704:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002550.127722:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561005312:0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.127743:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002550.127764:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969896 gen 2 00000004:00080000:1.0:1786002550.127769:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2465fe300, transno 4294969896 00000100:00100000:1.0:1786002550.127791:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561003904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002550.127823:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561004800 00000100:00100000:1.0:1786002550.127829:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561004800 00000100:00100000:1.0:1786002550.127889:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561005312 00000100:00100000:1.0:1786002550.127892:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561005312 00000100:00100000:1.0:1786002550.127912:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1786002550.127921:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561004800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.127965:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561004800:12345-0@lo:400:kworker.0 Request processed in 45us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002550.127972:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1786002550.127986:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:1.0:1786002550.127991:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561005312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.128013:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561005312:12345-0@lo:400:kworker.0 Request processed in 22us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002550.128019:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00080000:1.0:1786002550.128037:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002550.128055:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561004800:0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.128063:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561005312:0@lo:400:kworker.0 00000100:00100000:0.0:1786002550.130879:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561004288 00000100:00100000:0.0:1786002550.130890:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561004288 00000100:00100000:0.0:1786002550.131636:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040 00000100:00100000:0.0:1786002550.131647:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561004288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002550.131794:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561004288:12345-0@lo:400:kworker.0 Request processed in 148us (6889us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002550.131802:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040 00000100:00100000:0.0:1786002550.132813:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561005568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002550.132866:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002550.133748:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561004288:0@lo:400:kworker.0 00000100:00100000:2.0:1786002550.134027:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561005568 00000100:00100000:2.0:1786002550.134033:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561005568 00000100:00100000:2.0:1786002550.134082:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1786002550.134101:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561005568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002550.134120:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1786002550.134171:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561005568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002550.134177:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1786002550.134213:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561005568:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1786002550.134494:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002550.136447:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561004416:0@lo:400:kworker.0 00000100:00100000:3.0:1786002550.136503:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002550.136537:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561004928:0@lo:400:kworker.0 00000100:00100000:3.0:1786002550.136556:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002550.136585:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561005440:0@lo:400:kworker.0 00000100:00100000:3.0:1786002550.136605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002550.137296:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561004416 00000100:00100000:1.0:1786002550.137304:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561004416 00000100:00100000:1.0:1786002550.137361:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:1.0:1786002550.137371:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561004416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002550.137425:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561004416:12345-0@lo:400:kworker.0 Request processed in 56us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002550.137432:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:3.0:1786002550.137965:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561004416:0@lo:400:kworker.0 00000100:00100000:0.0:1786002550.139634:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561004928 00000100:00100000:0.0:1786002550.139642:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561004928 00000100:00100000:0.0:1786002550.139696:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561005440 00000100:00100000:0.0:1786002550.139699:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561005440 00000100:00100000:0.0:1786002550.139719:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1786002550.139727:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561004928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002550.139789:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561004928:12345-0@lo:400:kworker.0 Request processed in 62us (3231us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002550.139798:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1786002550.139812:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1786002550.139819:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561005440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002550.139862:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561005440:12345-0@lo:400:kworker.0 Request processed in 29us (3241us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002550.139867:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1786002550.139900:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561004928:0@lo:400:kworker.0 00000100:00100000:0.0:1786002550.139921:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561005440:0@lo:400:kworker.0 00000100:00080000:1.0:1786002550.140441:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786002550.767484:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786002551.474679:0:21627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:3.0:1786002551.662110:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786002551.662131:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561005696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786002551.662195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002551.662291:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561005696 00000100:00100000:1.0:1786002551.662298:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561005696 00000100:00100000:1.0:1786002551.662351:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041 00000100:00100000:1.0:1786002551.662361:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561005696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786002551.662393:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445072896 avail 1298833408 00000100:00100000:1.0:1786002551.662471:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561005696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002551.662479:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041 00000100:00100000:1.0:1786002551.662520:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561005696:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786002551.787003:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002552.812201:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786002553.102140:0:21675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffd56c8a4f0 00000004:00000080:2.0:1786002553.102158:0:21675:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=424066b1 len=576 karg=ffff9ed382058000 uarg=0000000000000000 00000004:00000080:2.0:1786002553.102202:0:21675:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b1 len=576 karg=ffff9ed382058000 00000040:00080000:2.0:1786002553.102408:0:21675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786002553.102572:0:21675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1786002553.102683:0:21675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 80 off8272 00000004:00000080:2.0:1786002553.102701:0:21675:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0001: registered changelog user 'cl1', mask 0x0 00000004:02000000:2.0:1786002553.102704:0:21675:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0001: changelog on 00000100:00100000:0.0:1786002553.709312:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561005952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002553.709380:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002553.709445:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002553.709452:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561005824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002553.709476:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002553.709514:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561005952 00000100:00100000:0.0:1786002553.709521:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561005952 00000100:00100000:0.0:1786002553.709597:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561005824 00000100:00100000:0.0:1786002553.709601:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561005824 00000100:00100000:0.0:1786002553.709620:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1786002553.709630:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561005952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786002553.709656:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1786002553.709698:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561005952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002553.709704:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1786002553.709722:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1786002553.709728:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561005824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786002553.709737:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67509696 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1786002553.709761:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561005824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002553.709766:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1786002553.709807:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561005824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002553.709818:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561005952:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1786002553.713888:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786002553.839480:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002554.204467:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002554.204791:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530929536 00000100:00100000:2.0:1786002554.204800:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530929536 00000100:00100000:2.0:1786002554.204875:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 523 00000100:00100000:2.0:1786002554.204884:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758530929536:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002554.204954:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758530929536:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 72us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002554.204962:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 523 00000100:00100000:0.0:1786002554.206900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002554.206935:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002554.206998:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530929792 00000100:00100000:1.0:1786002554.207004:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530929792 00000100:00100000:1.0:1786002554.207066:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 908 00000100:00100000:1.0:1786002554.207075:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758530929792:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002554.207123:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758530929792:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 50us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002554.207130:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 908 00000100:00080000:2.0:1786002554.207299:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786002554.207336:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530930048 00000100:00100000:3.0:1786002554.207340:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530930048 00000100:00100000:3.0:1786002554.207384:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 490 00000100:00100000:3.0:1786002554.207392:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758530930048:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002554.207469:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758530930048:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 78us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002554.207476:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 490 00000100:00080000:2.0:1786002554.207659:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002554.218586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002554.218620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002554.218718:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530929920 00000100:00100000:3.0:1786002554.218727:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530929920 00000100:00100000:3.0:1786002554.218791:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 491 00000100:00100000:3.0:1786002554.218800:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758530929920:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002554.218895:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758530929920:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 96us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002554.218902:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 491 00000100:00080000:2.0:1786002554.219033:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002554.219765:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530929664 00000100:00100000:1.0:1786002554.219771:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530929664 00000100:00100000:1.0:1786002554.219818:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 909 00000100:00100000:1.0:1786002554.219826:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2410:x1872758530929664:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002554.219889:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2410:x1872758530929664:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 54us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002554.219896:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 909 00000100:00080000:0.0:1786002554.220132:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002554.220509:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002554.220524:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561006080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002554.220585:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002554.220713:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561006080 00000100:00100000:0.0:1786002554.220717:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561006080 00000100:00100000:0.0:1786002554.220747:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042 00000100:00100000:0.0:1786002554.220753:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561006080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002554.220775:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444028416 avail 1297788928 00000100:00100000:0.0:1786002554.220818:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561006080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002554.220824:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042 00000100:00100000:2.0:1786002554.220996:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561006080:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1786002554.859066:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002555.247328:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561006208:0@lo:400:kworker.0 00000100:00100000:2.0:1786002555.247396:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002555.247450:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002555.247456:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561006592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002555.247497:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002555.247547:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561006208 00000100:00100000:2.0:1786002555.247554:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561006208 00000100:00100000:2.0:1786002555.247602:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1786002555.247611:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561006208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002555.247655:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561006208:12345-0@lo:400:kworker.0 Request processed in 46us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002555.247661:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1786002555.247707:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561006208:0@lo:400:kworker.0 00000100:00100000:2.0:1786002555.248653:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561006592 00000100:00100000:2.0:1786002555.248659:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561006592 00000100:00100000:2.0:1786002555.248695:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:2.0:1786002555.248702:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561006592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002555.248723:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1786002555.248762:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561006592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002555.248769:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:2.0:1786002555.248788:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561006464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002555.248812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002555.248834:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002555.248841:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561006336:0@lo:400:kworker.0 00000100:00100000:2.0:1786002555.248892:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002555.248923:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561006464 00000100:00100000:2.0:1786002555.248927:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561006464 00000100:00100000:2.0:1786002555.248949:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1786002555.248955:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561006464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002555.248964:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67476928 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1786002555.249004:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561006464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002555.249010:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1786002555.249042:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561006464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002555.249075:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561006592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002555.255414:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561006336 00000100:00100000:1.0:1786002555.255427:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561006336 00000100:00100000:1.0:1786002555.255478:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1786002555.255625:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561006336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002555.255704:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561006336:12345-0@lo:400:kworker.0 Request processed in 218us (6812us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002555.255712:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1786002555.255766:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002555.255778:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561006720:0@lo:400:kworker.0 00000100:00100000:1.0:1786002555.255813:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002555.255860:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561006720 00000100:00100000:1.0:1786002555.255864:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561006720 00000100:00100000:2.0:1786002555.256167:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561006336:0@lo:400:kworker.0 00000100:00100000:1.0:1786002555.257675:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043 00000100:00100000:1.0:1786002555.257684:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561006720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002555.257734:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561006720:12345-0@lo:400:kworker.0 Request processed in 51us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002555.257741:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043 00000100:00100000:1.0:1786002555.257774:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561006720:0@lo:400:kworker.0 00000100:00100000:2.0:1786002555.257888:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758561006848:0@lo:400:kworker.0 00000100:00100000:2.0:1786002555.257920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786002555.265023:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002555.271757:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561007104:0@lo:400:kworker.0 00000100:00100000:1.0:1786002555.271823:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002555.271963:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561006976:0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.272004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002555.272039:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561006976 00000100:00100000:0.0:1786002555.272045:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561006976 00000100:00100000:0.0:1786002555.272095:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044 00000100:00100000:0.0:1786002555.272104:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561006976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.272150:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561006976:12345-0@lo:400:kworker.0 Request processed in 47us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002555.272157:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044 00000100:00100000:0.0:1786002555.272195:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561006976:0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.272241:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561007232:0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.272264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002555.272294:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002555.272300:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561007360:0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.272320:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002555.272339:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561007360 00000100:00100000:0.0:1786002555.272342:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561007360 00000100:00100000:0.0:1786002555.272371:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1786002555.272377:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561007360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.272406:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561007360:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002555.272412:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00080000:0.0:1786002555.272425:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002555.272440:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561007360:0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.272463:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561007488:0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.272484:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002555.272524:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002555.272537:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561007616:0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.272691:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002555.272732:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561007744:0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.272754:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002555.272790:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561007488 00000100:00100000:0.0:1786002555.272793:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561007488 00000100:00100000:0.0:1786002555.272818:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1786002555.272823:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561007488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.272929:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561007488:12345-0@lo:400:kworker.0 Request processed in 48us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002555.272936:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1786002555.272954:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561006848 00000100:00100000:0.0:1786002555.272958:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561006848 00000100:00100000:0.0:1786002555.272975:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561007104 00000100:00100000:0.0:1786002555.272977:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561007104 00000100:00100000:0.0:1786002555.273116:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561007232 00000100:00100000:0.0:1786002555.273119:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561007232 00000100:00100000:0.0:1786002555.273129:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561007616 00000100:00100000:0.0:1786002555.273132:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561007616 00000100:00100000:0.0:1786002555.273142:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561007744 00000100:00100000:0.0:1786002555.273144:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561007744 00000100:00100000:0.0:1786002555.273156:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1786002555.273161:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758561006848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.273191:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758561006848:12345-0@lo:400:kworker.0 Request processed in 30us (15271us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002555.273197:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1786002555.273207:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1786002555.273213:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561007104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.273234:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561007104:12345-0@lo:400:kworker.0 Request processed in 21us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002555.273243:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1786002555.273251:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1786002555.273256:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561007232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.273280:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561007232:12345-0@lo:400:kworker.0 Request processed in 24us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002555.273286:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1786002555.273295:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:0.0:1786002555.273301:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561007616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.273322:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561007616:12345-0@lo:400:kworker.0 Request processed in 22us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002555.273328:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:0.0:1786002555.273337:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:0.0:1786002555.273342:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561007744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.273362:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561007744:12345-0@lo:400:kworker.0 Request processed in 20us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002555.273367:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00080000:0.0:1786002555.273381:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786002555.273384:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786002555.273386:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002555.273403:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561007488:0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.273420:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561007744:0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.273428:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561007616:0@lo:400:kworker.0 00000100:00100000:0.0:1786002555.273436:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561007232:0@lo:400:kworker.0 00000100:00100000:1.0:1786002555.273953:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561007104:0@lo:400:kworker.0 00000100:00100000:2.0:1786002555.275209:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758561006848:0@lo:400:kworker.0 00010000:00010000:3.0:1786002555.885403:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002556.271872:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002556.271908:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530930176 00000100:00100000:1.0:1786002556.271918:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530930176 00000100:00100000:1.0:1786002556.271986:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23952 00000100:00100000:1.0:1786002556.271997:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:19365:x1872758530930176:12345-192.168.203.49@tcp:46:lfs.0 00000004:00000080:1.0:1786002556.272039:0:14496:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9ed34bf59218 uarg=0000000000000000 00000004:00000080:1.0:1786002556.272089:0:14496:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9ed34bf59218 00000004:00000080:1.0:1786002556.272095:0:14496:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:1.0:1786002556.272130:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786002556.272133:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1786002556.272150:0:14496:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 0 00000040:00080000:1.0:1786002556.272197:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:1.0:1786002556.272203:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1786002556.272207:0:14496:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000100:00080000:0.0:1786002556.272742:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1786002556.273312:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1786002556.276181:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:19365:x1872758530930176:12345-192.168.203.49@tcp:46:lfs.0 Request processed in 4177us (4323us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002556.276197:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23952 00000100:00100000:1.0:1786002556.381249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002556.381313:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530930304 00000100:00100000:0.0:1786002556.381322:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530930304 00000100:00100000:0.0:1786002556.381394:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23953 00000100:00100000:0.0:1786002556.381405:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:19368:x1872758530930304:12345-192.168.203.49@tcp:46:lfs.0 00000004:00000080:0.0:1786002556.381445:0:10360:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=424066b3 len=12 karg=ffff9ed34bf593f8 uarg=0000000000000000 00000004:00000080:0.0:1786002556.381500:0:10360:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b3 len=12 karg=ffff9ed34bf593f8 00000004:00000080:0.0:1786002556.381682:0:10360:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=1, endrec=0 00000040:00080000:0.0:1786002556.381721:0:10360:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786002556.381725:0:10360:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1786002556.381743:0:10360:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl1 endrec = 0 00000040:00080000:0.0:1786002556.381793:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1786002556.381799:0:10360:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1786002556.381803:0:10360:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:0.0:1786002556.383216:0:10360:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00080000:1.0:1786002556.383396:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002556.383971:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:19368:x1872758530930304:12345-192.168.203.49@tcp:46:lfs.0 Request processed in 2562us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002556.383985:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23953 00000100:00100000:2.0:1786002556.422929:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002556.423080:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530930432 00000100:00100000:0.0:1786002556.423089:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530930432 00000100:00100000:0.0:1786002556.423146:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23954 00000100:00100000:0.0:1786002556.423156:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:19369:x1872758530930432:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002556.423175:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002556.423240:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415468 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad22 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.423303:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841546f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.423315:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841546f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.423326:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841546f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002556.423367:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:0.0:1786002556.423372:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786002556.423389:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841546f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.423413:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415468 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad22 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.423428:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841546f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad22 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.423435:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002556.423438:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786002556.423441:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34800, rc 0) 00000100:00100000:0.0:1786002556.423635:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:19369:x1872758530930432:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 479us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002556.423643:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23954 00000100:00100000:0.0:1786002556.465212:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002556.469129:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530930560 00000100:00100000:1.0:1786002556.469142:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530930560 00000100:00100000:1.0:1786002556.469200:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23955 00000100:00100000:1.0:1786002556.469209:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:19369:x1872758530930560:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002556.469226:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002556.469245:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578415476 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad29 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.469307:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841547d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.469320:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841547d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.469331:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841547d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.469345:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415484 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.469352:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.469358:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.469425:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af57841548b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.469434:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af57841548b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.469441:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af57841548b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002556.469472:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1546:0x0]: returning size 4096 00000004:00200000:1.0:1786002556.469475:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786002556.469491:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af57841548b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.471952:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841547d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.471966:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841547d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.471972:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841547d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.471979:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841547d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.471985:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002556.471989:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841547d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.471996:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841547d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.472010:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002556.472014:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002556.472019:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841547d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.472026:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841547d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.472041:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.472935:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415484 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.472946:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415484 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.472951:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002556.472954:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415484 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.472961:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415484 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.472971:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff9ed245e35600) 00010000:00010000:1.0:1786002556.472973:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002556.472976:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415484 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.472982:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415484 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.473028:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578415476 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad29 expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.473042:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af57841548b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad29 expref: 10 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.473940:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245e35a00) 00010000:00010000:1.0:1786002556.473943:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786002556.473946:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8d000, rc 0) 00000100:00100000:1.0:1786002556.475702:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:19369:x1872758530930560:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 6486us (10491us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002556.475716:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23955 00000100:00100000:3.0:1786002556.507328:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002556.507725:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530930816 00000100:00100000:1.0:1786002556.507734:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530930816 00000100:00100000:1.0:1786002556.507793:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23956 00000100:00100000:1.0:1786002556.507804:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:19369:x1872758530930816:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002556.507822:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002556.507825:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786002556.507873:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af57841548b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad29 expref: 10 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.507895:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245e35a00) 00010000:00010000:1.0:1786002556.507904:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002556.507916:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415492 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad30 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.508007:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415499 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.508019:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415499 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.508029:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415499 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.508090:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784154a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.508098:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784154a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.508106:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784154a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002556.508427:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cd:0x0], index 1: 0 00000040:00080000:1.0:1786002556.508559:0:10360:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786002556.508686:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 64 off8256 00010000:00010000:1.0:1786002556.508895:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784154a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.508905:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784154a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.508913:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784154a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002556.508962:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983607 00010000:00010000:1.0:1786002556.508994:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415499 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.509002:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415499 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.509009:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415499 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.509016:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415499 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.509022:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8de00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002556.509026:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415499 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.509039:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415499 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.509048:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245e35b00) 00010000:00010000:1.0:1786002556.509051:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002556.509055:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415499 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.509061:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415499 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002556.509072:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a20db5f reply state 00000000db557b73 transno 4294983608 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784154a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.509082:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784154a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.509088:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8b93e778 (ffff9ed245e35500) 00010000:00010000:1.0:1786002556.509091:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002556.509094:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002556.509117:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415492 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad30 expref: 13 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.509132:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784154a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad30 expref: 12 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.509140:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff9ed245e35100) 00010000:00010000:1.0:1786002556.509142:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002556.509145:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c400, rc 0) 00000100:00100000:1.0:1786002556.509200:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:19369:x1872758530930816:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1398us (1881us total) trans 4294983608 rc 0/0 00000100:00100000:1.0:1786002556.509208:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23956 00000020:00080000:1.0:1786002556.509214:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002556.523198:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002556.523981:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530931072 00000100:00100000:3.0:1786002556.523990:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530931072 00000100:00100000:3.0:1786002556.524057:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5116 00000100:00100000:3.0:1786002556.524067:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:19369:x1872758530931072:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002556.524297:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983609 00000100:00100000:3.0:1786002556.524383:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:19369:x1872758530931072:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 317us (1192us total) trans 4294983610 rc 0/0 00000100:00100000:3.0:1786002556.524391:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5116 00000020:00080000:3.0:1786002556.524396:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002556.554143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002556.561157:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530931200 00000100:00100000:2.0:1786002556.561171:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530931200 00000100:00100000:2.0:1786002556.561241:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23957 00000100:00100000:2.0:1786002556.561251:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:19369:x1872758530931200:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002556.561273:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002556.561292:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af5784154b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad37 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561352:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af5784154bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561366:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af5784154bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561378:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af5784154bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561393:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784154c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561400:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784154c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561407:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784154c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561478:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af5784154ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561487:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af5784154ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561499:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af5784154ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002556.561559:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1546:0x0]: returning size 4096 00000004:00200000:2.0:1786002556.561563:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786002556.561581:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af5784154ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561593:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af5784154bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561600:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af5784154bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561606:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af5784154bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561612:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af5784154bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561618:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002556.561622:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af5784154bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561630:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af5784154bc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561642:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002556.561645:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002556.561649:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af5784154bc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561660:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af5784154bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561671:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784154c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561677:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784154c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561683:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784154c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561688:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002556.561690:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784154c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561696:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784154c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561702:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd5d3932 (ffff9ed245ddc600) 00010000:00010000:2.0:1786002556.561704:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002556.561707:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784154c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561712:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784154c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd5d3932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561736:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af5784154b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad37 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561747:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af5784154ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad37 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.561754:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002556.561756:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786002556.561758:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a000, rc 0) 00000100:00100000:2.0:1786002556.561831:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:19369:x1872758530931200:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 579us (7695us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002556.561838:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23957 00000100:00100000:3.0:1786002556.583729:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002556.583797:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530931456 00000100:00100000:1.0:1786002556.583807:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530931456 00000100:00100000:1.0:1786002556.583890:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23958 00000100:00100000:1.0:1786002556.583901:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:19369:x1872758530931456:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002556.583920:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002556.583939:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af5784154d1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad3e expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584033:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af5784154d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584057:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af5784154d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584069:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af5784154d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584082:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784154df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584090:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784154df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584097:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784154df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002556.584389:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ce:0x0], index 0: 0 00010000:00010000:1.0:1786002556.584540:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784154e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584549:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784154e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584556:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784154e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002556.584606:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983611 00010000:00010000:1.0:1786002556.584638:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af5784154d8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584646:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af5784154d8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584654:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af5784154d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584660:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af5784154d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584666:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8de00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002556.584670:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af5784154d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584678:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af5784154d8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584689:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002556.584693:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002556.584697:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af5784154d8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584704:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af5784154d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002556.584717:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000594afd9e reply state 0000000023d0cd1f transno 4294983612 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784154df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584727:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784154df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584734:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x53a9537d (ffff9ed245e35b00) 00010000:00010000:1.0:1786002556.584736:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002556.584739:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002556.584764:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af5784154d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad3e expref: 20 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584776:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784154e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad3e expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.584784:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff9ed245e35a00) 00010000:00010000:1.0:1786002556.584787:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002556.584789:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c000, rc 0) 00000100:00100000:1.0:1786002556.584867:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:19369:x1872758530931456:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 946us (1135us total) trans 4294983612 rc 0/0 00000100:00100000:1.0:1786002556.584874:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23958 00000020:00080000:1.0:1786002556.584879:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002556.589040:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002556.589373:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530931712 00000100:00100000:1.0:1786002556.589383:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530931712 00000100:00100000:1.0:1786002556.589438:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5117 00000100:00100000:1.0:1786002556.589448:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:19369:x1872758530931712:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002556.589694:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983613 00000100:00100000:1.0:1786002556.590010:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:19369:x1872758530931712:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 562us (977us total) trans 4294983614 rc 0/0 00000100:00100000:1.0:1786002556.590018:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5117 00000020:00080000:1.0:1786002556.590023:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002556.605355:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002556.605625:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530931968 00000100:00100000:0.0:1786002556.605635:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530931968 00000100:00100000:0.0:1786002556.605685:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23959 00000100:00100000:0.0:1786002556.605699:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:19369:x1872758530931968:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002556.605730:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002556.605750:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784154f4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.605877:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784154fb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.605892:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784154fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.605902:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784154fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.605958:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578415502 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.605966:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578415502 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.605973:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578415502 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002556.606275:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ce:0x0], index 1: 0 00010000:00010000:0.0:1786002556.606418:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578415509 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606427:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578415509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606434:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578415509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002556.606484:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983615 00010000:00010000:0.0:1786002556.606542:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784154fb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606550:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784154fb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606556:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784154fb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606563:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784154fb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606569:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002556.606572:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784154fb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606579:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784154fb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606592:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002556.606595:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002556.606599:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784154fb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606606:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af5784154fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002556.606625:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a14d864b reply state 00000000c6070dbf transno 4294983616 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578415502 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606635:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578415502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606642:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x756ed0d2 (ffff9ed2456f9000) 00010000:00010000:0.0:1786002556.606645:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002556.606647:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002556.606672:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af5784154f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad45 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606686:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578415509 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad45 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.606694:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff9ed2456f9300) 00010000:00010000:0.0:1786002556.606697:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002556.606699:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35600, rc 0) 00000100:00100000:0.0:1786002556.606754:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:19369:x1872758530931968:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1055us (1408us total) trans 4294983616 rc 0/0 00000100:00100000:0.0:1786002556.606761:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23959 00000020:00080000:0.0:1786002556.606766:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002556.616384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002556.616461:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530932224 00000100:00100000:1.0:1786002556.616470:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530932224 00000100:00100000:1.0:1786002556.616537:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5118 00000100:00100000:1.0:1786002556.616546:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:19369:x1872758530932224:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002556.616793:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983617 00000100:00100000:1.0:1786002556.616919:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:19369:x1872758530932224:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 373us (543us total) trans 4294983618 rc 0/0 00000100:00100000:1.0:1786002556.616927:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5118 00000020:00080000:1.0:1786002556.616931:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002556.627436:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002556.627544:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530932480 00000100:00100000:0.0:1786002556.627554:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530932480 00000100:00100000:0.0:1786002556.627612:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23960 00000100:00100000:0.0:1786002556.627623:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:19369:x1872758530932480:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002556.627644:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002556.627663:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578415517 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.627755:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841551e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.627768:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841551e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.627779:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841551e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.627794:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415525 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.627801:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415525 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.627807:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415525 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002556.628139:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cf:0x0], index 0: 0 00010000:00010000:0.0:1786002556.628271:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af57841552c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628281:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af57841552c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628288:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af57841552c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002556.628336:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983619 00010000:00010000:0.0:1786002556.628369:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841551e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628377:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841551e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628383:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841551e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628389:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841551e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628395:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002556.628399:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841551e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628406:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841551e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628417:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002556.628421:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002556.628425:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841551e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628433:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af57841551e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002556.628445:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020ebbbf2 reply state 00000000e39d480c transno 4294983620 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415525 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628455:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415525 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628462:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd3ce983f (ffff9ed2456f9900) 00010000:00010000:0.0:1786002556.628465:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002556.628467:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002556.628491:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578415517 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad4c expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628506:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af57841552c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad4c expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.628514:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff9ed2456f9100) 00010000:00010000:0.0:1786002556.628516:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002556.628518:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35a00, rc 0) 00000100:00100000:0.0:1786002556.628590:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:19369:x1872758530932480:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 968us (1160us total) trans 4294983620 rc 0/0 00000100:00100000:0.0:1786002556.628597:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23960 00000020:00080000:0.0:1786002556.628602:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002556.637620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002556.639039:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530932736 00000100:00100000:1.0:1786002556.639059:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530932736 00000100:00100000:1.0:1786002556.639114:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5119 00000100:00100000:1.0:1786002556.639123:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:19369:x1872758530932736:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002556.639341:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983621 00000100:00100000:1.0:1786002556.639429:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+34:19369:x1872758530932736:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 305us (1817us total) trans 4294983622 rc 0/0 00000100:00100000:1.0:1786002556.639438:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5119 00000020:00080000:1.0:1786002556.639442:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002556.652963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002556.653088:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530932992 00000100:00100000:0.0:1786002556.653098:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530932992 00000100:00100000:0.0:1786002556.653154:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23961 00000100:00100000:0.0:1786002556.653163:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+34:19369:x1872758530932992:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002556.653184:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002556.653203:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841553a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad53 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.653290:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578415541 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.653304:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578415541 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.653316:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578415541 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.653330:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578415548 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.653337:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578415548 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.653343:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578415548 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002556.653623:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cf:0x0], index 1: 0 00010000:00010000:0.0:1786002556.653759:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af57841554f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.653769:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af57841554f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.653776:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af57841554f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002556.653828:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983623 00010000:00010000:2.0:1786002556.662305:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578415541 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.662322:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578415541 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.662329:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578415541 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.662337:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578415541 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.662343:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002556.662347:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578415541 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.662355:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578415541 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.662371:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002556.662374:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002556.662378:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578415541 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.662388:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578415541 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002556.662402:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019f1e90a reply state 000000003ae310b2 transno 4294983624 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578415548 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.662412:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578415548 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.662419:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xdb9e9594 (ffff9ed2456f9c00) 00010000:00010000:2.0:1786002556.662421:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002556.662424:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002556.662478:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841553a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad53 expref: 38 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.662494:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af57841554f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad53 expref: 37 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.662502:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff9ed2456f9400) 00010000:00010000:2.0:1786002556.662504:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002556.662507:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34a00, rc 0) 00000100:00100000:2.0:1786002556.662580:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+38:19369:x1872758530932992:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 9417us (9623us total) trans 4294983624 rc 0/0 00000100:00100000:2.0:1786002556.662589:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23961 00000020:00080000:2.0:1786002556.662594:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002556.666459:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002556.666601:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530933248 00000100:00100000:3.0:1786002556.666611:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530933248 00000100:00100000:3.0:1786002556.666659:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5120 00000100:00100000:3.0:1786002556.666668:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+38:19369:x1872758530933248:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002556.666944:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983625 00000100:00100000:3.0:1786002556.667034:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:19369:x1872758530933248:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 366us (581us total) trans 4294983626 rc 0/0 00000100:00100000:3.0:1786002556.667042:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5120 00000020:00080000:3.0:1786002556.667055:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002556.673090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002556.673203:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530933504 00000100:00100000:2.0:1786002556.673212:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530933504 00000100:00100000:2.0:1786002556.673268:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23962 00000100:00100000:2.0:1786002556.673278:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:19369:x1872758530933504:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002556.673299:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002556.673317:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841555d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad5a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.673422:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415564 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.673436:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415564 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.673446:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415564 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.673460:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841556b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.673477:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841556b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.673485:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841556b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002556.681449:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d0:0x0], index 0: 0 00010000:00010000:3.0:1786002556.681808:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a600/0x7cee4af578415572 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.681838:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a600/0x7cee4af578415572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.681997:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a600/0x7cee4af578415572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002556.682137:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983627 00010000:00010000:3.0:1786002556.682174:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415564 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.682182:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415564 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.682188:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415564 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.682195:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415564 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.682200:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002556.682204:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415564 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.682211:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415564 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.682221:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002556.682224:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002556.682228:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415564 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.682235:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af578415564 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002556.682248:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c116d4f4 reply state 00000000bc7499b8 transno 4294983628 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841556b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.682257:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841556b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.682266:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe663f479 (ffff9ed245ddc600) 00010000:00010000:3.0:1786002556.682268:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002556.682271:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002556.682305:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af57841555d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad5a expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.682320:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a600/0x7cee4af578415572 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad5a expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.682942:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff9ed245fedc00) 00010000:00010000:3.0:1786002556.682946:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002556.682949:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a600, rc 0) 00000100:00100000:3.0:1786002556.683020:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+44:19369:x1872758530933504:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 9742us (9936us total) trans 4294983628 rc 0/0 00000100:00100000:3.0:1786002556.683029:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23962 00000020:00080000:3.0:1786002556.683034:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002556.695461:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002556.696426:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530933760 00000100:00100000:3.0:1786002556.696436:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530933760 00000100:00100000:3.0:1786002556.696481:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5121 00000100:00100000:3.0:1786002556.696489:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+44:19369:x1872758530933760:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002556.696746:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983629 00000100:00100000:3.0:1786002556.696873:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:19369:x1872758530933760:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 359us (1394us total) trans 4294983630 rc 0/0 00000100:00100000:3.0:1786002556.696881:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5121 00000020:00080000:3.0:1786002556.696886:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002556.714591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002556.714722:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530934016 00000100:00100000:1.0:1786002556.714731:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530934016 00000100:00100000:1.0:1786002556.714790:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23963 00000100:00100000:1.0:1786002556.714799:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+46:19369:x1872758530934016:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002556.714821:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002556.714840:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415580 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad61 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.714972:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415587 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.714986:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415587 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.714998:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415587 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715053:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841558e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715061:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841558e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715068:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841558e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002556.715363:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d0:0x0], index 1: 0 00010000:00010000:1.0:1786002556.715495:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578415595 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715606:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578415595 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715615:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578415595 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002556.715668:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983631 00010000:00010000:1.0:1786002556.715701:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415587 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715710:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415587 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715716:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415587 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715722:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415587 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715728:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002556.715732:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415587 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715741:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415587 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715753:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002556.715756:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002556.715761:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415587 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715767:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af578415587 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002556.715784:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a26b0cd8 reply state 00000000113e9844 transno 4294983632 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841558e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715793:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841558e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715798:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xf8b3f1ce (ffff9ed245e35600) 00010000:00010000:1.0:1786002556.715800:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002556.715803:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002556.715829:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415580 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad61 expref: 50 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.715843:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578415595 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad61 expref: 49 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.716152:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff9ed245e35400) 00010000:00010000:1.0:1786002556.716155:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002556.716158:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8c200, rc 0) 00000100:00100000:1.0:1786002556.716224:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+50:19369:x1872758530934016:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1425us (1641us total) trans 4294983632 rc 0/0 00000100:00100000:1.0:1786002556.716231:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23963 00000020:00080000:1.0:1786002556.716235:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002556.734643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002556.734761:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530934272 00000100:00100000:3.0:1786002556.734770:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530934272 00000100:00100000:3.0:1786002556.734826:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5122 00000100:00100000:3.0:1786002556.734836:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+50:19369:x1872758530934272:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002556.735121:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983633 00000100:00100000:3.0:1786002556.735198:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+52:19369:x1872758530934272:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 362us (562us total) trans 4294983634 rc 0/0 00000100:00100000:3.0:1786002556.735206:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5122 00000020:00080000:3.0:1786002556.735211:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002556.744793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002556.758988:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530934528 00000100:00100000:2.0:1786002556.759003:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530934528 00000100:00100000:3.0:1786002556.759229:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23964 00000100:00100000:3.0:1786002556.759240:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+52:19369:x1872758530934528:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002556.759261:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002556.759280:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784155a3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad68 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.759375:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784155aa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.759389:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784155aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.759400:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784155aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.759413:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784155b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.759420:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784155b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.759432:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784155b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002556.759735:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d1:0x0], index 0: 0 00010000:00010000:3.0:1786002556.760041:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784155b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760149:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784155b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760159:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784155b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002556.760216:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983635 00010000:00010000:3.0:1786002556.760249:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784155aa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760257:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784155aa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760262:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784155aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760267:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784155aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760273:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002556.760277:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784155aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760284:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784155aa lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760296:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002556.760299:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002556.760304:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784155aa lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760310:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784155aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002556.760321:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ccadfb95 reply state 00000000160d485f transno 4294983636 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784155b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760331:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784155b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760336:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7d12be7b (ffff9ed245fede00) 00010000:00010000:3.0:1786002556.760339:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002556.760342:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002556.760367:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784155a3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad68 expref: 56 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760379:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784155b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad68 expref: 55 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.760385:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff9ed245fed500) 00010000:00010000:3.0:1786002556.760387:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002556.760389:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a400, rc 0) 00000100:00100000:3.0:1786002556.760439:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+56:19369:x1872758530934528:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1201us (15657us total) trans 4294983636 rc 0/0 00000100:00100000:3.0:1786002556.760445:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23964 00000020:00080000:3.0:1786002556.760449:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002556.764904:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002556.765402:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530934784 00000100:00100000:3.0:1786002556.765410:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530934784 00000100:00100000:3.0:1786002556.765459:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5123 00000100:00100000:3.0:1786002556.765468:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+56:19369:x1872758530934784:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002556.765771:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983637 00000100:00100000:3.0:1786002556.766683:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+58:19369:x1872758530934784:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 1213us (1785us total) trans 4294983638 rc 0/0 00000100:00100000:3.0:1786002556.766691:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5123 00000020:00080000:3.0:1786002556.766696:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002556.784600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002556.784700:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530935040 00000100:00100000:3.0:1786002556.784709:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530935040 00000100:00100000:3.0:1786002556.784762:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23965 00000100:00100000:3.0:1786002556.784772:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+58:19369:x1872758530935040:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002556.784795:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002556.784816:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784155c6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad6f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.784949:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784155cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.784963:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784155cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.784985:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784155cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785000:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784155d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785010:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784155d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785016:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784155d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002556.785287:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d1:0x0], index 1: 0 00010000:00010000:3.0:1786002556.785420:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784155db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785430:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784155db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785438:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784155db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002556.785483:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983639 00010000:00010000:3.0:1786002556.785513:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784155cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785531:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784155cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785539:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784155cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785546:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784155cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785738:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002556.785742:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784155cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785750:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784155cd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785762:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002556.785765:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002556.785770:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784155cd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785776:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784155cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002556.785789:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000162e3034 reply state 00000000ea705162 transno 4294983640 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784155d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785799:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784155d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.785805:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6e2bbd0 (ffff9ed245fed100) 00010000:00010000:3.0:1786002556.785807:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002556.785809:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002556.785837:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784155c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad6f expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.786040:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784155db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad6f expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002556.786049:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff9ed245fed700) 00010000:00010000:3.0:1786002556.786052:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002556.786054:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5a200, rc 0) 00000100:00100000:3.0:1786002556.786108:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+62:19369:x1872758530935040:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1337us (1515us total) trans 4294983640 rc 0/0 00000100:00100000:3.0:1786002556.786116:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23965 00000020:00080000:3.0:1786002556.786121:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002556.791939:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002556.792100:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530935296 00000100:00100000:2.0:1786002556.792110:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530935296 00000100:00100000:2.0:1786002556.792167:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5124 00000100:00100000:2.0:1786002556.792177:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+62:19369:x1872758530935296:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002556.792417:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983641 00000100:00100000:2.0:1786002556.792512:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+64:19369:x1872758530935296:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 330us (574us total) trans 4294983642 rc 0/0 00000100:00100000:2.0:1786002556.792519:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5124 00000020:00080000:2.0:1786002556.792531:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002556.797906:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786002556.797928:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561007872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002556.798002:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002556.798078:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561007872 00000100:00100000:3.0:1786002556.798085:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561007872 00000100:00100000:3.0:1786002556.798128:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045 00000100:00100000:3.0:1786002556.798137:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561007872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002556.798169:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002556.798209:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561007872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002556.798217:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045 00000100:00100000:1.0:1786002556.806519:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561007872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002556.817714:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002556.817796:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530935552 00000100:00100000:1.0:1786002556.817806:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530935552 00000100:00100000:1.0:1786002556.817932:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23966 00000100:00100000:1.0:1786002556.817941:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+64:19369:x1872758530935552:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002556.817963:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002556.818191:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af5784155e9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad76 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.818284:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784155f0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.818297:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784155f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.818308:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784155f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.818321:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784155f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.819941:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784155f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002556.819954:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784155f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002556.821092:0:8759:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8759:1872758561008000:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1786002556.821147:0:8759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002556.821191:0:8759:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed24194e180 going to sleep for 11 seconds 00000100:00100000:3.0:1786002556.821256:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561008000 00000100:00100000:3.0:1786002556.821263:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561008000 00000100:00100000:3.0:1786002556.821299:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5240 00000100:00100000:3.0:1786002556.821307:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:8759:x1872758561008000:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1786002556.822097:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d2:0x0], index 0: 0 00010000:00010000:0.0:1786002556.822250:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784155fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822264:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784155fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822274:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784155fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002556.822322:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983643 00010000:00010000:0.0:1786002556.822368:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784155f0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822377:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784155f0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822383:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784155f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822390:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784155f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822396:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002556.822400:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784155f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822408:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784155f0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822420:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002556.822423:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002556.822427:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784155f0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822438:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af5784155f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002556.822450:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000313a2ce6 reply state 00000000a84bea9e transno 4294983644 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784155f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822461:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784155f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822467:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x40eea295 (ffff9ed245e35000) 00010000:00010000:0.0:1786002556.822470:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002556.822472:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002556.822512:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af5784155e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad76 expref: 68 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822534:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784155fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad76 expref: 67 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.822542:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff9ed2456f9a00) 00010000:00010000:0.0:1786002556.822544:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002556.822545:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35200, rc 0) 00002000:00080000:3.0:1786002556.822962:0:14687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2530 00000100:00100000:0.0:1786002556.825717:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+68:19369:x1872758530935552:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 7771us (8003us total) trans 4294983644 rc 0/0 00000100:00100000:0.0:1786002556.825728:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23966 00000020:00080000:0.0:1786002556.825735:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002556.836100:0:8759:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8759:1872758561008000:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1786002556.836116:0:8759:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x9d2:0x0]-[0x280000401:0xa01:0x0] 00000100:00100000:2.0:1786002556.836603:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:8759:x1872758561008000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14662us (14821us total) trans 4294969900 rc 0/0 00000100:00100000:2.0:1786002556.836617:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5240 00000100:00100000:2.0:1786002556.871458:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002556.871627:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530935808 00000100:00100000:3.0:1786002556.871636:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530935808 00000100:00100000:3.0:1786002556.871685:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5125 00000100:00100000:3.0:1786002556.871695:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+68:19369:x1872758530935808:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002556.873462:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983645 00000100:00100000:3.0:1786002556.876731:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+70:19369:x1872758530935808:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 5027us (5270us total) trans 4294983646 rc 0/0 00000100:00100000:3.0:1786002556.876746:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5125 00000020:00080000:3.0:1786002556.876754:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786002556.906255:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002556.906488:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002556.908069:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530936064 00000100:00100000:0.0:1786002556.908081:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530936064 00000100:00100000:0.0:1786002556.908147:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23967 00000100:00100000:0.0:1786002556.908158:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+70:19369:x1872758530936064:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002556.908178:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002556.908196:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841560c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.908288:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415613 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.908301:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415613 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.908312:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415613 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.908337:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841561a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xea16437d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.908345:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841561a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.908352:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841561a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002556.908727:0:9839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9839:1872758561008128:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1786002556.908780:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002556.908832:0:9839:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed349b73840 going to sleep for 11 seconds 00000100:00100000:2.0:1786002556.910132:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561008128 00000100:00100000:2.0:1786002556.910139:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561008128 00000100:00100000:2.0:1786002556.910177:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5241 00000100:00100000:2.0:1786002556.910185:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9839:x1872758561008128:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1786002556.910217:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2530 00000100:00100000:2.0:1786002556.917312:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9839:x1872758561008128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7122us (8525us total) trans 4294969897 rc 0/0 00000100:00100000:0.0:1786002556.917965:0:9839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9839:1872758561008128:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1786002556.917989:0:9839:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x9d1:0x0]-[0x2c0000401:0xa01:0x0] 00000100:00100000:2.0:1786002556.918132:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5241 00000004:00080000:0.0:1786002556.937658:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d2:0x0], index 1: 0 00010000:00010000:0.0:1786002556.937929:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578415621 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.937946:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578415621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.937959:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578415621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002556.938147:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983647 00010000:00010000:0.0:1786002556.938186:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415613 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.938194:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415613 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.938201:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415613 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.938208:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415613 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.938214:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002556.938219:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415613 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.938226:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415613 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.938237:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002556.938240:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002556.938244:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415613 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.938250:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415613 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002556.938268:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a88446d reply state 00000000677b331a transno 4294983648 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841561a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.938279:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841561a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.938285:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xea16437d (ffff9ed2456f9600) 00010000:00010000:0.0:1786002556.938288:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002556.938291:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002556.938324:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841560c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad7d expref: 74 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.940229:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578415621 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad7d expref: 73 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002556.940239:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff9ed2456f9f00) 00010000:00010000:0.0:1786002556.940242:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002556.940245:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35c00, rc 0) 00000100:00100000:0.0:1786002556.940359:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+74:19369:x1872758530936064:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 32202us (33875us total) trans 4294983648 rc 0/0 00000100:00100000:0.0:1786002556.940369:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23967 00000020:00080000:0.0:1786002556.940375:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002556.962752:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002556.979960:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530936320 00000100:00100000:3.0:1786002556.979981:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530936320 00000100:00100000:3.0:1786002556.980053:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5126 00000100:00100000:3.0:1786002556.980064:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+74:19369:x1872758530936320:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002556.980293:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983649 00000100:00100000:3.0:1786002556.980391:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+76:19369:x1872758530936320:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 328us (17645us total) trans 4294983650 rc 0/0 00000100:00100000:3.0:1786002556.980399:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5126 00000020:00080000:3.0:1786002556.980403:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002556.992021:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002556.992058:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530936576 00000100:00100000:2.0:1786002556.992068:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530936576 00000100:00100000:2.0:1786002556.992121:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23968 00000100:00100000:2.0:1786002556.992131:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+76:19369:x1872758530936576:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002556.992152:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002556.992170:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af57841562f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad84 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.992266:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415636 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.992280:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.992291:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.992304:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841563d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x9897527d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.992312:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841563d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.992319:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841563d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002556.993131:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d3:0x0], index 0: 0 00010000:00010000:2.0:1786002556.993265:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578415644 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.993276:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578415644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.993284:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578415644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002556.994091:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983651 00010000:00010000:2.0:1786002556.994135:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415636 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.994144:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415636 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.994151:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415636 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.994159:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415636 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.994165:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002556.994169:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415636 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.994177:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415636 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.994189:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002556.994193:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002556.994197:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415636 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.994204:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415636 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002556.994217:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000362b417f reply state 0000000052c509dd transno 4294983652 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841563d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.994228:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841563d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.994234:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x9897527d (ffff9ed245ddcd00) 00010000:00010000:2.0:1786002556.994237:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002556.994240:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002556.994268:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af57841562f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad84 expref: 80 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.994281:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578415644 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad84 expref: 79 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002556.994290:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff9ed245ddcc00) 00010000:00010000:2.0:1786002556.994292:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002556.994295:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b200, rc 0) 00000100:00100000:2.0:1786002556.997661:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+80:19369:x1872758530936576:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 5522us (5639us total) trans 4294983652 rc 0/0 00000100:00100000:2.0:1786002556.997673:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23968 00000020:00080000:2.0:1786002556.997680:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.050035:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.050169:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530936832 00000100:00100000:3.0:1786002557.050178:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530936832 00000100:00100000:3.0:1786002557.050230:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5127 00000100:00100000:3.0:1786002557.050239:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+80:19369:x1872758530936832:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002557.050480:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983653 00000100:00100000:3.0:1786002557.051694:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+82:19369:x1872758530936832:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 1451us (1663us total) trans 4294983654 rc 0/0 00000100:00100000:3.0:1786002557.051706:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5127 00000020:00080000:3.0:1786002557.051712:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.084451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002557.084632:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530937088 00000100:00100000:0.0:1786002557.084642:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530937088 00000100:00100000:0.0:1786002557.084711:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23969 00000100:00100000:0.0:1786002557.084721:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+82:19369:x1872758530937088:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002557.084744:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002557.084763:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578415652 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad8b expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.084901:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415659 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.084916:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415659 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.084928:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415659 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.084942:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415660 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe423257d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.084949:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415660 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.084955:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415660 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002557.085448:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d3:0x0], index 1: 0 00010000:00010000:2.0:1786002557.085607:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415667 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085618:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415667 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085625:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415667 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002557.085672:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983655 00010000:00010000:2.0:1786002557.085702:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415659 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085710:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415659 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085717:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415659 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085724:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415659 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085731:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002557.085735:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415659 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085743:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415659 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085755:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002557.085758:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002557.085762:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415659 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085769:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415659 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002557.085782:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a2f0a85 reply state 000000001c479323 transno 4294983656 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415660 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085793:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415660 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085799:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe423257d (ffff9ed2456f9500) 00010000:00010000:2.0:1786002557.085802:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002557.085804:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002557.085828:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578415652 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad8b expref: 86 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085842:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415667 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad8b expref: 85 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.085895:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff9ed245ddc000) 00010000:00010000:2.0:1786002557.085898:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002557.085900:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b800, rc 0) 00000100:00100000:2.0:1786002557.085954:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+86:19369:x1872758530937088:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1235us (1511us total) trans 4294983656 rc 0/0 00000100:00100000:2.0:1786002557.085961:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23969 00000020:00080000:2.0:1786002557.085966:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002557.100229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002557.100343:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530937344 00000100:00100000:1.0:1786002557.100352:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530937344 00000100:00100000:1.0:1786002557.100404:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5128 00000100:00100000:1.0:1786002557.100414:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+86:19369:x1872758530937344:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002557.100670:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983657 00000100:00100000:1.0:1786002557.100771:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+88:19369:x1872758530937344:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 358us (549us total) trans 4294983658 rc 0/0 00000100:00100000:1.0:1786002557.100779:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5128 00000020:00080000:1.0:1786002557.100783:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.134182:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002557.134632:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530937600 00000100:00100000:0.0:1786002557.134641:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530937600 00000100:00100000:0.0:1786002557.134699:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23970 00000100:00100000:0.0:1786002557.134709:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+88:19369:x1872758530937600:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002557.134731:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002557.134750:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578415675 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad92 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.134842:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841567c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.134900:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841567c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.134911:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841567c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.134927:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415683 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.134935:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415683 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.134942:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415683 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002557.135263:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d4:0x0], index 0: 0 00010000:00010000:0.0:1786002557.135663:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841568a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135672:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841568a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135679:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841568a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002557.135722:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983659 00010000:00010000:0.0:1786002557.135751:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841567c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135757:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841567c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135767:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841567c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135772:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841567c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135777:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002557.135781:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841567c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135786:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841567c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135797:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002557.135800:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002557.135804:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841567c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135809:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af57841567c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002557.135821:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c26e69d0 reply state 00000000d629f368 transno 4294983660 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415683 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135829:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415683 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135835:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x970cb47d (ffff9ed2456f9800) 00010000:00010000:0.0:1786002557.135837:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002557.135839:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002557.135903:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578415675 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad92 expref: 92 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135916:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841568a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad92 expref: 91 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.135922:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff9ed2456f9d00) 00010000:00010000:0.0:1786002557.135924:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002557.135926:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34c00, rc 0) 00000100:00100000:0.0:1786002557.135994:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+92:19369:x1872758530937600:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1286us (1819us total) trans 4294983660 rc 0/0 00000100:00100000:0.0:1786002557.136001:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23970 00000020:00080000:0.0:1786002557.136006:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002557.148930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.149090:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530937856 00000100:00100000:3.0:1786002557.149100:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530937856 00000100:00100000:3.0:1786002557.149155:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5129 00000100:00100000:3.0:1786002557.149165:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+92:19369:x1872758530937856:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002557.149409:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983661 00000100:00100000:3.0:1786002557.149502:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+94:19369:x1872758530937856:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 338us (579us total) trans 4294983662 rc 0/0 00000100:00100000:3.0:1786002557.149510:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5129 00000020:00080000:3.0:1786002557.149515:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.179946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002557.180077:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530938112 00000100:00100000:2.0:1786002557.180087:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530938112 00000100:00100000:2.0:1786002557.180144:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23971 00000100:00100000:2.0:1786002557.180153:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+94:19369:x1872758530938112:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002557.180174:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002557.180193:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578415698 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ad99 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180305:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841569f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180320:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841569f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180344:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841569f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180358:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784156a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180365:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784156a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180371:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784156a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002557.180681:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d4:0x0], index 1: 0 00010000:00010000:2.0:1786002557.180825:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784156ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180834:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784156ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180840:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784156ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002557.180910:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983663 00010000:00010000:2.0:1786002557.180940:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841569f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180947:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841569f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180952:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841569f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180961:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841569f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180966:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002557.180982:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841569f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180989:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841569f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.180998:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002557.181001:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002557.181005:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841569f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.181010:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af57841569f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002557.181024:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fd45b34 reply state 00000000082e5479 transno 4294983664 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784156a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.181033:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784156a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.181038:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5239df7d (ffff9ed245ddc900) 00010000:00010000:2.0:1786002557.181040:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002557.181042:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002557.181065:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af578415698 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad99 expref: 98 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.181081:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784156ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad99 expref: 97 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.181087:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff9ed245ddcf00) 00010000:00010000:2.0:1786002557.181089:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002557.181091:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2ac00, rc 0) 00000100:00100000:2.0:1786002557.181148:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+98:19369:x1872758530938112:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 996us (1211us total) trans 4294983664 rc 0/0 00000100:00100000:2.0:1786002557.181154:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23971 00000020:00080000:2.0:1786002557.181158:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002557.209602:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.209950:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530938368 00000100:00100000:3.0:1786002557.209959:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530938368 00000100:00100000:3.0:1786002557.210012:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5130 00000100:00100000:3.0:1786002557.210023:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+98:19369:x1872758530938368:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002557.210268:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983665 00000100:00100000:3.0:1786002557.210799:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+100:19369:x1872758530938368:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 776us (1203us total) trans 4294983666 rc 0/0 00000100:00100000:3.0:1786002557.210808:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5130 00000020:00080000:3.0:1786002557.210813:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002557.234332:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002557.234958:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530938624 00000100:00100000:0.0:1786002557.234968:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530938624 00000100:00100000:0.0:1786002557.235034:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23972 00000100:00100000:0.0:1786002557.235054:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+100:19369:x1872758530938624:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002557.235077:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002557.235098:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784156bb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ada0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.235215:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784156c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.235229:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784156c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.235241:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784156c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.235255:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784156c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.235262:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784156c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.235269:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784156c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002557.235819:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d5:0x0], index 0: 0 00010000:00010000:0.0:1786002557.236615:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af5784156d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.236627:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af5784156d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.236635:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af5784156d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002557.236697:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983667 00010000:00010000:0.0:1786002557.236819:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784156c2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.236828:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784156c2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.236834:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784156c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.236841:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784156c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.236964:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002557.236969:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784156c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.236976:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784156c2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.236989:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002557.236992:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002557.236996:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784156c2 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.237002:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af5784156c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002557.237016:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e3df9c7 reply state 00000000c124a4da transno 4294983668 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784156c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.237027:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784156c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.237033:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa5436e7d (ffff9ed2456f9700) 00010000:00010000:0.0:1786002557.237035:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002557.237038:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002557.237125:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784156bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ada0 expref: 104 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.237140:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af5784156d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ada0 expref: 103 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.237152:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff9ed2456f9e00) 00010000:00010000:0.0:1786002557.237153:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002557.237155:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228600, rc 0) 00000100:00100000:0.0:1786002557.241659:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+104:19369:x1872758530938624:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 6606us (7325us total) trans 4294983668 rc 0/0 00000100:00100000:0.0:1786002557.241672:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23972 00000020:00080000:0.0:1786002557.241680:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.259039:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002557.260645:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530938880 00000100:00100000:2.0:1786002557.260656:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530938880 00000100:00100000:2.0:1786002557.260729:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5131 00000100:00100000:2.0:1786002557.260740:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+104:19369:x1872758530938880:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002557.261053:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983669 00000100:00100000:2.0:1786002557.261146:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+106:19369:x1872758530938880:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 408us (2113us total) trans 4294983670 rc 0/0 00000100:00100000:2.0:1786002557.261154:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5131 00000020:00080000:2.0:1786002557.261159:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002557.275825:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.275998:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530939136 00000100:00100000:3.0:1786002557.276007:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530939136 00000100:00100000:3.0:1786002557.276074:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23973 00000100:00100000:3.0:1786002557.276084:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+106:19369:x1872758530939136:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002557.276106:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002557.276124:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784156de lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ada7 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.276222:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784156e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.276236:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784156e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.276247:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784156e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.276261:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784156ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xead1417d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.276273:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784156ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.276280:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784156ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002557.276748:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d5:0x0], index 1: 0 00010000:00010000:3.0:1786002557.276920:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784156f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.276929:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784156f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.276935:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784156f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002557.276979:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983671 00010000:00010000:3.0:1786002557.277012:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784156e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.277020:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784156e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.277026:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784156e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.277033:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784156e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.277230:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002557.277236:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784156e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.277245:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784156e5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.277257:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002557.277260:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002557.277265:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784156e5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.277272:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784156e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002557.277286:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001eca8fc2 reply state 00000000c0a9244f transno 4294983672 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784156ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.277296:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784156ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.277303:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xead1417d (ffff9ed245fed600) 00010000:00010000:3.0:1786002557.277306:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002557.277308:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002557.285574:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784156de lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ada7 expref: 110 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.285603:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784156f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ada7 expref: 109 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.285613:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff9ed245fed800) 00010000:00010000:1.0:1786002557.285616:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002557.285619:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b200, rc 0) 00000100:00100000:1.0:1786002557.285696:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+110:19369:x1872758530939136:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 9613us (9878us total) trans 4294983672 rc 0/0 00000100:00100000:1.0:1786002557.285706:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23973 00000020:00080000:1.0:1786002557.285711:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002557.316131:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002557.317822:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530939392 00000100:00100000:1.0:1786002557.317833:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530939392 00000100:00100000:1.0:1786002557.317931:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5132 00000100:00100000:1.0:1786002557.317941:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+110:19369:x1872758530939392:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002557.318192:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983673 00000100:00100000:1.0:1786002557.318279:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+112:19369:x1872758530939392:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 338us (2155us total) trans 4294983674 rc 0/0 00000100:00100000:1.0:1786002557.318287:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5132 00000020:00080000:1.0:1786002557.318292:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002557.344607:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002557.344827:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530939648 00000100:00100000:1.0:1786002557.344836:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530939648 00000100:00100000:1.0:1786002557.344920:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23974 00000100:00100000:1.0:1786002557.344929:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+112:19369:x1872758530939648:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002557.344952:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002557.344970:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415701 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3adae expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.345077:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415708 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.345091:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415708 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.345101:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415708 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.345116:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841570f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.345124:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841570f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.345131:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841570f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002557.345415:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d6:0x0], index 0: 0 00010000:00010000:1.0:1786002557.346090:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578415716 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346100:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578415716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346108:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578415716 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002557.346168:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983675 00010000:00010000:1.0:1786002557.346207:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415708 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346215:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415708 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346220:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415708 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346227:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415708 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346236:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002557.346240:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415708 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346247:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415708 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346259:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002557.346261:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002557.346266:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415708 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346271:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415708 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002557.346283:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6af9fc2 reply state 00000000ad33f617 transno 4294983676 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841570f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346292:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841570f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346297:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7d30507d (ffff9ed245e35f00) 00010000:00010000:1.0:1786002557.346299:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002557.346301:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002557.346328:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415701 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adae expref: 116 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346343:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578415716 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adae expref: 115 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.346354:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff9ed245e35c00) 00010000:00010000:1.0:1786002557.346356:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002557.346359:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8ce00, rc 0) 00000100:00100000:1.0:1786002557.346423:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+116:19369:x1872758530939648:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1494us (1824us total) trans 4294983676 rc 0/0 00000100:00100000:1.0:1786002557.346431:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23974 00000020:00080000:1.0:1786002557.346436:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002557.384933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.385116:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530939904 00000100:00100000:3.0:1786002557.385127:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530939904 00000100:00100000:3.0:1786002557.385183:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5133 00000100:00100000:3.0:1786002557.385193:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+116:19369:x1872758530939904:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002557.385437:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983677 00000100:00100000:3.0:1786002557.385582:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+118:19369:x1872758530939904:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 390us (656us total) trans 4294983678 rc 0/0 00000100:00100000:3.0:1786002557.385594:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5133 00000020:00080000:3.0:1786002557.385599:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002557.407930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002557.408084:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530940160 00000100:00100000:0.0:1786002557.408093:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530940160 00000100:00100000:0.0:1786002557.408150:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23975 00000100:00100000:0.0:1786002557.408159:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+118:19369:x1872758530940160:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002557.408180:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002557.408199:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415724 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3adb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.408292:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841572b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.408306:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841572b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.408317:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841572b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.408330:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578415732 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.408341:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578415732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.408348:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578415732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002557.408925:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d6:0x0], index 1: 0 00010000:00010000:0.0:1786002557.409075:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415739 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409084:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409091:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415739 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002557.409146:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983679 00010000:00010000:0.0:1786002557.409177:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841572b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409184:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841572b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409190:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841572b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409195:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841572b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409200:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002557.409204:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841572b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409212:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841572b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409222:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002557.409225:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002557.409229:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841572b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409234:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841572b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002557.409245:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c387b82 reply state 00000000d5b1d3f0 transno 4294983680 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578415732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409254:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578415732 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409260:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa468b7d (ffff9ed2456f9200) 00010000:00010000:0.0:1786002557.409262:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002557.409264:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002557.409289:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415724 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adb5 expref: 122 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409301:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415739 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adb5 expref: 121 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.409308:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff9ed2456f9b00) 00010000:00010000:0.0:1786002557.409310:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002557.409312:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229200, rc 0) 00000100:00100000:0.0:1786002557.409467:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+122:19369:x1872758530940160:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1308us (1544us total) trans 4294983680 rc 0/0 00000100:00100000:0.0:1786002557.409474:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23975 00000020:00080000:0.0:1786002557.409479:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002557.421916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002557.422124:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530940416 00000100:00100000:2.0:1786002557.422133:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530940416 00000100:00100000:2.0:1786002557.422183:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5134 00000100:00100000:2.0:1786002557.422192:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366dc6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+122:19369:x1872758530940416:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002557.422436:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983681 00000100:00100000:2.0:1786002557.423886:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366dc6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+124:19369:x1872758530940416:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 1689us (2036us total) trans 4294983682 rc 0/0 00000100:00100000:2.0:1786002557.423897:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5134 00000020:00080000:2.0:1786002557.423902:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002557.446781:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002557.446883:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530940672 00000100:00100000:1.0:1786002557.446893:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530940672 00000100:00100000:1.0:1786002557.446952:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23976 00000100:00100000:1.0:1786002557.446961:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+124:19369:x1872758530940672:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002557.446985:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002557.447006:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415747 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3adbc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.447115:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841574e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.447130:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841574e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.447142:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841574e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.447156:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578415755 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.447163:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578415755 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.447170:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578415755 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002557.447453:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d7:0x0], index 0: 0 00010000:00010000:1.0:1786002557.447948:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af57841575c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.447959:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af57841575c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.447967:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af57841575c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002557.448017:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983683 00010000:00010000:1.0:1786002557.448105:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841574e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.448112:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841574e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.448117:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841574e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.448122:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841574e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.448127:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002557.448130:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841574e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.448136:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841574e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.448146:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002557.448149:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002557.448152:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841574e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.448158:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af57841574e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002557.448169:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbf6925c reply state 00000000a8083fd8 transno 4294983684 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578415755 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.448177:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578415755 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.448182:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xdf501a7d (ffff9ed245e35900) 00010000:00010000:1.0:1786002557.448184:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002557.448186:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002557.448220:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415747 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adbc expref: 128 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.448231:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af57841575c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adbc expref: 127 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.448238:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:1.0:1786002557.448240:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002557.448242:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8cc00, rc 0) 00000100:00100000:1.0:1786002557.448334:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+128:19369:x1872758530940672:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1373us (1560us total) trans 4294983684 rc 0/0 00000100:00100000:1.0:1786002557.448341:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23976 00000020:00080000:1.0:1786002557.448346:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002557.465989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002557.471961:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530940928 00000100:00100000:1.0:1786002557.471975:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530940928 00000100:00100000:3.0:1786002557.472136:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5135 00000100:00100000:3.0:1786002557.472149:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+128:19369:x1872758530940928:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002557.472383:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983685 00000100:00100000:3.0:1786002557.472484:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+130:19369:x1872758530940928:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 337us (6503us total) trans 4294983686 rc 0/0 00000100:00100000:3.0:1786002557.472493:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5135 00000020:00080000:3.0:1786002557.472507:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.487199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002557.487287:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530941184 00000100:00100000:2.0:1786002557.487297:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530941184 00000100:00100000:2.0:1786002557.487401:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23977 00000100:00100000:2.0:1786002557.487412:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+130:19369:x1872758530941184:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002557.487434:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002557.487454:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841576a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3adc3 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.487575:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415771 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.487589:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415771 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.487600:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415771 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.487613:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578415778 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.487620:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578415778 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.487625:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578415778 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002557.487978:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d7:0x0], index 1: 0 00010000:00010000:2.0:1786002557.488140:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af57841577f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488150:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af57841577f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488158:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af57841577f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002557.488204:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983687 00010000:00010000:2.0:1786002557.488236:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415771 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488245:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415771 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488252:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415771 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488271:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415771 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488278:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002557.488282:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415771 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488290:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415771 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488302:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002557.488305:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002557.488310:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415771 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488317:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415771 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002557.488334:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6aa9f73 reply state 00000000ff050479 transno 4294983688 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578415778 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488344:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578415778 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488350:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8b6840d2 (ffff9ed245ddc800) 00010000:00010000:2.0:1786002557.488352:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002557.488354:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002557.488382:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841576a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adc3 expref: 134 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488396:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af57841577f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adc3 expref: 133 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.488404:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff9ed245ddcb00) 00010000:00010000:2.0:1786002557.488407:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002557.488409:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2ae00, rc 0) 00000100:00100000:2.0:1786002557.488473:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+134:19369:x1872758530941184:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1062us (1282us total) trans 4294983688 rc 0/0 00000100:00100000:2.0:1786002557.488480:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23977 00000020:00080000:2.0:1786002557.488486:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002557.501407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002557.501631:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530941440 00000100:00100000:1.0:1786002557.501640:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530941440 00000100:00100000:1.0:1786002557.501692:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5136 00000100:00100000:1.0:1786002557.501701:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+134:19369:x1872758530941440:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002557.501971:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983689 00000100:00100000:1.0:1786002557.502069:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+136:19369:x1872758530941440:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 368us (669us total) trans 4294983690 rc 0/0 00000100:00100000:1.0:1786002557.502078:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5136 00000020:00080000:1.0:1786002557.502083:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002557.510175:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002557.510305:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530941696 00000100:00100000:0.0:1786002557.510314:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530941696 00000100:00100000:0.0:1786002557.510374:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23978 00000100:00100000:0.0:1786002557.510384:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+136:19369:x1872758530941696:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002557.510407:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002557.510426:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af57841578d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3adca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.510778:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578415794 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.510794:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578415794 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.510805:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578415794 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.510820:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af57841579b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.510828:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af57841579b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.510835:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af57841579b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002557.512267:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d8:0x0], index 0: 0 00010000:00010000:1.0:1786002557.512428:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784157a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.512441:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784157a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.512449:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784157a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002557.512511:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983691 00010000:00010000:1.0:1786002557.514666:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578415794 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.514682:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578415794 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.514689:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578415794 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.514698:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578415794 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.514705:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002557.514709:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578415794 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.514836:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578415794 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.515109:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002557.515113:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002557.515118:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578415794 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.515125:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af578415794 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002557.515141:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d162dfe reply state 0000000040db77a4 transno 4294983692 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af57841579b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.515151:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af57841579b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.515157:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa0674fd2 (ffff9ed351207900) 00010000:00010000:1.0:1786002557.515160:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002557.515163:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002557.515203:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af57841578d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adca expref: 140 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.515221:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784157a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adca expref: 139 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.515228:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff9ed245e35200) 00010000:00010000:1.0:1786002557.515230:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002557.515232:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f800, rc 0) 00000100:00100000:1.0:1786002557.515358:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+140:19369:x1872758530941696:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 4975us (5190us total) trans 4294983692 rc 0/0 00000100:00100000:1.0:1786002557.515367:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23978 00000020:00080000:1.0:1786002557.515373:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.534008:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.534101:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530941952 00000100:00100000:3.0:1786002557.534110:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530941952 00000100:00100000:3.0:1786002557.534165:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5137 00000100:00100000:3.0:1786002557.534173:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+140:19369:x1872758530941952:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002557.534417:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983693 00000100:00100000:3.0:1786002557.536677:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+142:19369:x1872758530941952:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 2492us (2666us total) trans 4294983694 rc 0/0 00000100:00100000:3.0:1786002557.536693:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5137 00000020:00080000:3.0:1786002557.536701:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002557.561035:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002557.561228:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530942208 00000100:00100000:1.0:1786002557.561237:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530942208 00000100:00100000:1.0:1786002557.561295:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23979 00000100:00100000:1.0:1786002557.561303:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+142:19369:x1872758530942208:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002557.561326:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002557.561344:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784157b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3add1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.561436:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784157b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.561449:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784157b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.561459:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784157b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.561474:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784157be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.561480:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784157be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.561485:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784157be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002557.561790:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d8:0x0], index 1: 0 00010000:00010000:1.0:1786002557.562027:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af5784157c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562037:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af5784157c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562056:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af5784157c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002557.562107:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983695 00010000:00010000:1.0:1786002557.562137:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784157b7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562146:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784157b7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562153:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784157b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562160:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784157b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562171:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fe00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002557.562176:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784157b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562183:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784157b7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562195:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002557.562198:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002557.562203:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784157b7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562210:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784157b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002557.562222:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051fc5503 reply state 00000000ba85495c transno 4294983696 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784157be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562232:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784157be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562238:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x65f522d2 (ffff9ed245e35d00) 00010000:00010000:1.0:1786002557.562241:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002557.562243:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002557.562268:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784157b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3add1 expref: 146 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562281:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af5784157c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3add1 expref: 145 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.562294:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff9ed245e35800) 00010000:00010000:1.0:1786002557.562296:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002557.562298:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7f600, rc 0) 00000100:00100000:1.0:1786002557.562352:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+146:19369:x1872758530942208:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1049us (1325us total) trans 4294983696 rc 0/0 00000100:00100000:1.0:1786002557.562360:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23979 00000020:00080000:1.0:1786002557.562365:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.567720:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.567783:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530942464 00000100:00100000:3.0:1786002557.567792:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530942464 00000100:00100000:3.0:1786002557.567844:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5138 00000100:00100000:3.0:1786002557.567880:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+146:19369:x1872758530942464:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002557.568119:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983697 00000100:00100000:3.0:1786002557.568199:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+148:19369:x1872758530942464:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 320us (486us total) trans 4294983698 rc 0/0 00000100:00100000:3.0:1786002557.568207:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5138 00000020:00080000:3.0:1786002557.568212:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.587637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002557.587756:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530942720 00000100:00100000:2.0:1786002557.587765:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530942720 00000100:00100000:2.0:1786002557.587822:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23980 00000100:00100000:2.0:1786002557.587831:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+148:19369:x1872758530942720:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002557.587885:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002557.587903:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af5784157d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3add8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.587996:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784157da lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588010:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784157da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588021:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784157da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588035:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784157e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588052:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784157e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588060:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784157e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002557.588359:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d9:0x0], index 0: 0 00010000:00010000:2.0:1786002557.588500:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af5784157e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588510:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af5784157e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588530:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af5784157e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002557.588644:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983699 00010000:00010000:2.0:1786002557.588679:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784157da lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588686:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784157da lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588692:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784157da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588698:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784157da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588704:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2bc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002557.588708:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784157da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588715:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784157da lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588726:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002557.588729:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002557.588733:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784157da lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588740:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af5784157da lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002557.588763:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000375cdfcd reply state 00000000ce8cc93d transno 4294983700 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784157e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588774:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784157e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588780:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x38feb1d2 (ffff9ed245ddc100) 00010000:00010000:2.0:1786002557.588783:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002557.588786:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002557.588811:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af5784157d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3add8 expref: 152 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588826:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af5784157e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3add8 expref: 151 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.588834:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff9ed245ddc400) 00010000:00010000:2.0:1786002557.588836:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002557.588839:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a200, rc 0) 00000100:00100000:2.0:1786002557.588938:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+152:19369:x1872758530942720:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1107us (1309us total) trans 4294983700 rc 0/0 00000100:00100000:2.0:1786002557.588945:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23980 00000020:00080000:2.0:1786002557.588950:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002557.606375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002557.607634:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530942976 00000100:00100000:1.0:1786002557.607644:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530942976 00000100:00100000:1.0:1786002557.607699:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5139 00000100:00100000:1.0:1786002557.607708:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+152:19369:x1872758530942976:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002557.607988:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983701 00000100:00100000:0.0:1786002557.608317:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+154:19369:x1872758530942976:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 607us (1947us total) trans 4294983702 rc 0/0 00000100:00100000:0.0:1786002557.608326:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5139 00000020:00080000:0.0:1786002557.608331:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002557.635697:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002557.635875:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530943232 00000100:00100000:1.0:1786002557.635883:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530943232 00000100:00100000:0.0:1786002557.637035:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23981 00000100:00100000:0.0:1786002557.637058:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+154:19369:x1872758530943232:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002557.637081:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002557.637098:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784157f6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3addf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637185:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784157fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637197:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784157fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637206:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784157fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637218:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415804 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637223:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415804 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637229:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415804 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002557.637529:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d9:0x0], index 1: 0 00010000:00010000:0.0:1786002557.637677:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841580b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637688:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841580b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637696:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841580b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002557.637743:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983703 00010000:00010000:0.0:1786002557.637773:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784157fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637781:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784157fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637788:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784157fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637795:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784157fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637802:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002557.637806:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784157fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637813:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784157fd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637824:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002557.637828:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002557.637832:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784157fd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637839:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784157fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002557.637913:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf5880b7 reply state 00000000046323d2 transno 4294983704 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415804 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637925:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415804 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637931:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7c0bdcd2 (ffff9ed351207400) 00010000:00010000:0.0:1786002557.637934:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002557.637936:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002557.637961:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784157f6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3addf expref: 158 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637974:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841580b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3addf expref: 157 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.637981:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff9ed351207000) 00010000:00010000:0.0:1786002557.637984:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002557.637986:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a229000, rc 0) 00000100:00100000:0.0:1786002557.638040:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+158:19369:x1872758530943232:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 988us (2352us total) trans 4294983704 rc 0/0 00000100:00100000:0.0:1786002557.638048:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23981 00000020:00080000:0.0:1786002557.638052:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002557.647730:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002557.647974:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530943488 00000100:00100000:1.0:1786002557.647984:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530943488 00000100:00100000:1.0:1786002557.648045:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5140 00000100:00100000:1.0:1786002557.648056:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+158:19369:x1872758530943488:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002557.648311:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983705 00000100:00100000:1.0:1786002557.648410:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+160:19369:x1872758530943488:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 355us (688us total) trans 4294983706 rc 0/0 00000100:00100000:1.0:1786002557.648418:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5140 00000020:00080000:1.0:1786002557.648424:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.665353:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.665434:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530943744 00000100:00100000:3.0:1786002557.665444:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530943744 00000100:00100000:3.0:1786002557.665511:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23982 00000100:00100000:3.0:1786002557.665529:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+160:19369:x1872758530943744:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002557.665558:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002557.665577:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578415819 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ade6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.665670:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415820 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.665683:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415820 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.665694:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415820 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.665707:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578415827 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.665713:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578415827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.665720:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578415827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002557.666057:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9da:0x0], index 0: 0 00010000:00010000:3.0:1786002557.666200:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af57841582e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666210:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af57841582e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666217:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af57841582e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002557.666264:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983707 00010000:00010000:3.0:1786002557.666295:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415820 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666303:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415820 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666310:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415820 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666317:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415820 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666322:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5ac00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002557.666327:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415820 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666334:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415820 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666345:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002557.666348:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002557.666353:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415820 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666360:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415820 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002557.666373:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8c59ddc reply state 000000000a636267 transno 4294983708 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578415827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666384:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578415827 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666391:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x27156bd2 (ffff9ed245fed200) 00010000:00010000:3.0:1786002557.666393:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002557.666396:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002557.666421:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578415819 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ade6 expref: 164 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666434:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af57841582e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ade6 expref: 163 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.666441:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff9ed245fedb00) 00010000:00010000:3.0:1786002557.666444:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002557.666446:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5aa00, rc 0) 00000100:00100000:3.0:1786002557.666505:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+164:19369:x1872758530943744:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 978us (1161us total) trans 4294983708 rc 0/0 00000100:00100000:3.0:1786002557.666513:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23982 00000020:00080000:3.0:1786002557.666527:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002557.670397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002557.670466:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530944000 00000100:00100000:0.0:1786002557.670475:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530944000 00000100:00100000:0.0:1786002557.670531:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5141 00000100:00100000:0.0:1786002557.670548:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+164:19369:x1872758530944000:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002557.670780:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983709 00000100:00100000:0.0:1786002557.670903:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+166:19369:x1872758530944000:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 362us (513us total) trans 4294983710 rc 0/0 00000100:00100000:0.0:1786002557.670910:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5141 00000020:00080000:0.0:1786002557.670915:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.711170:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002557.711252:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530944256 00000100:00100000:0.0:1786002557.711260:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530944256 00000100:00100000:0.0:1786002557.711316:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23983 00000100:00100000:0.0:1786002557.711325:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+166:19369:x1872758530944256:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002557.711347:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002557.711366:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af57841583c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aded expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.711456:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415843 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.711480:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415843 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.711491:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415843 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.711506:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af57841584a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.711513:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af57841584a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.711529:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af57841584a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002557.712009:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9da:0x0], index 1: 0 00010000:00010000:2.0:1786002557.720199:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415851 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720222:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720234:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002557.720312:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983711 00010000:00010000:2.0:1786002557.720350:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415843 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720358:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415843 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720364:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415843 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720371:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415843 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720377:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002557.720381:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415843 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720388:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415843 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720401:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002557.720404:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002557.720408:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415843 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720415:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415843 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002557.720434:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4f63bec reply state 00000000b651917b transno 4294983712 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af57841584a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720443:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af57841584a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720449:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xfd213ed2 (ffff9ed351207c00) 00010000:00010000:2.0:1786002557.720451:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002557.720454:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002557.720486:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af57841583c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aded expref: 170 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720499:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415851 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aded expref: 169 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002557.720506:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff9ed245ddc700) 00010000:00010000:2.0:1786002557.720508:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002557.720511:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2be00, rc 0) 00000100:00100000:2.0:1786002557.721081:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+170:19369:x1872758530944256:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 9754us (9917us total) trans 4294983712 rc 0/0 00000100:00100000:2.0:1786002557.721090:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23983 00000020:00080000:2.0:1786002557.721095:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002557.733201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.733270:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530944512 00000100:00100000:3.0:1786002557.733279:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530944512 00000100:00100000:3.0:1786002557.733334:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5142 00000100:00100000:3.0:1786002557.733344:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+170:19369:x1872758530944512:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002557.733603:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983713 00000100:00100000:3.0:1786002557.733693:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+172:19369:x1872758530944512:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 350us (500us total) trans 4294983714 rc 0/0 00000100:00100000:3.0:1786002557.733700:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5142 00000020:00080000:3.0:1786002557.733705:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002557.743235:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.743317:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530944768 00000100:00100000:3.0:1786002557.743325:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530944768 00000100:00100000:3.0:1786002557.743386:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23984 00000100:00100000:3.0:1786002557.743397:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+172:19369:x1872758530944768:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002557.743420:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002557.743438:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af57841585f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3adf4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.743562:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415866 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.743577:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415866 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.743587:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415866 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.743600:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841586d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.743605:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841586d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.743611:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841586d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002557.743988:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9db:0x0], index 0: 0 00010000:00010000:3.0:1786002557.744130:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578415874 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744138:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578415874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744144:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578415874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002557.744192:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983715 00010000:00010000:3.0:1786002557.744222:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415866 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744228:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415866 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744233:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415866 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744238:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415866 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744243:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5ac00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002557.744247:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415866 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744253:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415866 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744264:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002557.744267:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002557.744270:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415866 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744276:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415866 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002557.744286:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089ee4188 reply state 00000000459a8376 transno 4294983716 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841586d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744293:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841586d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744298:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x81a24dd2 (ffff9ed245fed000) 00010000:00010000:3.0:1786002557.744301:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002557.744303:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002557.744326:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af57841585f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adf4 expref: 176 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744338:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578415874 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adf4 expref: 175 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.744345:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:3.0:1786002557.744347:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002557.744349:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5bc00, rc 0) 00000100:00100000:3.0:1786002557.744696:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+176:19369:x1872758530944768:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1299us (1469us total) trans 4294983716 rc 0/0 00000100:00100000:3.0:1786002557.744704:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23984 00000020:00080000:3.0:1786002557.744709:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.779901:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.779990:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530945024 00000100:00100000:3.0:1786002557.779999:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530945024 00000100:00100000:3.0:1786002557.780057:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5143 00000100:00100000:3.0:1786002557.780066:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+176:19369:x1872758530945024:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002557.780290:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983717 00000100:00100000:3.0:1786002557.780582:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+178:19369:x1872758530945024:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 515us (689us total) trans 4294983718 rc 0/0 00000100:00100000:3.0:1786002557.780589:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5143 00000020:00080000:3.0:1786002557.780594:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002557.800504:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002557.802532:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530945280 00000100:00100000:1.0:1786002557.802553:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530945280 00000100:00100000:1.0:1786002557.802611:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23985 00000100:00100000:1.0:1786002557.802621:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+178:19369:x1872758530945280:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002557.802644:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002557.802663:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415882 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3adfb expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.802772:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415889 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.802786:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415889 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.802797:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415889 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.802810:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578415890 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.802817:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578415890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.802824:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578415890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002557.803290:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9db:0x0], index 1: 0 00010000:00010000:1.0:1786002557.805838:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578415897 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.805879:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578415897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.805891:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578415897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002557.806802:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983719 00010000:00010000:1.0:1786002557.807152:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415889 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.807162:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415889 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.807168:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415889 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.807175:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415889 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.807181:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002557.807185:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415889 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.807192:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415889 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.807205:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002557.807208:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002557.807211:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415889 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.807222:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415889 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002557.807235:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013a2a4bb reply state 000000004b38a60e transno 4294983720 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578415890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.807245:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578415890 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.807252:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6cc088d2 (ffff9ed245e35300) 00010000:00010000:1.0:1786002557.807254:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002557.807257:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002557.807303:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415882 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adfb expref: 182 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.807317:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578415897 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adfb expref: 181 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.810030:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:1.0:1786002557.810034:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002557.810087:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7fa00, rc 0) 00000100:00100000:0.0:1786002557.810237:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+182:19369:x1872758530945280:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 7613us (9737us total) trans 4294983720 rc 0/0 00000100:00100000:0.0:1786002557.810247:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23985 00000020:00080000:0.0:1786002557.810253:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002557.837451:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002557.843967:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530945536 00000100:00100000:2.0:1786002557.844602:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530945536 00000100:00100000:2.0:1786002557.844719:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5144 00000100:00100000:2.0:1786002557.844730:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+182:19369:x1872758530945536:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002557.847170:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983721 00000100:00100000:2.0:1786002557.847286:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+184:19369:x1872758530945536:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 2555us (9841us total) trans 4294983722 rc 0/0 00000100:00100000:2.0:1786002557.847296:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5144 00000020:00080000:2.0:1786002557.847301:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.852463:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.852559:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530945792 00000100:00100000:3.0:1786002557.852568:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530945792 00000100:00100000:3.0:1786002557.852628:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23986 00000100:00100000:3.0:1786002557.852638:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+184:19369:x1872758530945792:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002557.852660:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002557.852678:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784158a5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae02 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.852786:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784158ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.852800:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784158ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.852813:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784158ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.852826:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5784158b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.852837:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5784158b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.852844:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5784158b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002557.853412:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9dc:0x0], index 0: 0 00010000:00010000:3.0:1786002557.853802:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784158ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.853812:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784158ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.853820:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784158ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002557.855231:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983723 00010000:00010000:3.0:1786002557.855282:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784158ac lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.855292:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784158ac lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.855300:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784158ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.855307:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784158ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.855313:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5ac00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002557.855318:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784158ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.855327:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784158ac lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.855340:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002557.855343:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002557.855347:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784158ac lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.855354:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784158ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002557.855367:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb5099f9 reply state 00000000d2e7e81d transno 4294983724 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5784158b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.861247:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5784158b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.861257:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe9ca17d2 (ffff9ed245feda00) 00010000:00010000:3.0:1786002557.861260:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002557.861265:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002557.861768:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784158a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae02 expref: 188 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.861795:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784158ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae02 expref: 187 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.861803:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002557.861806:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002557.861809:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f5b600, rc 0) 00000100:00100000:3.0:1786002557.862680:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+188:19369:x1872758530945792:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 10040us (10222us total) trans 4294983724 rc 0/0 00000100:00100000:3.0:1786002557.862691:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23986 00000020:00080000:3.0:1786002557.862697:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.881303:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.881423:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530946048 00000100:00100000:3.0:1786002557.881432:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530946048 00000100:00100000:3.0:1786002557.881483:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5145 00000100:00100000:3.0:1786002557.881492:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+188:19369:x1872758530946048:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002557.881751:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983725 00000100:00100000:3.0:1786002557.881873:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+190:19369:x1872758530946048:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 353us (549us total) trans 4294983726 rc 0/0 00000100:00100000:3.0:1786002557.881883:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5145 00000020:00080000:3.0:1786002557.881887:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.901699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002557.901799:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530946304 00000100:00100000:0.0:1786002557.901809:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530946304 00000100:00100000:0.0:1786002557.901903:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23987 00000100:00100000:0.0:1786002557.901912:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+190:19369:x1872758530946304:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002557.901935:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002557.901954:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae09 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.902346:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784158cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.902361:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784158cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.902377:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784158cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.902391:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784158d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa846083f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.902398:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784158d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.902405:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784158d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002557.902706:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9dc:0x0], index 1: 0 00010000:00010000:1.0:1786002557.902839:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784158dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.903384:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784158dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.903395:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784158dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002557.903455:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983727 00010000:00010000:1.0:1786002557.903488:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784158cf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.903496:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784158cf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.903502:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784158cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.903521:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784158cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.903529:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fe00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002557.903533:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784158cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.903945:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784158cf lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.903958:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002557.903961:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002557.903966:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784158cf lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.903982:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af5784158cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002557.903995:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0c8c663 reply state 00000000c087ef13 transno 4294983728 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784158d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.904006:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784158d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.904013:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa846083f (ffff9ed244f15d00) 00010000:00010000:1.0:1786002557.904015:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002557.904018:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002557.904057:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae09 expref: 194 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.904077:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784158dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae09 expref: 193 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002557.904085:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff9ed244f15000) 00010000:00010000:1.0:1786002557.904088:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002557.904090:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7ea00, rc 0) 00000100:00100000:1.0:1786002557.904156:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+194:19369:x1872758530946304:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2245us (2467us total) trans 4294983728 rc 0/0 00000100:00100000:1.0:1786002557.904163:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23987 00000020:00080000:1.0:1786002557.904168:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.923196:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002557.924633:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530946560 00000100:00100000:2.0:1786002557.924644:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530946560 00000100:00100000:2.0:1786002557.924706:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5146 00000100:00100000:2.0:1786002557.924716:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+194:19369:x1872758530946560:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002557.925120:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983729 00000100:00100000:2.0:1786002557.925222:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+196:19369:x1872758530946560:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 506us (2033us total) trans 4294983730 rc 0/0 00000100:00100000:2.0:1786002557.925230:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5146 00000020:00080000:2.0:1786002557.925235:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786002557.931881:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002557.940669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002557.942362:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530946816 00000100:00100000:0.0:1786002557.942373:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530946816 00000100:00100000:0.0:1786002557.942436:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23988 00000100:00100000:0.0:1786002557.942445:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+196:19369:x1872758530946816:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002557.942466:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002557.942485:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af5784158eb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae10 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.942604:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.942618:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.942629:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.942643:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784158f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.942651:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784158f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.942658:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784158f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002557.943250:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9dd:0x0], index 0: 0 00010000:00010000:0.0:1786002557.943388:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578415900 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.943398:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578415900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.943406:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578415900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002557.943453:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983731 00010000:00010000:0.0:1786002557.943483:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158f2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.943493:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158f2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.943499:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.943506:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.943512:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002557.943525:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.943533:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158f2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.943702:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002557.943707:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002557.943765:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158f2 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.943774:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af5784158f2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002557.943789:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055d3a1e5 reply state 00000000af6ca327 transno 4294983732 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784158f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.943801:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784158f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.943808:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb56f173f (ffff9ed351207300) 00010000:00010000:0.0:1786002557.943811:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002557.943814:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002557.943841:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af5784158eb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae10 expref: 200 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.944638:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578415900 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae10 expref: 199 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002557.944647:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff9ed351207100) 00010000:00010000:0.0:1786002557.944649:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002557.944652:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35e00, rc 0) 00000100:00100000:1.0:1786002557.948797:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+200:19369:x1872758530946816:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 6340us (8125us total) trans 4294983732 rc 0/0 00000100:00100000:1.0:1786002557.948810:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23988 00000020:00080000:1.0:1786002557.948818:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002557.970493:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002557.970595:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530947072 00000100:00100000:0.0:1786002557.970604:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530947072 00000100:00100000:0.0:1786002557.970656:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5147 00000100:00100000:0.0:1786002557.970664:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+200:19369:x1872758530947072:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002557.970954:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983733 00000100:00100000:0.0:1786002557.971217:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+202:19369:x1872758530947072:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 552us (732us total) trans 4294983734 rc 0/0 00000100:00100000:0.0:1786002557.971225:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5147 00000020:00080000:0.0:1786002557.971229:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002557.991409:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002557.995392:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530947328 00000100:00100000:3.0:1786002557.995405:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530947328 00000100:00100000:3.0:1786002557.995531:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23989 00000100:00100000:3.0:1786002557.995551:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+202:19369:x1872758530947328:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002557.995577:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002557.995598:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af57841590e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae17 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.995694:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415915 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.995709:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415915 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.997407:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415915 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.997433:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031400/0x7cee4af57841591c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.997443:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031400/0x7cee4af57841591c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.997450:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031400/0x7cee4af57841591c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002557.997934:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9dd:0x0], index 1: 0 00010000:00010000:3.0:1786002557.998196:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340030200/0x7cee4af578415923 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.998207:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340030200/0x7cee4af578415923 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.998215:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340030200/0x7cee4af578415923 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002557.998262:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983735 00010000:00010000:3.0:1786002557.998292:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415915 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.998301:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415915 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.998307:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415915 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.998314:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415915 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.998598:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5ac00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002557.998603:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415915 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.998611:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415915 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.998624:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002557.998627:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002557.998632:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415915 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.998639:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af578415915 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002557.998652:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f2fd0e6 reply state 00000000412e1f5c transno 4294983736 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031400/0x7cee4af57841591c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.998662:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031400/0x7cee4af57841591c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.998669:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5432ea3f (ffff9ed245fed300) 00010000:00010000:3.0:1786002557.998672:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002557.998675:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002557.998708:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af57841590e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae17 expref: 206 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.999398:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340030200/0x7cee4af578415923 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae17 expref: 205 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002557.999411:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff9ed245fed400) 00010000:00010000:3.0:1786002557.999413:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002557.999416:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed340030200, rc 0) 00000100:00100000:3.0:1786002557.999490:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+206:19369:x1872758530947328:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 3950us (8087us total) trans 4294983736 rc 0/0 00000100:00100000:3.0:1786002557.999498:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23989 00000020:00080000:3.0:1786002557.999503:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.009621:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.009732:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530947584 00000100:00100000:2.0:1786002558.009742:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530947584 00000100:00100000:2.0:1786002558.009810:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5148 00000100:00100000:2.0:1786002558.009821:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+206:19369:x1872758530947584:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002558.010424:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983737 00000100:00100000:2.0:1786002558.010522:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+208:19369:x1872758530947584:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 693us (899us total) trans 4294983738 rc 0/0 00000100:00100000:2.0:1786002558.010530:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5148 00000020:00080000:2.0:1786002558.010535:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1786002558.011306:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002558.020726:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.020941:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530947840 00000100:00100000:1.0:1786002558.020951:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530947840 00000100:00100000:1.0:1786002558.021013:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23990 00000100:00100000:1.0:1786002558.021023:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+208:19369:x1872758530947840:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002558.021054:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002558.021074:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578415931 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae1e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.021171:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415938 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.021186:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415938 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.021197:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415938 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.021211:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af57841593f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.021218:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af57841593f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.021225:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af57841593f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002558.021565:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9de:0x0], index 0: 0 00010000:00010000:1.0:1786002558.021708:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578415946 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022234:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578415946 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022242:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578415946 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002558.022298:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983739 00010000:00010000:1.0:1786002558.022443:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415938 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022450:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415938 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022460:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415938 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022465:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415938 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022470:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002558.022473:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415938 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022479:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415938 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022489:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002558.022492:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002558.022495:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415938 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022502:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415938 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002558.022524:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000172df67f reply state 00000000de76a88c transno 4294983740 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af57841593f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022534:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af57841593f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022594:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7f3c793f (ffff9ed244f15a00) 00010000:00010000:1.0:1786002558.022597:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002558.022599:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002558.022628:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578415931 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae1e expref: 212 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022643:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578415946 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae1e expref: 211 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.022651:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff9ed244f15700) 00010000:00010000:1.0:1786002558.022654:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002558.022656:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e000, rc 0) 00000100:00100000:1.0:1786002558.022807:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+212:19369:x1872758530947840:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1784us (2100us total) trans 4294983740 rc 0/0 00000100:00100000:1.0:1786002558.022815:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23990 00000020:00080000:1.0:1786002558.022820:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002558.048610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002558.048738:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530948096 00000100:00100000:0.0:1786002558.048747:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530948096 00000100:00100000:0.0:1786002558.048796:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5149 00000100:00100000:0.0:1786002558.048805:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+212:19369:x1872758530948096:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002558.049074:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983741 00000100:00100000:0.0:1786002558.049152:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+214:19369:x1872758530948096:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 347us (549us total) trans 4294983742 rc 0/0 00000100:00100000:0.0:1786002558.049160:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5149 00000020:00080000:0.0:1786002558.049165:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002558.065226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.065402:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530948352 00000100:00100000:2.0:1786002558.065411:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530948352 00000100:00100000:2.0:1786002558.065471:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23991 00000100:00100000:2.0:1786002558.065481:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+214:19369:x1872758530948352:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002558.065502:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002558.065529:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415954 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae25 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.065635:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841595b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.065649:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841595b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.065659:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841595b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.065673:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578415962 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.065680:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578415962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.065687:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578415962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002558.066023:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9de:0x0], index 1: 0 00010000:00010000:2.0:1786002558.067487:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415969 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.067503:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.067524:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002558.067601:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983743 00010000:00010000:2.0:1786002558.067639:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841595b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.067647:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841595b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.067652:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841595b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.067657:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841595b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.067661:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002558.067665:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841595b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.067671:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841595b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.067682:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002558.067685:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002558.067690:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841595b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.067697:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841595b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002558.068811:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a650a9b reply state 00000000e3433c8d transno 4294983744 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578415962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.068826:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578415962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.068833:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x98e9a43f (ffff9ed35363db00) 00010000:00010000:2.0:1786002558.068836:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002558.068839:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002558.069192:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415954 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae25 expref: 218 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.069209:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415969 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae25 expref: 217 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.069215:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff9ed35363dc00) 00010000:00010000:2.0:1786002558.069218:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002558.069220:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2b000, rc 0) 00000100:00100000:2.0:1786002558.069284:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+218:19369:x1872758530948352:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 3804us (4067us total) trans 4294983744 rc 0/0 00000100:00100000:2.0:1786002558.069292:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23991 00000020:00080000:2.0:1786002558.069297:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002558.083773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.083884:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530948608 00000100:00100000:2.0:1786002558.083893:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530948608 00000100:00100000:2.0:1786002558.083944:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5150 00000100:00100000:2.0:1786002558.083953:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+218:19369:x1872758530948608:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002558.084186:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983745 00000100:00100000:2.0:1786002558.084272:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+220:19369:x1872758530948608:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 320us (508us total) trans 4294983746 rc 0/0 00000100:00100000:2.0:1786002558.084279:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5150 00000020:00080000:2.0:1786002558.084284:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002558.108997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.109424:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530948864 00000100:00100000:2.0:1786002558.109434:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530948864 00000100:00100000:2.0:1786002558.109486:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23992 00000100:00100000:2.0:1786002558.109496:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+220:19369:x1872758530948864:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002558.109528:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002558.109549:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415977 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae2c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.109650:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841597e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.109664:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841597e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.109674:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841597e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.109710:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1e00/0x7cee4af578415985 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.109720:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1e00/0x7cee4af578415985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.109727:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1e00/0x7cee4af578415985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002558.110311:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9df:0x0], index 0: 0 00010000:00010000:2.0:1786002558.111299:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1600/0x7cee4af57841598c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111313:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1600/0x7cee4af57841598c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111418:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1600/0x7cee4af57841598c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002558.111478:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983747 00010000:00010000:2.0:1786002558.111518:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841597e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111528:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841597e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111535:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841597e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111542:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841597e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111547:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002558.111551:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841597e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111558:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841597e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111569:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002558.111573:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002558.111577:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841597e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111588:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af57841597e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002558.111607:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df21530d reply state 0000000051179245 transno 4294983748 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1e00/0x7cee4af578415985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111617:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1e00/0x7cee4af578415985 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111623:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x43f3333f (ffff9ed35363d900) 00010000:00010000:2.0:1786002558.111625:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002558.111628:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002558.111657:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415977 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae2c expref: 224 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111671:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1600/0x7cee4af57841598c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae2c expref: 223 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.111679:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff9ed35363d100) 00010000:00010000:2.0:1786002558.111681:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002558.111684:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1600, rc 0) 00000100:00100000:2.0:1786002558.111757:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+224:19369:x1872758530948864:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2263us (2769us total) trans 4294983748 rc 0/0 00000100:00100000:2.0:1786002558.111764:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23992 00000020:00080000:2.0:1786002558.111769:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002558.155197:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002558.156458:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530949120 00000100:00100000:3.0:1786002558.156469:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530949120 00000100:00100000:3.0:1786002558.156538:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5151 00000100:00100000:3.0:1786002558.156548:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+224:19369:x1872758530949120:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002558.156809:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983749 00000100:00100000:3.0:1786002558.157419:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+226:19369:x1872758530949120:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 871us (2227us total) trans 4294983750 rc 0/0 00000100:00100000:3.0:1786002558.157428:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5151 00000020:00080000:3.0:1786002558.157433:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002558.183740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.184054:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530949376 00000100:00100000:2.0:1786002558.184063:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530949376 00000100:00100000:2.0:1786002558.184118:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23993 00000100:00100000:2.0:1786002558.184128:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+226:19369:x1872758530949376:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002558.184149:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002558.184167:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af57841599a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae33 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.184256:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.184270:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.184281:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.184294:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0200/0x7cee4af5784159a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.184302:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0200/0x7cee4af5784159a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.184309:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0200/0x7cee4af5784159a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002558.184609:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9df:0x0], index 1: 0 00010000:00010000:2.0:1786002558.186175:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1a00/0x7cee4af5784159af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.186191:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1a00/0x7cee4af5784159af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.186200:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1a00/0x7cee4af5784159af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002558.186280:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983751 00010000:00010000:2.0:1786002558.187594:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.187607:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.187614:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.187621:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.187628:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002558.187633:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.187641:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159a1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.187655:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002558.187658:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002558.187662:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159a1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.187668:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002558.187689:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016c5983e reply state 00000000bd1df7bf transno 4294983752 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0200/0x7cee4af5784159a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.187705:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0200/0x7cee4af5784159a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.189189:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5ae1063f (ffff9ed35363d700) 00010000:00010000:2.0:1786002558.189192:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002558.189196:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002558.189246:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af57841599a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae33 expref: 230 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.189266:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1a00/0x7cee4af5784159af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae33 expref: 229 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.189273:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff9ed35363dd00) 00010000:00010000:2.0:1786002558.189275:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002558.189278:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1a00, rc 0) 00000100:00100000:2.0:1786002558.189357:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+230:19369:x1872758530949376:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 5229us (5624us total) trans 4294983752 rc 0/0 00000100:00100000:2.0:1786002558.189365:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23993 00000020:00080000:2.0:1786002558.189371:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002558.197208:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002558.197280:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530949632 00000100:00100000:0.0:1786002558.197288:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530949632 00000100:00100000:0.0:1786002558.197349:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5152 00000100:00100000:0.0:1786002558.197360:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+230:19369:x1872758530949632:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002558.197611:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983753 00000100:00100000:0.0:1786002558.197720:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+232:19369:x1872758530949632:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 354us (514us total) trans 4294983754 rc 0/0 00000100:00100000:0.0:1786002558.197728:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5152 00000020:00080000:0.0:1786002558.197733:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002558.207007:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.207202:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530949888 00000100:00100000:2.0:1786002558.207211:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530949888 00000100:00100000:2.0:1786002558.207269:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23994 00000100:00100000:2.0:1786002558.207279:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+232:19369:x1872758530949888:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002558.207300:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002558.207329:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af5784159bd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae3a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.207426:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159c4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.207440:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.207451:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.207464:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1c00/0x7cee4af5784159cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.207471:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1c00/0x7cee4af5784159cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.207478:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1c00/0x7cee4af5784159cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002558.207773:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e0:0x0], index 0: 0 00010000:00010000:2.0:1786002558.207953:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1400/0x7cee4af5784159d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.207963:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1400/0x7cee4af5784159d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.209190:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1400/0x7cee4af5784159d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002558.209449:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983755 00010000:00010000:0.0:1786002558.209503:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159c4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002558.209519:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159c4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002558.209527:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159c4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002558.209534:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002558.209540:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002558.209544:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002558.209556:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159c4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002558.209569:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002558.209572:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002558.209576:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159c4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002558.209583:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af5784159c4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002558.209601:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5796d34 reply state 000000000d5fc159 transno 4294983756 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1c00/0x7cee4af5784159cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002558.209610:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1c00/0x7cee4af5784159cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002558.209615:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6fe0153f (ffff9ed35363d800) 00010000:00010000:0.0:1786002558.209617:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002558.209620:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002558.209650:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af5784159bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae3a expref: 236 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002558.209662:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1400/0x7cee4af5784159d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae3a expref: 235 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002558.209669:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff9ed35363d400) 00010000:00010000:0.0:1786002558.209671:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002558.209673:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1400, rc 0) 00000100:00100000:0.0:1786002558.209744:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+236:19369:x1872758530949888:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2466us (2746us total) trans 4294983756 rc 0/0 00000100:00100000:0.0:1786002558.209752:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23994 00000020:00080000:0.0:1786002558.209758:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002558.230166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002558.230257:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530950144 00000100:00100000:3.0:1786002558.230266:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530950144 00000100:00100000:3.0:1786002558.230315:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5153 00000100:00100000:3.0:1786002558.230325:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+236:19369:x1872758530950144:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002558.230578:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983757 00000100:00100000:3.0:1786002558.230676:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+238:19369:x1872758530950144:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 351us (517us total) trans 4294983758 rc 0/0 00000100:00100000:3.0:1786002558.230685:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5153 00000020:00080000:3.0:1786002558.230690:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002558.240440:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002558.240531:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530950400 00000100:00100000:3.0:1786002558.240540:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530950400 00000100:00100000:3.0:1786002558.240601:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23995 00000100:00100000:3.0:1786002558.240611:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+238:19369:x1872758530950400:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002558.240634:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002558.240653:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af5784159e0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae41 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.240758:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784159e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.240773:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784159e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.240783:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784159e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.240796:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784159ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.240803:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784159ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.240811:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784159ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002558.241271:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e0:0x0], index 1: 0 00010000:00010000:3.0:1786002558.241412:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a400/0x7cee4af5784159f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241422:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a400/0x7cee4af5784159f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241429:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a400/0x7cee4af5784159f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002558.241482:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983759 00010000:00010000:3.0:1786002558.241525:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784159e7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241533:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784159e7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241539:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784159e7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241545:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784159e7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241551:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002558.241556:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784159e7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241562:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784159e7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241575:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002558.241578:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002558.241583:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784159e7 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241590:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af5784159e7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002558.241602:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f61b7149 reply state 000000002ec8af45 transno 4294983760 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784159ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241613:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784159ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241619:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa91e503f (ffff9ed245fedd00) 00010000:00010000:3.0:1786002558.241622:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002558.241624:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002558.241648:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af5784159e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae41 expref: 242 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241662:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a400/0x7cee4af5784159f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae41 expref: 241 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.241670:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:3.0:1786002558.241673:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002558.241675:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24577a400, rc 0) 00000100:00100000:3.0:1786002558.243164:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+242:19369:x1872758530950400:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2549us (2726us total) trans 4294983760 rc 0/0 00000100:00100000:3.0:1786002558.243174:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23995 00000020:00080000:3.0:1786002558.243179:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002558.279822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.280075:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530950656 00000100:00100000:2.0:1786002558.280084:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530950656 00000100:00100000:2.0:1786002558.280136:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5154 00000100:00100000:2.0:1786002558.280145:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+242:19369:x1872758530950656:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002558.280375:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983761 00000100:00100000:2.0:1786002558.280468:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+244:19369:x1872758530950656:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 324us (655us total) trans 4294983762 rc 0/0 00000100:00100000:2.0:1786002558.280477:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5154 00000020:00080000:2.0:1786002558.280482:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.295324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.295454:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530950912 00000100:00100000:2.0:1786002558.295463:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530950912 00000100:00100000:2.0:1786002558.295531:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23996 00000100:00100000:2.0:1786002558.295542:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+244:19369:x1872758530950912:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002558.295564:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002558.295583:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415a03 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.295677:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a0a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.295692:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.295702:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.295716:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0c00/0x7cee4af578415a11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.295723:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0c00/0x7cee4af578415a11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.295730:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0c00/0x7cee4af578415a11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002558.296341:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e1:0x0], index 0: 0 00010000:00010000:2.0:1786002558.297636:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1800/0x7cee4af578415a18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.297651:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1800/0x7cee4af578415a18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.297662:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1800/0x7cee4af578415a18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002558.297743:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983763 00010000:00010000:2.0:1786002558.297789:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a0a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.297796:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a0a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.297803:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.297809:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.297815:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002558.297819:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.297826:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a0a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.297838:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002558.297841:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002558.298622:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a0a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.298634:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002558.298654:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071df26be reply state 000000006c2f1937 transno 4294983764 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0c00/0x7cee4af578415a11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.298666:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0c00/0x7cee4af578415a11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.298674:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xfc27df3f (ffff9ed245ddca00) 00010000:00010000:2.0:1786002558.298677:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002558.298680:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002558.298717:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415a03 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae48 expref: 248 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.298733:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1800/0x7cee4af578415a18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae48 expref: 247 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.298740:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff9ed245ddce00) 00010000:00010000:2.0:1786002558.298742:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002558.298745:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1800, rc 0) 00000100:00100000:2.0:1786002558.298897:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+248:19369:x1872758530950912:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 3356us (3581us total) trans 4294983764 rc 0/0 00000100:00100000:2.0:1786002558.298906:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23996 00000020:00080000:2.0:1786002558.298912:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.324625:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002558.324704:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530951168 00000100:00100000:3.0:1786002558.324714:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530951168 00000100:00100000:3.0:1786002558.324762:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5155 00000100:00100000:3.0:1786002558.324772:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+248:19369:x1872758530951168:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002558.325239:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983765 00000100:00100000:3.0:1786002558.325367:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+250:19369:x1872758530951168:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 594us (748us total) trans 4294983766 rc 0/0 00000100:00100000:3.0:1786002558.325375:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5155 00000020:00080000:3.0:1786002558.325379:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.345644:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.345749:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530951424 00000100:00100000:1.0:1786002558.345759:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530951424 00000100:00100000:1.0:1786002558.345821:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23997 00000100:00100000:1.0:1786002558.345832:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+250:19369:x1872758530951424:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002558.345896:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002558.345917:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415a26 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae4f expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.346180:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a2d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.346194:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.346204:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a2d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.346217:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415a34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.346224:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415a34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.346230:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415a34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002558.346574:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e1:0x0], index 1: 0 00010000:00010000:1.0:1786002558.346718:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578415a3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.346727:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578415a3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.346735:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578415a3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002558.346785:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983767 00010000:00010000:1.0:1786002558.346819:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a2d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.346827:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a2d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.346837:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a2d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.346844:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.348093:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ec00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002558.348098:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a2d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.348107:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a2d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.348121:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002558.348124:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002558.348129:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a2d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.348135:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a2d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002558.348151:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c526d603 reply state 00000000fb91cb64 transno 4294983768 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415a34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.348160:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415a34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.348166:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6a358594 (ffff9ed244f15500) 00010000:00010000:1.0:1786002558.348169:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002558.348171:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002558.348204:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415a26 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae4f expref: 254 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.348217:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578415a3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae4f expref: 253 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.348224:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff9ed244f15f00) 00010000:00010000:1.0:1786002558.348225:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002558.348228:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245e7e200, rc 0) 00000100:00100000:1.0:1786002558.348292:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+254:19369:x1872758530951424:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2462us (3260us total) trans 4294983768 rc 0/0 00000100:00100000:1.0:1786002558.348301:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23997 00000020:00080000:1.0:1786002558.348307:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002558.357490:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.357750:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530951680 00000100:00100000:1.0:1786002558.357759:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530951680 00000100:00100000:1.0:1786002558.357811:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5156 00000100:00100000:1.0:1786002558.357820:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+254:19369:x1872758530951680:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002558.358566:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983769 00000100:00100000:1.0:1786002558.358714:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+256:19369:x1872758530951680:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 893us (1231us total) trans 4294983770 rc 0/0 00000100:00100000:1.0:1786002558.358723:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5156 00000020:00080000:1.0:1786002558.358728:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.388030:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.388107:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530951936 00000100:00100000:1.0:1786002558.388116:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530951936 00000100:00100000:1.0:1786002558.388172:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23998 00000100:00100000:1.0:1786002558.388182:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+256:19369:x1872758530951936:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002558.388204:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002558.388224:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415a49 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae56 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388343:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a50 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388357:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388368:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a50 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388382:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415a57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388388:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415a57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388394:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415a57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002558.388685:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e2:0x0], index 0: 0 00010000:00010000:1.0:1786002558.388819:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415a5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388829:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388836:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415a5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002558.388928:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983771 00010000:00010000:1.0:1786002558.388959:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a50 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388968:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a50 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388974:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a50 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388981:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a50 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388986:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ec00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002558.388990:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a50 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.388997:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a50 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.389008:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002558.389011:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002558.389015:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a50 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.389022:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415a50 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002558.389034:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c56732f reply state 0000000094062b9e transno 4294983772 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415a57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.389044:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415a57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.389054:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x3f3f1494 (ffff9ed244f15900) 00010000:00010000:1.0:1786002558.389056:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002558.389059:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002558.389083:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415a49 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae56 expref: 260 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.389097:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415a5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae56 expref: 259 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.389104:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff9ed244f15b00) 00010000:00010000:1.0:1786002558.389106:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002558.389109:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c8de00, rc 0) 00000100:00100000:1.0:1786002558.389160:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+260:19369:x1872758530951936:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 979us (1139us total) trans 4294983772 rc 0/0 00000100:00100000:1.0:1786002558.389167:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23998 00000020:00080000:1.0:1786002558.389172:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002558.392814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.393159:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530952192 00000100:00100000:1.0:1786002558.393168:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530952192 00000100:00100000:1.0:1786002558.393219:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5157 00000100:00100000:1.0:1786002558.393228:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+260:19369:x1872758530952192:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002558.393465:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983773 00000100:00100000:1.0:1786002558.393556:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+262:19369:x1872758530952192:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 328us (751us total) trans 4294983774 rc 0/0 00000100:00100000:1.0:1786002558.393564:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5157 00000020:00080000:1.0:1786002558.393569:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002558.424453:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.424582:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530952448 00000100:00100000:2.0:1786002558.424592:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530952448 00000100:00100000:2.0:1786002558.424650:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23999 00000100:00100000:2.0:1786002558.424659:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+262:19369:x1872758530952448:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002558.424688:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002558.424709:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415a6c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae5d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.424823:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.424836:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.424886:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.424900:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0a00/0x7cee4af578415a7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.424907:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0a00/0x7cee4af578415a7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.424914:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0a00/0x7cee4af578415a7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002558.425177:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e2:0x0], index 1: 0 00010000:00010000:2.0:1786002558.425312:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0800/0x7cee4af578415a81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425321:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0800/0x7cee4af578415a81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425328:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0800/0x7cee4af578415a81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002558.425376:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983775 00010000:00010000:2.0:1786002558.425407:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a73 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425414:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a73 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425420:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425426:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425431:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002558.425435:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425442:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a73 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425453:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002558.425455:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002558.425459:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a73 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425465:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a73 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002558.425484:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e47e7ca5 reply state 0000000098e928d3 transno 4294983776 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0a00/0x7cee4af578415a7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425558:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0a00/0x7cee4af578415a7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425564:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x584c3f94 (ffff9ed245ddc200) 00010000:00010000:2.0:1786002558.425567:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002558.425569:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002558.425597:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415a6c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae5d expref: 266 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425611:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0800/0x7cee4af578415a81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae5d expref: 265 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.425619:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff9ed245ddc500) 00010000:00010000:2.0:1786002558.425622:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002558.425624:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b0800, rc 0) 00000100:00100000:2.0:1786002558.425686:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+266:19369:x1872758530952448:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1026us (1240us total) trans 4294983776 rc 0/0 00000100:00100000:2.0:1786002558.425693:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23999 00000020:00080000:2.0:1786002558.425697:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.437843:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.438004:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530952704 00000100:00100000:1.0:1786002558.438014:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530952704 00000100:00100000:1.0:1786002558.438078:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5158 00000100:00100000:1.0:1786002558.438088:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+266:19369:x1872758530952704:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002558.438313:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983777 00000100:00100000:1.0:1786002558.438404:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+268:19369:x1872758530952704:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 316us (568us total) trans 4294983778 rc 0/0 00000100:00100000:1.0:1786002558.438412:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5158 00000020:00080000:1.0:1786002558.438417:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002558.460688:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.460777:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530952960 00000100:00100000:2.0:1786002558.460786:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530952960 00000100:00100000:2.0:1786002558.460841:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24000 00000100:00100000:2.0:1786002558.460885:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+268:19369:x1872758530952960:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002558.460908:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002558.460928:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415a8f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae64 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461023:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461047:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461058:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461075:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af578415a9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x55367694 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461082:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af578415a9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461089:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af578415a9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002558.461399:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e3:0x0], index 0: 0 00010000:00010000:2.0:1786002558.461551:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af578415aa4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461560:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af578415aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461567:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af578415aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002558.461615:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983779 00010000:00010000:2.0:1786002558.461646:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a96 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461653:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a96 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461659:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461666:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461671:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002558.461675:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461681:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a96 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461692:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002558.461695:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002558.461699:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a96 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461705:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415a96 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002558.461721:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034dec88f reply state 0000000065b3625f transno 4294983780 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af578415a9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461730:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af578415a9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461736:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x55367694 (ffff9ed24559f500) 00010000:00010000:2.0:1786002558.461738:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002558.461741:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002558.461763:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415a8f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae64 expref: 272 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461775:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af578415aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae64 expref: 271 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.461783:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff9ed24559fe00) 00010000:00010000:2.0:1786002558.461785:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002558.461787:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b0e00, rc 0) 00000100:00100000:2.0:1786002558.461834:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+272:19369:x1872758530952960:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 953us (1156us total) trans 4294983780 rc 0/0 00000100:00100000:2.0:1786002558.461842:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24000 00000020:00080000:2.0:1786002558.461881:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.487928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.488009:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530953216 00000100:00100000:2.0:1786002558.488019:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530953216 00000100:00100000:2.0:1786002558.488077:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5159 00000100:00100000:2.0:1786002558.488087:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+272:19369:x1872758530953216:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002558.488308:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983781 00000100:00100000:2.0:1786002558.488401:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+274:19369:x1872758530953216:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 314us (480us total) trans 4294983782 rc 0/0 00000100:00100000:2.0:1786002558.488409:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5159 00000020:00080000:2.0:1786002558.488414:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.507722:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.507996:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530953472 00000100:00100000:2.0:1786002558.508006:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530953472 00000100:00100000:2.0:1786002558.508074:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24001 00000100:00100000:2.0:1786002558.508084:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+274:19369:x1872758530953472:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002558.508107:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002558.508127:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415ab2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae6b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.508218:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415ab9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.508231:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.508243:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.508258:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0400/0x7cee4af578415ac0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.508266:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0400/0x7cee4af578415ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.508272:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0400/0x7cee4af578415ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002558.508803:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e3:0x0], index 1: 0 00010000:00010000:2.0:1786002558.508988:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1000/0x7cee4af578415ac7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.508998:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1000/0x7cee4af578415ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.509005:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1000/0x7cee4af578415ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002558.509155:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983783 00010000:00010000:2.0:1786002558.509188:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415ab9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.509196:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415ab9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.509203:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415ab9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.509210:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415ab9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.509217:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002558.509221:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415ab9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.509228:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415ab9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.509240:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002558.509243:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002558.509247:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415ab9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.509254:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415ab9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002558.509271:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008142e011 reply state 00000000227f37b0 transno 4294983784 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0400/0x7cee4af578415ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.509286:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0400/0x7cee4af578415ac0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.509293:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xf0e3a194 (ffff9ed24559f700) 00010000:00010000:2.0:1786002558.509295:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002558.509298:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002558.509323:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415ab2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae6b expref: 278 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.509338:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1000/0x7cee4af578415ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae6b expref: 277 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.509345:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff9ed24559fc00) 00010000:00010000:2.0:1786002558.509347:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002558.509350:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1000, rc 0) 00000100:00100000:2.0:1786002558.509401:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+278:19369:x1872758530953472:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1317us (1686us total) trans 4294983784 rc 0/0 00000100:00100000:2.0:1786002558.509408:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24001 00000020:00080000:2.0:1786002558.509412:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002558.512831:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.513017:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530953728 00000100:00100000:1.0:1786002558.513026:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530953728 00000100:00100000:1.0:1786002558.513077:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5160 00000100:00100000:1.0:1786002558.513086:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+278:19369:x1872758530953728:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002558.513291:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983785 00000100:00100000:1.0:1786002558.513361:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+280:19369:x1872758530953728:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 275us (538us total) trans 4294983786 rc 0/0 00000100:00100000:1.0:1786002558.513368:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5160 00000020:00080000:1.0:1786002558.513372:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.526820:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.526989:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530953984 00000100:00100000:1.0:1786002558.526999:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530953984 00000100:00100000:1.0:1786002558.527066:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24002 00000100:00100000:1.0:1786002558.527075:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+280:19369:x1872758530953984:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002558.527099:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002558.527119:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415ad5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae72 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.527216:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415adc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.527233:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415adc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.527243:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415adc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.527258:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415ae3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.527266:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.527272:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002558.527697:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e4:0x0], index 0: 0 00010000:00010000:1.0:1786002558.527838:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578415aea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.527970:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578415aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.527980:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578415aea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002558.528139:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983787 00010000:00010000:1.0:1786002558.528175:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415adc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.528183:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415adc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.528195:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415adc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.528202:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415adc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.528208:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002558.528212:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415adc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.528219:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415adc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.528232:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002558.528235:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002558.528239:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415adc lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.528246:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415adc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002558.528259:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb1cf8dc reply state 000000002b3cd711 transno 4294983788 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.528269:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415ae3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.528275:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x2fe2b094 (ffff9ed244f15300) 00010000:00010000:1.0:1786002558.528278:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002558.528280:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002558.528306:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415ad5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae72 expref: 284 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.528320:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578415aea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae72 expref: 283 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.528327:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff9ed244f15600) 00010000:00010000:1.0:1786002558.528330:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002558.528332:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed3429ea000, rc 0) 00000100:00100000:1.0:1786002558.528396:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+284:19369:x1872758530953984:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1322us (1584us total) trans 4294983788 rc 0/0 00000100:00100000:1.0:1786002558.528404:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24002 00000020:00080000:1.0:1786002558.528409:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.559839:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.560028:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530954240 00000100:00100000:1.0:1786002558.560047:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530954240 00000100:00100000:1.0:1786002558.560108:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5161 00000100:00100000:1.0:1786002558.560117:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+284:19369:x1872758530954240:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002558.560362:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983789 00000100:00100000:1.0:1786002558.560453:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+286:19369:x1872758530954240:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 337us (621us total) trans 4294983790 rc 0/0 00000100:00100000:1.0:1786002558.560462:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5161 00000020:00080000:1.0:1786002558.560466:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002558.581994:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.582195:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530954496 00000100:00100000:1.0:1786002558.582204:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530954496 00000100:00100000:1.0:1786002558.582263:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24003 00000100:00100000:1.0:1786002558.582272:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+286:19369:x1872758530954496:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002558.582292:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002558.582312:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415af8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae79 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.582403:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415aff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.582416:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415aff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.582426:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415aff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.582440:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415b06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.582446:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415b06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.582452:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415b06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002558.582775:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e4:0x0], index 1: 0 00010000:00010000:1.0:1786002558.582963:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578415b0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.582973:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578415b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.582980:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578415b0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002558.583028:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983791 00010000:00010000:1.0:1786002558.583193:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415aff lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.583202:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415aff lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.583209:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415aff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.583215:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415aff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.583221:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002558.583225:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415aff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.583232:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415aff lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.583243:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002558.583246:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002558.583250:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415aff lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.583257:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415aff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002558.583268:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dacdd19 reply state 000000003f8285c4 transno 4294983792 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415b06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.583278:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415b06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.583290:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xc8efdb94 (ffff9ed244f15c00) 00010000:00010000:1.0:1786002558.583292:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002558.583295:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002558.583319:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415af8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae79 expref: 290 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.583333:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578415b0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae79 expref: 289 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.583342:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff9ed244f15800) 00010000:00010000:1.0:1786002558.583344:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002558.583347:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556be00, rc 0) 00000100:00100000:1.0:1786002558.583396:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+290:19369:x1872758530954496:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1125us (1411us total) trans 4294983792 rc 0/0 00000100:00100000:1.0:1786002558.583404:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24003 00000020:00080000:1.0:1786002558.583410:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.592384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.592827:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530954752 00000100:00100000:2.0:1786002558.592837:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530954752 00000100:00100000:2.0:1786002558.592924:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5162 00000100:00100000:2.0:1786002558.592934:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+290:19369:x1872758530954752:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002558.593192:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983793 00000100:00100000:2.0:1786002558.593289:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+292:19369:x1872758530954752:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 356us (913us total) trans 4294983794 rc 0/0 00000100:00100000:2.0:1786002558.593300:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5162 00000020:00080000:2.0:1786002558.593305:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.614698:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.617127:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530955008 00000100:00100000:2.0:1786002558.617138:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530955008 00000100:00100000:2.0:1786002558.617206:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24004 00000100:00100000:2.0:1786002558.617216:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+292:19369:x1872758530955008:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002558.617238:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002558.617259:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415b1b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae80 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.617355:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b22 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.617369:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b22 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.617381:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b22 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.617397:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415b29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.617404:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415b29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.617411:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415b29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002558.618090:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e5:0x0], index 0: 0 00010000:00010000:2.0:1786002558.618245:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578415b30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.618256:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578415b30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.618263:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578415b30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002558.618318:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983795 00010000:00010000:2.0:1786002558.618353:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b22 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.618360:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b22 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.618367:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b22 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.618373:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b22 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.618379:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002558.618383:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b22 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.618390:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b22 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.618402:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002558.618405:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002558.618409:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b22 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.618415:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b22 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002558.618431:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005594abba reply state 000000009c8a559d transno 4294983796 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415b29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.618441:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415b29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.618447:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x45da1294 (ffff9ed24559f900) 00010000:00010000:2.0:1786002558.618449:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002558.618451:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002558.620108:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415b1b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae80 expref: 296 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.620139:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578415b30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae80 expref: 295 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.620148:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff9ed24559fa00) 00010000:00010000:2.0:1786002558.620150:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002558.620153:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed243d2a800, rc 0) 00000100:00100000:2.0:1786002558.620213:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+296:19369:x1872758530955008:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2999us (5523us total) trans 4294983796 rc 0/0 00000100:00100000:2.0:1786002558.620221:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24004 00000020:00080000:2.0:1786002558.620227:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.631391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002558.632100:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530955264 00000100:00100000:3.0:1786002558.632111:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530955264 00000100:00100000:3.0:1786002558.632165:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5163 00000100:00100000:3.0:1786002558.632175:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+296:19369:x1872758530955264:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002558.632428:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983797 00000100:00100000:3.0:1786002558.635192:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+298:19369:x1872758530955264:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 3011us (3804us total) trans 4294983798 rc 0/0 00000100:00100000:3.0:1786002558.635205:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5163 00000020:00080000:3.0:1786002558.635211:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.660118:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.660246:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530955520 00000100:00100000:1.0:1786002558.660255:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530955520 00000100:00100000:1.0:1786002558.660308:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24005 00000100:00100000:1.0:1786002558.660317:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+298:19369:x1872758530955520:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002558.660341:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002558.660360:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578415b3e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae87 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.660457:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578415b45 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.660488:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578415b45 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.660505:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578415b45 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.660526:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578415b4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.660533:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578415b4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.660540:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578415b4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002558.660823:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e5:0x0], index 1: 0 00010000:00010000:1.0:1786002558.661303:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578415b53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.661313:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578415b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.661321:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578415b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002558.661375:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983799 00010000:00010000:1.0:1786002558.661410:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578415b45 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.661418:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578415b45 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.661429:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578415b45 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.661435:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578415b45 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.661441:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002558.661444:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578415b45 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.661451:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578415b45 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.661463:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002558.661466:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002558.661471:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578415b45 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.661477:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578415b45 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002558.661920:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b24f5942 reply state 00000000984f53f2 transno 4294983800 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578415b4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.661932:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578415b4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.661939:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd2f04d94 (ffff9ed244f15200) 00010000:00010000:1.0:1786002558.661941:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002558.661944:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002558.662019:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578415b3e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae87 expref: 302 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.662209:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578415b53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae87 expref: 301 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.662219:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff9ed244f15e00) 00010000:00010000:1.0:1786002558.662222:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002558.662225:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556aa00, rc 0) 00000100:00100000:1.0:1786002558.662280:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+302:19369:x1872758530955520:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1964us (2170us total) trans 4294983800 rc 0/0 00000100:00100000:1.0:1786002558.662288:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24005 00000020:00080000:1.0:1786002558.662293:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.672146:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.672233:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530955776 00000100:00100000:1.0:1786002558.672242:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530955776 00000100:00100000:1.0:1786002558.672294:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5164 00000100:00100000:1.0:1786002558.672304:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+302:19369:x1872758530955776:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002558.672565:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983801 00000100:00100000:1.0:1786002558.672660:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+304:19369:x1872758530955776:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 357us (521us total) trans 4294983802 rc 0/0 00000100:00100000:1.0:1786002558.672668:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5164 00000020:00080000:1.0:1786002558.672673:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.682740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.682819:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530956032 00000100:00100000:1.0:1786002558.682828:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530956032 00000100:00100000:1.0:1786002558.682913:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24006 00000100:00100000:1.0:1786002558.682923:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+304:19369:x1872758530956032:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002558.682947:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002558.682977:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415b61 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae8e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683083:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415b68 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683096:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415b68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683107:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415b68 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683141:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415b6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683149:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415b6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683158:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415b6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002558.683458:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e6:0x0], index 0: 0 00010000:00010000:1.0:1786002558.683630:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dba00/0x7cee4af578415b76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683640:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dba00/0x7cee4af578415b76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683647:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dba00/0x7cee4af578415b76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002558.683697:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983803 00010000:00010000:1.0:1786002558.683729:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415b68 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683738:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415b68 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683744:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415b68 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683751:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415b68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683758:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed3429eb600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002558.683762:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415b68 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683770:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415b68 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683782:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002558.683785:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002558.683789:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415b68 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683796:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415b68 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002558.683809:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab1bdeb7 reply state 00000000c8dd64d4 transno 4294983804 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415b6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683820:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415b6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683826:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7df9dc94 (ffff9ed244f15100) 00010000:00010000:1.0:1786002558.683829:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002558.683832:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002558.683882:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415b61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae8e expref: 308 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683897:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dba00/0x7cee4af578415b76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae8e expref: 307 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.683904:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff9ed244f15400) 00010000:00010000:1.0:1786002558.683907:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002558.683909:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2455dba00, rc 0) 00000100:00100000:1.0:1786002558.683955:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+308:19369:x1872758530956032:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1034us (1225us total) trans 4294983804 rc 0/0 00000100:00100000:1.0:1786002558.683963:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24006 00000020:00080000:1.0:1786002558.683968:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002558.696386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.696498:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530956288 00000100:00100000:1.0:1786002558.696515:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530956288 00000100:00100000:1.0:1786002558.696570:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5165 00000100:00100000:1.0:1786002558.696581:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+308:19369:x1872758530956288:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002558.696832:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983805 00000100:00100000:1.0:1786002558.696945:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+310:19369:x1872758530956288:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 365us (567us total) trans 4294983806 rc 0/0 00000100:00100000:1.0:1786002558.696953:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5165 00000020:00080000:1.0:1786002558.696958:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.713154:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.713589:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530956544 00000100:00100000:2.0:1786002558.713599:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530956544 00000100:00100000:2.0:1786002558.713663:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24007 00000100:00100000:2.0:1786002558.713673:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+310:19369:x1872758530956544:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002558.713697:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002558.713720:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415b84 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.713821:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b8b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.713835:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.713885:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b8b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.713926:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ce00/0x7cee4af578415b92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xda336479 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.713934:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ce00/0x7cee4af578415b92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.713941:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ce00/0x7cee4af578415b92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002558.714925:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e6:0x0], index 1: 0 00010000:00010000:3.0:1786002558.715232:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a800/0x7cee4af578415b99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.715243:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a800/0x7cee4af578415b99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.715251:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a800/0x7cee4af578415b99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002558.715308:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983807 00010000:00010000:3.0:1786002558.715345:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b8b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.715353:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b8b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.715360:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b8b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.715366:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b8b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.715372:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002558.715377:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b8b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.715384:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b8b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.715395:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002558.715398:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002558.715402:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b8b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.715408:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415b8b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002558.715425:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000d2036e reply state 0000000028d4bced transno 4294983808 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ce00/0x7cee4af578415b92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.715442:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ce00/0x7cee4af578415b92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.715448:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xda336479 (ffff9ed24559f600) 00010000:00010000:3.0:1786002558.715451:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002558.715454:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002558.715483:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415b84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae95 expref: 314 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.715956:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a800/0x7cee4af578415b99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae95 expref: 313 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.716092:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff9ed38214d400) 00010000:00010000:3.0:1786002558.716097:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002558.716100:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24577a800, rc 0) 00000100:00100000:3.0:1786002558.716164:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+314:19369:x1872758530956544:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2492us (3019us total) trans 4294983808 rc 0/0 00000100:00100000:3.0:1786002558.716172:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24007 00000020:00080000:3.0:1786002558.716178:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.720363:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.720442:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530956800 00000100:00100000:2.0:1786002558.720451:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530956800 00000100:00100000:2.0:1786002558.720525:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5166 00000100:00100000:2.0:1786002558.720537:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+314:19369:x1872758530956800:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002558.720778:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983809 00000100:00100000:2.0:1786002558.720899:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+316:19369:x1872758530956800:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 363us (543us total) trans 4294983810 rc 0/0 00000100:00100000:2.0:1786002558.720907:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5166 00000020:00080000:2.0:1786002558.720911:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.725437:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002558.725533:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530957056 00000100:00100000:3.0:1786002558.725542:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530957056 00000100:00100000:3.0:1786002558.725598:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24008 00000100:00100000:3.0:1786002558.725608:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+316:19369:x1872758530957056:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002558.725630:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002558.725649:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ba7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3ae9c expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.725763:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415bae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.725777:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415bae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.725788:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415bae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.725802:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577aa00/0x7cee4af578415bb5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.725808:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577aa00/0x7cee4af578415bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.725815:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577aa00/0x7cee4af578415bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002558.726380:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e7:0x0], index 0: 0 00010000:00010000:2.0:1786002558.729701:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c200/0x7cee4af578415bbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.729721:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c200/0x7cee4af578415bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.729732:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c200/0x7cee4af578415bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002558.729833:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983811 00010000:00010000:2.0:1786002558.730617:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415bae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.730627:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415bae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.730634:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415bae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.730641:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415bae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.730648:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24577ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002558.730652:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415bae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.730660:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415bae lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.730672:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002558.730675:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002558.730680:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415bae lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.730690:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415bae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002558.730702:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d39a9d98 reply state 00000000e1d1ef64 transno 4294983812 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577aa00/0x7cee4af578415bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.730712:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577aa00/0x7cee4af578415bb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.730717:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x3abc7379 (ffff9ed366e56700) 00010000:00010000:2.0:1786002558.730720:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002558.730723:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002558.730760:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ba7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae9c expref: 320 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.730775:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c200/0x7cee4af578415bbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae9c expref: 319 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.730782:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff9ed24559f200) 00010000:00010000:2.0:1786002558.730784:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002558.730787:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24570c200, rc 0) 00000100:00100000:2.0:1786002558.731951:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+320:19369:x1872758530957056:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 5238us (5415us total) trans 4294983812 rc 0/0 00000100:00100000:2.0:1786002558.731964:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24008 00000020:00080000:2.0:1786002558.732091:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.752997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002558.753577:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530957312 00000100:00100000:3.0:1786002558.753587:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530957312 00000100:00100000:3.0:1786002558.753648:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5167 00000100:00100000:3.0:1786002558.753658:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+320:19369:x1872758530957312:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002558.753927:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983813 00000100:00100000:3.0:1786002558.754019:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+322:19369:x1872758530957312:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 362us (1031us total) trans 4294983814 rc 0/0 00000100:00100000:3.0:1786002558.754027:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5167 00000020:00080000:3.0:1786002558.754039:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.775356:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002558.775529:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530957568 00000100:00100000:3.0:1786002558.775538:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530957568 00000100:00100000:3.0:1786002558.775598:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24009 00000100:00100000:3.0:1786002558.775608:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+322:19369:x1872758530957568:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002558.775633:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002558.775654:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415bca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aea3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.775752:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.775765:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.775776:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.775789:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b000/0x7cee4af578415bd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x32204679 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.775796:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b000/0x7cee4af578415bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.775801:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b000/0x7cee4af578415bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002558.776141:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e7:0x0], index 1: 0 00010000:00010000:3.0:1786002558.776286:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577bc00/0x7cee4af578415bdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776296:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577bc00/0x7cee4af578415bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776304:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577bc00/0x7cee4af578415bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002558.776353:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983815 00010000:00010000:3.0:1786002558.776385:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bd1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776393:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bd1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776400:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776407:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776414:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24577b600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002558.776418:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776427:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bd1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776438:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002558.776441:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002558.776445:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bd1 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776452:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bd1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002558.776467:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9e9fda6 reply state 0000000074c99a9b transno 4294983816 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b000/0x7cee4af578415bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776478:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b000/0x7cee4af578415bd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776485:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x32204679 (ffff9ed366e56400) 00010000:00010000:3.0:1786002558.776487:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002558.776490:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002558.776526:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415bca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aea3 expref: 326 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776541:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577bc00/0x7cee4af578415bdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aea3 expref: 325 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.776548:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff9ed366e56300) 00010000:00010000:3.0:1786002558.776550:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002558.776553:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24577bc00, rc 0) 00000100:00100000:3.0:1786002558.776617:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+326:19369:x1872758530957568:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1010us (1269us total) trans 4294983816 rc 0/0 00000100:00100000:3.0:1786002558.776626:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24009 00000020:00080000:3.0:1786002558.776631:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002558.826280:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed349f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561008256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786002558.826344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002558.826411:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561008256 00000100:00100000:2.0:1786002558.826418:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561008256 00000100:00100000:2.0:1786002558.826462:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1786002558.826483:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561008256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786002558.826524:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67508800 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002558.826564:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561008256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002558.826572:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00080000:2.0:1786002558.826591:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002558.826622:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed349f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561008256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002558.826993:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561008384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002558.827021:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002558.827531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.827632:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530957824 00000100:00100000:1.0:1786002558.827637:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530957824 00000100:00100000:1.0:1786002558.827673:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5168 00000100:00100000:1.0:1786002558.827681:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+326:19369:x1872758530957824:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002558.827943:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983817 00000100:00100000:1.0:1786002558.828020:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+328:19369:x1872758530957824:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 340us (490us total) trans 4294983818 rc 0/0 00000100:00100000:1.0:1786002558.828028:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5168 00000020:00080000:1.0:1786002558.828042:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002558.828241:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561008384 00000100:00100000:2.0:1786002558.828246:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561008384 00000100:00100000:2.0:1786002558.828288:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1786002558.828295:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1872758561008384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786002558.828308:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67508800 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002558.828342:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1872758561008384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002558.828348:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1786002558.828379:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561008384:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786002558.829672:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002558.848714:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002558.848802:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530958080 00000100:00100000:3.0:1786002558.848812:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530958080 00000100:00100000:3.0:1786002558.848912:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24010 00000100:00100000:3.0:1786002558.848923:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+328:19369:x1872758530958080:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002558.848946:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002558.849240:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415bed lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aeaa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.849347:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.849361:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.849374:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.849390:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b400/0x7cee4af578415bfb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.849397:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b400/0x7cee4af578415bfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.849404:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b400/0x7cee4af578415bfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002558.849796:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e8:0x0], index 0: 0 00010000:00010000:3.0:1786002558.851303:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a000/0x7cee4af578415c02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.851319:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a000/0x7cee4af578415c02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.851328:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a000/0x7cee4af578415c02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002558.851387:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983819 00010000:00010000:3.0:1786002558.851417:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bf4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.851426:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bf4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.851433:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.851440:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.851446:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24577b600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002558.851450:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.851458:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bf4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.851469:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002558.851472:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002558.851477:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bf4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.851484:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415bf4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002558.853192:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ece5ba4 reply state 00000000b0b8ad6c transno 4294983820 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b400/0x7cee4af578415bfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.853206:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b400/0x7cee4af578415bfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.853214:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x2f29d579 (ffff9ed24556e100) 00010000:00010000:3.0:1786002558.853217:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002558.853221:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002558.853258:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415bed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aeaa expref: 332 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.853273:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a000/0x7cee4af578415c02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aeaa expref: 331 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.853281:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff9ed24556e400) 00010000:00010000:3.0:1786002558.853283:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002558.853286:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24577a000, rc 0) 00000100:00100000:3.0:1786002558.853346:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+332:19369:x1872758530958080:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 4424us (4640us total) trans 4294983820 rc 0/0 00000100:00100000:3.0:1786002558.853354:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24010 00000020:00080000:3.0:1786002558.853360:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.867421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.867894:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530958336 00000100:00100000:2.0:1786002558.867903:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530958336 00000100:00100000:2.0:1786002558.867959:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5169 00000100:00100000:2.0:1786002558.867976:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+332:19369:x1872758530958336:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002558.868465:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983821 00000100:00100000:2.0:1786002558.868588:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+334:19369:x1872758530958336:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 619us (1174us total) trans 4294983822 rc 0/0 00000100:00100000:2.0:1786002558.868596:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5169 00000020:00080000:2.0:1786002558.868601:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.882288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.882585:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530958592 00000100:00100000:2.0:1786002558.882594:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530958592 00000100:00100000:2.0:1786002558.882656:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24011 00000100:00100000:2.0:1786002558.882667:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+334:19369:x1872758530958592:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002558.882690:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002558.882709:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415c10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aeb1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.882803:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.882817:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.882827:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.882841:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c400/0x7cee4af578415c1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.884395:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c400/0x7cee4af578415c1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.884405:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c400/0x7cee4af578415c1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002558.884772:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e8:0x0], index 1: 0 00010000:00010000:2.0:1786002558.884961:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c600/0x7cee4af578415c25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.884972:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c600/0x7cee4af578415c25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.884980:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c600/0x7cee4af578415c25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002558.885028:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983823 00010000:00010000:2.0:1786002558.886456:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c17 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.886467:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c17 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.886473:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.886481:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.887620:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570d400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002558.887631:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.887642:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c17 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.887658:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002558.887661:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002558.887665:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c17 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.887677:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002558.887699:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000319205ed reply state 000000003815d618 transno 4294983824 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c400/0x7cee4af578415c1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.887709:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c400/0x7cee4af578415c1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.887716:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xcad70079 (ffff9ed24559f100) 00010000:00010000:2.0:1786002558.887719:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002558.887722:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002558.887762:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415c10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aeb1 expref: 338 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.887776:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c600/0x7cee4af578415c25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aeb1 expref: 337 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002558.887784:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff9ed24559fb00) 00010000:00010000:2.0:1786002558.887786:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002558.887789:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24570c600, rc 0) 00000100:00100000:2.0:1786002558.887928:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+338:19369:x1872758530958592:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 5262us (5647us total) trans 4294983824 rc 0/0 00000100:00100000:2.0:1786002558.887938:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24011 00000020:00080000:2.0:1786002558.887944:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.924719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002558.924793:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530958848 00000100:00100000:3.0:1786002558.924802:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530958848 00000100:00100000:3.0:1786002558.924881:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5170 00000100:00100000:3.0:1786002558.924890:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+338:19369:x1872758530958848:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002558.925300:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983825 00000100:00100000:3.0:1786002558.925388:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+340:19369:x1872758530958848:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 498us (676us total) trans 4294983826 rc 0/0 00000100:00100000:3.0:1786002558.925396:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5170 00000020:00080000:3.0:1786002558.925401:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002558.944655:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002558.944784:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530959104 00000100:00100000:1.0:1786002558.944792:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530959104 00000100:00100000:1.0:1786002558.944901:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24012 00000100:00100000:1.0:1786002558.944912:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+340:19369:x1872758530959104:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002558.944935:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002558.944953:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415c33 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aeb8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.945064:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415c3a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.945077:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415c3a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.945088:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415c3a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.945103:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db200/0x7cee4af578415c41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.945110:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db200/0x7cee4af578415c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.945115:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db200/0x7cee4af578415c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002558.945460:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e9:0x0], index 0: 0 00010000:00010000:1.0:1786002558.946106:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db000/0x7cee4af578415c48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.946117:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db000/0x7cee4af578415c48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.946124:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db000/0x7cee4af578415c48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002558.946177:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983827 00010000:00010000:1.0:1786002558.946209:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415c3a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.946217:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415c3a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.946223:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415c3a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.946229:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415c3a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.946234:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455db600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002558.946238:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415c3a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.946244:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415c3a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.946254:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002558.946258:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002558.946261:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415c3a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.946267:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415c3a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002558.946278:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed03eb32 reply state 00000000e5a94470 transno 4294983828 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db200/0x7cee4af578415c41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.946287:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db200/0x7cee4af578415c41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.946293:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x71408f79 (ffff9ed2456c9200) 00010000:00010000:1.0:1786002558.946295:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002558.946297:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002558.947399:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415c33 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aeb8 expref: 344 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.947416:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db000/0x7cee4af578415c48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aeb8 expref: 343 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002558.947425:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff9ed2456c9d00) 00010000:00010000:1.0:1786002558.947428:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002558.947430:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2455db000, rc 0) 00000100:00100000:1.0:1786002558.948645:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+344:19369:x1872758530959104:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 3731us (3994us total) trans 4294983828 rc 0/0 00000100:00100000:1.0:1786002558.948655:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24012 00000020:00080000:1.0:1786002558.948662:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786002558.958298:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002558.976132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002558.976261:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530959360 00000100:00100000:2.0:1786002558.976270:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530959360 00000100:00100000:2.0:1786002558.976326:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5171 00000100:00100000:2.0:1786002558.976338:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+344:19369:x1872758530959360:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002558.976600:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983829 00000100:00100000:2.0:1786002558.976686:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+346:19369:x1872758530959360:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 350us (561us total) trans 4294983830 rc 0/0 00000100:00100000:2.0:1786002558.976693:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5171 00000020:00080000:2.0:1786002558.976698:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002558.986028:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002558.986391:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530959616 00000100:00100000:3.0:1786002558.986400:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530959616 00000100:00100000:3.0:1786002558.986526:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24013 00000100:00100000:3.0:1786002558.986547:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+346:19369:x1872758530959616:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002558.986570:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002558.986589:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415c56 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aebf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.986680:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415c5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.986694:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415c5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.986705:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415c5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.986718:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b200/0x7cee4af578415c64 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.986726:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b200/0x7cee4af578415c64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.986733:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b200/0x7cee4af578415c64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002558.987069:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e9:0x0], index 1: 0 00010000:00010000:3.0:1786002558.987218:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a600/0x7cee4af578415c6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987227:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a600/0x7cee4af578415c6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987234:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a600/0x7cee4af578415c6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002558.987282:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983831 00010000:00010000:3.0:1786002558.987327:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415c5d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987335:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415c5d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987341:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415c5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987347:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415c5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987352:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24577b600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002558.987356:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415c5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987363:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415c5d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987374:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002558.987377:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002558.987381:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415c5d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987386:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415c5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002558.987398:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070504f4c reply state 0000000093eb4719 transno 4294983832 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b200/0x7cee4af578415c64 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987412:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b200/0x7cee4af578415c64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987418:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa2c3e279 (ffff9ed24556e800) 00010000:00010000:3.0:1786002558.987421:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002558.987423:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002558.987450:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415c56 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aebf expref: 350 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987463:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a600/0x7cee4af578415c6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aebf expref: 349 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002558.987470:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff9ed24556ea00) 00010000:00010000:3.0:1786002558.987472:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002558.987475:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24577a600, rc 0) 00000100:00100000:3.0:1786002558.987534:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+350:19369:x1872758530959616:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 997us (1513us total) trans 4294983832 rc 0/0 00000100:00100000:3.0:1786002558.987542:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24013 00000020:00080000:3.0:1786002558.987547:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002559.015457:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002559.016982:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530959872 00000100:00100000:3.0:1786002559.016991:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530959872 00000100:00100000:3.0:1786002559.017051:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5172 00000100:00100000:3.0:1786002559.017062:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+350:19369:x1872758530959872:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002559.017298:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983833 00000100:00100000:3.0:1786002559.017402:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+352:19369:x1872758530959872:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 341us (1951us total) trans 4294983834 rc 0/0 00000100:00100000:3.0:1786002559.017415:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5172 00000020:00080000:3.0:1786002559.017419:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002559.083388:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002559.083538:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530960128 00000100:00100000:2.0:1786002559.083547:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530960128 00000100:00100000:2.0:1786002559.083610:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24014 00000100:00100000:2.0:1786002559.083621:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+352:19369:x1872758530960128:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002559.083643:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002559.083661:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c79 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aec6 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.083754:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415c80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.083768:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415c80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.083779:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415c80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.083794:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570cc00/0x7cee4af578415c87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.083801:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570cc00/0x7cee4af578415c87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.083808:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570cc00/0x7cee4af578415c87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002559.084137:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ea:0x0], index 0: 0 00010000:00010000:2.0:1786002559.084286:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d800/0x7cee4af578415c8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.084296:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d800/0x7cee4af578415c8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.084303:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d800/0x7cee4af578415c8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002559.084694:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983835 00010000:00010000:2.0:1786002559.084727:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415c80 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.084735:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415c80 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.084742:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415c80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.084748:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415c80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.084754:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002559.084757:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415c80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.084764:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415c80 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.084776:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002559.084779:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002559.084783:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415c80 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.084789:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415c80 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002559.084806:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096d32ab9 reply state 00000000d7fcbf52 transno 4294983836 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570cc00/0x7cee4af578415c87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.084815:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570cc00/0x7cee4af578415c87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.084821:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x77cd7179 (ffff9ed24559f400) 00010000:00010000:2.0:1786002559.084823:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002559.084825:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002559.085157:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415c79 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aec6 expref: 356 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.085175:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d800/0x7cee4af578415c8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aec6 expref: 355 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.085183:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff9ed24559ff00) 00010000:00010000:2.0:1786002559.085185:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002559.085188:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24570d800, rc 0) 00000100:00100000:2.0:1786002559.085246:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+356:19369:x1872758530960128:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1627us (1866us total) trans 4294983836 rc 0/0 00000100:00100000:2.0:1786002559.085255:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24014 00000020:00080000:2.0:1786002559.085259:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.092995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002559.095108:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530960384 00000100:00100000:0.0:1786002559.095118:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530960384 00000100:00100000:0.0:1786002559.095179:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5173 00000100:00100000:0.0:1786002559.095190:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+356:19369:x1872758530960384:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002559.095430:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983837 00000100:00100000:0.0:1786002559.095529:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+358:19369:x1872758530960384:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 339us (2540us total) trans 4294983838 rc 0/0 00000100:00100000:0.0:1786002559.095627:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5173 00000020:00080000:0.0:1786002559.095632:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002559.106842:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.108153:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530960640 00000100:00100000:1.0:1786002559.108162:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530960640 00000100:00100000:1.0:1786002559.108222:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24015 00000100:00100000:1.0:1786002559.108231:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+358:19369:x1872758530960640:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002559.108254:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002559.108273:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415c9c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aecd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.108368:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ca3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.108383:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ca3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.108394:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ca3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.108406:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da600/0x7cee4af578415caa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.108412:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da600/0x7cee4af578415caa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.108417:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da600/0x7cee4af578415caa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002559.108838:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ea:0x0], index 1: 0 00010000:00010000:1.0:1786002559.109349:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455daa00/0x7cee4af578415cb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109359:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455daa00/0x7cee4af578415cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109368:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455daa00/0x7cee4af578415cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002559.109418:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983839 00010000:00010000:1.0:1786002559.109449:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ca3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109457:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ca3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109464:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ca3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109471:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ca3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109477:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455db600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002559.109481:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ca3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109488:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ca3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109521:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002559.109524:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002559.109528:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ca3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109625:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ca3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002559.109644:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004acbe4aa reply state 0000000052cf50f6 transno 4294983840 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da600/0x7cee4af578415caa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109656:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da600/0x7cee4af578415caa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109663:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe58bac79 (ffff9ed2456c9000) 00010000:00010000:1.0:1786002559.109665:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002559.109668:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002559.109694:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415c9c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aecd expref: 362 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109707:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455daa00/0x7cee4af578415cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aecd expref: 361 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.109714:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff9ed2456c9400) 00010000:00010000:1.0:1786002559.109717:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002559.109719:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2455daa00, rc 0) 00000100:00100000:1.0:1786002559.109776:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+362:19369:x1872758530960640:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1545us (2941us total) trans 4294983840 rc 0/0 00000100:00100000:1.0:1786002559.109783:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24015 00000020:00080000:1.0:1786002559.109788:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.124695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.124777:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530960896 00000100:00100000:1.0:1786002559.124786:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530960896 00000100:00100000:1.0:1786002559.124838:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5174 00000100:00100000:1.0:1786002559.124881:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+362:19369:x1872758530960896:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002559.125128:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983841 00000100:00100000:1.0:1786002559.125223:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+364:19369:x1872758530960896:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 343us (535us total) trans 4294983842 rc 0/0 00000100:00100000:1.0:1786002559.125230:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5174 00000020:00080000:1.0:1786002559.125234:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.143894:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002559.143990:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530961152 00000100:00100000:3.0:1786002559.143999:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530961152 00000100:00100000:3.0:1786002559.144067:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24016 00000100:00100000:3.0:1786002559.144076:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+364:19369:x1872758530961152:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002559.144099:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002559.144117:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415cbf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aed4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144213:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415cc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144227:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415cc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144238:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415cc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144253:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ccd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144260:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ccd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144267:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ccd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002559.144612:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9eb:0x0], index 0: 0 00010000:00010000:3.0:1786002559.144750:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415cd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144760:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144768:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002559.144814:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983843 00010000:00010000:3.0:1786002559.144870:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415cc6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144878:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415cc6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144884:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415cc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144891:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415cc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144897:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24577b600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002559.144901:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415cc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144908:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415cc6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144920:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002559.144923:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002559.144927:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415cc6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144934:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415cc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002559.144946:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000981bdec5 reply state 0000000054ebbb39 transno 4294983844 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ccd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144956:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ccd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.144962:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8bf53b79 (ffff9ed24556e300) 00010000:00010000:3.0:1786002559.144964:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002559.144966:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002559.144991:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415cbf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aed4 expref: 368 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.145004:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aed4 expref: 367 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.145011:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff9ed24556ed00) 00010000:00010000:3.0:1786002559.145013:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002559.145016:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24577ba00, rc 0) 00000100:00100000:3.0:1786002559.145078:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+368:19369:x1872758530961152:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1002us (1191us total) trans 4294983844 rc 0/0 00000100:00100000:3.0:1786002559.145084:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24016 00000020:00080000:3.0:1786002559.145089:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002559.163779:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.164181:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530961408 00000100:00100000:1.0:1786002559.164190:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530961408 00000100:00100000:1.0:1786002559.164243:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5175 00000100:00100000:1.0:1786002559.164252:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+368:19369:x1872758530961408:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002559.164491:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983845 00000100:00100000:1.0:1786002559.164674:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+370:19369:x1872758530961408:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 421us (902us total) trans 4294983846 rc 0/0 00000100:00100000:1.0:1786002559.164683:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5175 00000020:00080000:1.0:1786002559.164687:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.171329:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.172683:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530961664 00000100:00100000:1.0:1786002559.172694:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530961664 00000100:00100000:1.0:1786002559.172758:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24017 00000100:00100000:1.0:1786002559.172767:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+370:19369:x1872758530961664:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002559.172788:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002559.172807:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415ce2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aedb expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.172936:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ce9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.172951:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ce9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.172961:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ce9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.172985:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbe00/0x7cee4af578415cf0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.172992:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbe00/0x7cee4af578415cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.172998:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbe00/0x7cee4af578415cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002559.173619:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9eb:0x0], index 1: 0 00010000:00010000:0.0:1786002559.173763:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578415cf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.173773:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578415cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.173781:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578415cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002559.173827:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983847 00010000:00010000:0.0:1786002559.173891:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ce9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.173901:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ce9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.173907:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ce9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.173915:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ce9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.173921:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455db600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002559.173925:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ce9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.173933:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ce9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.173945:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002559.173948:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002559.173952:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ce9 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.173959:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415ce9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002559.174140:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091fc1f3a reply state 0000000078a6b1fd transno 4294983848 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbe00/0x7cee4af578415cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.174151:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbe00/0x7cee4af578415cf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.174158:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa6a2e1ce (ffff9ed2456c9f00) 00010000:00010000:0.0:1786002559.174161:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002559.174164:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002559.174190:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415ce2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aedb expref: 374 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.174204:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578415cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aedb expref: 373 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.174212:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff9ed351207600) 00010000:00010000:0.0:1786002559.174214:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002559.174216:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34e00, rc 0) 00000100:00100000:0.0:1786002559.174316:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+374:19369:x1872758530961664:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1549us (2993us total) trans 4294983848 rc 0/0 00000100:00100000:0.0:1786002559.174324:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24017 00000020:00080000:0.0:1786002559.174328:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.205806:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002559.206067:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530961920 00000100:00100000:0.0:1786002559.206077:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530961920 00000100:00100000:0.0:1786002559.206134:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5176 00000100:00100000:0.0:1786002559.206144:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+374:19369:x1872758530961920:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002559.206382:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983849 00000100:00100000:0.0:1786002559.206473:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+376:19369:x1872758530961920:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 330us (673us total) trans 4294983850 rc 0/0 00000100:00100000:0.0:1786002559.206482:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5176 00000020:00080000:0.0:1786002559.206486:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.210632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.210755:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530962176 00000100:00100000:1.0:1786002559.210763:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530962176 00000100:00100000:1.0:1786002559.210819:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24018 00000100:00100000:1.0:1786002559.210828:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+376:19369:x1872758530962176:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002559.210888:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002559.210908:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db800/0x7cee4af578415d05 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aee2 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211039:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415d0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211054:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415d0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211065:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415d0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211080:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da200/0x7cee4af578415d13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211087:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da200/0x7cee4af578415d13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211094:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da200/0x7cee4af578415d13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002559.211353:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ec:0x0], index 0: 0 00010000:00010000:1.0:1786002559.211479:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da400/0x7cee4af578415d1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211487:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da400/0x7cee4af578415d1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211494:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da400/0x7cee4af578415d1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002559.211769:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983851 00010000:00010000:1.0:1786002559.211806:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415d0c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211814:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415d0c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211820:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415d0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211825:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415d0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211830:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455dbc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002559.211833:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415d0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211839:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415d0c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211868:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002559.211871:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002559.211875:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415d0c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211880:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415d0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002559.211891:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003e0a533 reply state 00000000bedd537f transno 4294983852 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da200/0x7cee4af578415d13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211900:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da200/0x7cee4af578415d13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211905:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x4d0c70ce (ffff9ed2456c9a00) 00010000:00010000:1.0:1786002559.211907:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002559.211909:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002559.211932:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db800/0x7cee4af578415d05 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aee2 expref: 380 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211943:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da400/0x7cee4af578415d1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aee2 expref: 379 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.211950:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff9ed2456c9100) 00010000:00010000:1.0:1786002559.211951:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002559.211953:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2455da400, rc 0) 00000100:00100000:2.0:1786002559.215291:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+380:19369:x1872758530962176:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 4454us (4657us total) trans 4294983852 rc 0/0 00000100:00100000:2.0:1786002559.215303:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24018 00000020:00080000:2.0:1786002559.215310:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.245004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.245189:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530962432 00000100:00100000:1.0:1786002559.245198:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530962432 00000100:00100000:1.0:1786002559.245251:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5177 00000100:00100000:1.0:1786002559.245261:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+380:19369:x1872758530962432:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002559.245484:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983853 00000100:00100000:1.0:1786002559.245745:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+382:19369:x1872758530962432:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 484us (748us total) trans 4294983854 rc 0/0 00000100:00100000:1.0:1786002559.245752:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5177 00000020:00080000:1.0:1786002559.245756:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002559.255800:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002559.255907:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530962688 00000100:00100000:2.0:1786002559.255916:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530962688 00000100:00100000:2.0:1786002559.255981:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24019 00000100:00100000:2.0:1786002559.255992:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+382:19369:x1872758530962688:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002559.256013:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002559.256040:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d200/0x7cee4af578415d28 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aee9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.256140:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415d2f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.256154:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415d2f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.256165:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415d2f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.256179:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d600/0x7cee4af578415d36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.256191:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d600/0x7cee4af578415d36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.256198:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d600/0x7cee4af578415d36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002559.256470:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ec:0x0], index 1: 0 00010000:00010000:2.0:1786002559.256895:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570de00/0x7cee4af578415d3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.256905:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570de00/0x7cee4af578415d3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.256913:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570de00/0x7cee4af578415d3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002559.256964:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983855 00010000:00010000:2.0:1786002559.258271:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415d2f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.258282:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415d2f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.258287:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415d2f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.258294:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415d2f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.258300:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002559.258304:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415d2f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.258312:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415d2f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.258325:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002559.258327:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002559.258332:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415d2f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.258338:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415d2f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002559.258353:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045d86e6e reply state 000000002e4558c7 transno 4294983856 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d600/0x7cee4af578415d36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.258364:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d600/0x7cee4af578415d36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.258369:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe8b99bce (ffff9ed24559fd00) 00010000:00010000:2.0:1786002559.258371:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002559.258374:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002559.258409:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d200/0x7cee4af578415d28 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aee9 expref: 386 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.258423:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570de00/0x7cee4af578415d3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aee9 expref: 385 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.258430:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff9ed24559f000) 00010000:00010000:2.0:1786002559.258432:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002559.258435:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24570de00, rc 0) 00000100:00100000:2.0:1786002559.262149:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+386:19369:x1872758530962688:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 6149us (6346us total) trans 4294983856 rc 0/0 00000100:00100000:2.0:1786002559.262161:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24019 00000020:00080000:2.0:1786002559.262169:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.307944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002559.308160:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530962944 00000100:00100000:3.0:1786002559.308169:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530962944 00000100:00100000:3.0:1786002559.308223:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5178 00000100:00100000:3.0:1786002559.308232:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+386:19369:x1872758530962944:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002559.308477:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983857 00000100:00100000:3.0:1786002559.308583:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+388:19369:x1872758530962944:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 351us (645us total) trans 4294983858 rc 0/0 00000100:00100000:3.0:1786002559.308592:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5178 00000020:00080000:3.0:1786002559.308597:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002559.339134:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561008512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002559.339200:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002559.339388:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561008512 00000100:00100000:1.0:1786002559.339396:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561008512 00000100:00100000:1.0:1786002559.339440:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046 00000100:00100000:1.0:1786002559.339449:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561008512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786002559.339487:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443954688 avail 1297715200 00000100:00100000:1.0:1786002559.339554:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561008512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002559.339560:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046 00000100:00100000:3.0:1786002559.339802:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561008512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002559.345346:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002559.345382:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002559.345412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002559.345438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002559.345457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002559.345956:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530963328 00000100:00100000:2.0:1786002559.345973:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530963328 00000100:00100000:2.0:1786002559.346037:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530963456 00000100:00100000:2.0:1786002559.346039:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530963456 00000100:00100000:2.0:1786002559.346064:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 494 00000100:00100000:2.0:1786002559.346074:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530963328:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002559.346150:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530963328:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 79us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002559.346156:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 494 00000100:00100000:2.0:1786002559.346170:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 495 00000100:00100000:2.0:1786002559.346176:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758530963456:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002559.346194:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758530963456:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 19us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002559.346199:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 495 00000100:00080000:0.0:1786002559.347122:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786002559.347126:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002559.348733:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530963200 00000100:00100000:3.0:1786002559.348740:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530963200 00000100:00100000:3.0:1786002559.348779:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530963712 00000100:00100000:3.0:1786002559.348781:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530963712 00000100:00100000:3.0:1786002559.348805:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 916 00000100:00100000:3.0:1786002559.348814:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530963200:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002559.348894:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758530963200:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 80us (3480us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002559.348902:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 916 00000100:00100000:3.0:1786002559.348917:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24020 00000100:00100000:3.0:1786002559.348923:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+388:19369:x1872758530963712:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002559.348938:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002559.348957:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415d4b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aef0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.349147:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.349162:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.349177:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.349192:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415d59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.349199:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415d59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.349205:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415d59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002559.349686:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530963072 00000100:00100000:1.0:1786002559.349692:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530963072 00000100:00100000:1.0:1786002559.349729:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 525 00000100:00100000:1.0:1786002559.349737:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758530963072:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002559.349770:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758530963072:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 34us (4432us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002559.349777:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 525 00000100:00080000:0.0:1786002559.350116:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1786002559.350826:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ed:0x0], index 0: 0 00010000:00010000:3.0:1786002559.352365:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415d60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.352382:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415d60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.352393:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415d60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002559.352458:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983859 00010000:00010000:3.0:1786002559.355884:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d52 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.355899:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d52 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.355906:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.355917:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.355922:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24577b600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002559.355927:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.355933:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d52 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.355947:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002559.355950:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002559.355953:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d52 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.355959:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002559.355989:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6d71a4e reply state 000000006d127ab5 transno 4294983860 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415d59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.356000:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415d59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.356007:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x91a3d2ce (ffff9ed24556e000) 00010000:00010000:3.0:1786002559.356009:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002559.356012:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002559.359217:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415d4b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aef0 expref: 392 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.359250:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415d60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aef0 expref: 391 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.359259:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff9ed24556e500) 00010000:00010000:3.0:1786002559.359262:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002559.359265:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b0000, rc 0) 00000100:00100000:3.0:1786002559.359337:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+392:19369:x1872758530963712:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 10413us (13898us total) trans 4294983860 rc 0/0 00000100:00100000:3.0:1786002559.359346:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24020 00000020:00080000:3.0:1786002559.359352:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.376728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002559.376947:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530963968 00000100:00100000:0.0:1786002559.376965:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530963968 00000100:00100000:0.0:1786002559.377022:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5179 00000100:00100000:0.0:1786002559.377031:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+392:19369:x1872758530963968:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002559.377268:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983861 00000100:00100000:0.0:1786002559.377356:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+394:19369:x1872758530963968:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 325us (635us total) trans 4294983862 rc 0/0 00000100:00100000:0.0:1786002559.377364:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5179 00000020:00080000:0.0:1786002559.377369:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002559.408894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002559.410389:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530964224 00000100:00100000:3.0:1786002559.410400:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530964224 00000100:00100000:3.0:1786002559.410475:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24021 00000100:00100000:3.0:1786002559.410494:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+394:19369:x1872758530964224:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002559.410525:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002559.410547:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415d6e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aef7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.410636:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d75 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.410649:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.410660:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d75 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.410678:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af578415d7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.410685:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af578415d7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002559.410692:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af578415d7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002559.410992:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ed:0x0], index 1: 0 00010000:00010000:2.0:1786002559.428725:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415d83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.428746:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415d83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.428758:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415d83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002559.428893:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983863 00010000:00010000:2.0:1786002559.428951:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d75 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.428960:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d75 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.429514:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d75 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.429521:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.429528:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24577b600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002559.429585:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d75 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.429595:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d75 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.429607:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002559.429610:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002559.429614:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d75 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.429621:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415d75 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002559.429635:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000065b07a4 reply state 000000002c9d1c53 transno 4294983864 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af578415d7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.429650:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af578415d7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.429656:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa0d0fdce (ffff9ed24556ef00) 00010000:00010000:2.0:1786002559.429658:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002559.429661:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002559.429697:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415d6e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aef7 expref: 398 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.429711:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415d83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aef7 expref: 397 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.429718:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff9ed24559f300) 00010000:00010000:2.0:1786002559.429720:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002559.429723:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24570c000, rc 0) 00000100:00100000:2.0:1786002559.429832:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+398:19369:x1872758530964224:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 19347us (20945us total) trans 4294983864 rc 0/0 00000100:00100000:2.0:1786002559.429841:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24021 00000020:00080000:2.0:1786002559.429904:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.474288:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.476088:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530964480 00000100:00100000:1.0:1786002559.476099:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530964480 00000100:00100000:1.0:1786002559.476158:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5180 00000100:00100000:1.0:1786002559.476167:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+398:19369:x1872758530964480:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002559.476405:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983865 00000100:00100000:1.0:1786002559.476501:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+400:19369:x1872758530964480:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 334us (2220us total) trans 4294983866 rc 0/0 00000100:00100000:1.0:1786002559.476525:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5180 00000020:00080000:1.0:1786002559.476669:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002559.490148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002559.490257:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530964736 00000100:00100000:2.0:1786002559.490266:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530964736 00000100:00100000:2.0:1786002559.490330:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24022 00000100:00100000:2.0:1786002559.490342:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+400:19369:x1872758530964736:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002559.490366:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002559.490387:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415d91 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aefe expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.490524:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415d98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.490548:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415d98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.490560:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415d98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.490575:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570da00/0x7cee4af578415d9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.490582:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570da00/0x7cee4af578415d9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.490588:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570da00/0x7cee4af578415d9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002559.490928:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ee:0x0], index 0: 0 00010000:00010000:2.0:1786002559.491100:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415da6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491111:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415da6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491118:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415da6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002559.491173:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983867 00010000:00010000:2.0:1786002559.491204:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415d98 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491212:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415d98 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491218:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415d98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491224:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415d98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491230:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002559.491234:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415d98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491241:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415d98 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491252:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002559.491255:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002559.491259:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415d98 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491267:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415d98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002559.491280:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000969ddd2b reply state 00000000cdf5067c transno 4294983868 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570da00/0x7cee4af578415d9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491291:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570da00/0x7cee4af578415d9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491297:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x95b00cce (ffff9ed24559f800) 00010000:00010000:2.0:1786002559.491300:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002559.491303:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002559.491329:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415d91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aefe expref: 404 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491343:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415da6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aefe expref: 403 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.491351:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff9ed366e57900) 00010000:00010000:2.0:1786002559.491354:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002559.491356:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24570d400, rc 0) 00000100:00100000:2.0:1786002559.491418:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+404:19369:x1872758530964736:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1079us (1279us total) trans 4294983868 rc 0/0 00000100:00100000:2.0:1786002559.491425:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24022 00000020:00080000:2.0:1786002559.491429:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.510131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002559.510215:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530964992 00000100:00100000:3.0:1786002559.510225:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530964992 00000100:00100000:3.0:1786002559.510278:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5181 00000100:00100000:3.0:1786002559.510287:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+404:19369:x1872758530964992:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002559.510559:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983869 00000100:00100000:3.0:1786002559.510654:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+406:19369:x1872758530964992:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 367us (531us total) trans 4294983870 rc 0/0 00000100:00100000:3.0:1786002559.510663:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5181 00000020:00080000:3.0:1786002559.510667:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002559.529517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002559.530620:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530965248 00000100:00100000:0.0:1786002559.530629:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530965248 00000100:00100000:0.0:1786002559.530688:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24023 00000100:00100000:0.0:1786002559.530697:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+406:19369:x1872758530965248:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002559.530721:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002559.530739:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578415db4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af05 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.530832:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415dbb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.530898:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415dbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.530911:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415dbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.530947:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578415dc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.530955:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578415dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.531103:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578415dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002559.531448:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ee:0x0], index 1: 0 00010000:00010000:1.0:1786002559.531620:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db800/0x7cee4af578415dc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531629:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db800/0x7cee4af578415dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531636:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db800/0x7cee4af578415dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002559.531682:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983871 00010000:00010000:1.0:1786002559.531714:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415dbb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531721:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415dbb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531728:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415dbb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531734:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415dbb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531740:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002559.531744:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415dbb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531755:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415dbb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531767:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002559.531770:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002559.531774:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415dbb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531780:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415dbb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002559.531793:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000767116e5 reply state 000000001d2fe682 transno 4294983872 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578415dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531802:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578415dc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531808:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd0dd37ce (ffff9ed351207700) 00010000:00010000:1.0:1786002559.531810:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002559.531812:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002559.531836:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578415db4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af05 expref: 410 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531892:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db800/0x7cee4af578415dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af05 expref: 409 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.531901:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff9ed2456c9500) 00010000:00010000:1.0:1786002559.531903:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002559.531905:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2455db800, rc 0) 00000100:00100000:1.0:1786002559.531993:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+410:19369:x1872758530965248:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1296us (2491us total) trans 4294983872 rc 0/0 00000100:00100000:1.0:1786002559.532000:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24023 00000020:00080000:1.0:1786002559.532005:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.583389:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.583571:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530965504 00000100:00100000:1.0:1786002559.583580:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530965504 00000100:00100000:1.0:1786002559.583636:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5182 00000100:00100000:1.0:1786002559.583645:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+410:19369:x1872758530965504:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002559.583920:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983873 00000100:00100000:1.0:1786002559.584158:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+412:19369:x1872758530965504:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 513us (776us total) trans 4294983874 rc 0/0 00000100:00100000:1.0:1786002559.584166:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5182 00000020:00080000:1.0:1786002559.584171:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002559.622260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002559.622411:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530965760 00000100:00100000:2.0:1786002559.622422:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530965760 00000100:00100000:2.0:1786002559.622498:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24024 00000100:00100000:2.0:1786002559.622520:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+412:19369:x1872758530965760:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002559.622544:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002559.622563:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415dd7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af0c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.622665:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dde lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.622679:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.622689:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.622702:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415de5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.622708:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.622714:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002559.623081:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ef:0x0], index 0: 0 00010000:00010000:2.0:1786002559.623214:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d200/0x7cee4af578415dec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623222:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d200/0x7cee4af578415dec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623229:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d200/0x7cee4af578415dec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002559.623274:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983875 00010000:00010000:2.0:1786002559.623305:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dde lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623325:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dde lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623330:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623340:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623346:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570c800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002559.623350:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623355:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dde lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623365:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002559.623368:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002559.623372:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dde lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623376:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dde lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002559.623388:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008564d0b6 reply state 000000006424392f transno 4294983876 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415de5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623396:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415de5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623401:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x77c76ece (ffff9ed366e57e00) 00010000:00010000:2.0:1786002559.623403:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002559.623405:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002559.623428:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415dd7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af0c expref: 416 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623444:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d200/0x7cee4af578415dec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af0c expref: 415 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.623451:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff9ed366e57f00) 00010000:00010000:2.0:1786002559.623453:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002559.623455:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24570d200, rc 0) 00000100:00100000:2.0:1786002559.623530:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+416:19369:x1872758530965760:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1013us (1278us total) trans 4294983876 rc 0/0 00000100:00100000:2.0:1786002559.623537:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24024 00000020:00080000:2.0:1786002559.623541:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002559.634706:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002559.636589:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530966016 00000100:00100000:0.0:1786002559.636601:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530966016 00000100:00100000:0.0:1786002559.636664:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5183 00000100:00100000:0.0:1786002559.636675:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+416:19369:x1872758530966016:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002559.636974:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983877 00000100:00100000:0.0:1786002559.637089:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+418:19369:x1872758530966016:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 414us (2389us total) trans 4294983878 rc 0/0 00000100:00100000:0.0:1786002559.637097:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5183 00000020:00080000:0.0:1786002559.637102:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002559.646609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002559.646746:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530966272 00000100:00100000:2.0:1786002559.646756:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530966272 00000100:00100000:2.0:1786002559.646828:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24025 00000100:00100000:2.0:1786002559.646870:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+418:19369:x1872758530966272:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002559.646895:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002559.646915:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dfa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af13 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647014:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415e01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647039:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415e01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647051:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415e01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647071:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415e08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647078:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415e08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647089:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415e08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002559.647419:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ef:0x0], index 1: 0 00010000:00010000:2.0:1786002559.647732:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415e0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647742:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647751:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002559.647808:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983879 00010000:00010000:2.0:1786002559.647871:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415e01 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647879:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415e01 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647885:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415e01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647891:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415e01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647901:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002559.647906:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415e01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647913:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415e01 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647926:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002559.647929:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002559.647933:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415e01 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647939:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415e01 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002559.647953:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039573b17 reply state 00000000692040ca transno 4294983880 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415e08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647962:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415e08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.647968:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe585a9ce (ffff9ed366e57800) 00010000:00010000:2.0:1786002559.647970:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002559.647973:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002559.648002:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415dfa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af13 expref: 422 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.648016:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415e0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af13 expref: 421 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.650584:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff9ed366e57600) 00010000:00010000:2.0:1786002559.650587:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002559.650591:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed24577ac00, rc 0) 00000100:00100000:2.0:1786002559.650669:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+422:19369:x1872758530966272:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 3829us (4065us total) trans 4294983880 rc 0/0 00000100:00100000:2.0:1786002559.650679:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24025 00000020:00080000:2.0:1786002559.650686:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.670232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.672734:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530966528 00000100:00100000:1.0:1786002559.672745:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530966528 00000100:00100000:1.0:1786002559.672806:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5184 00000100:00100000:1.0:1786002559.672815:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+422:19369:x1872758530966528:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002559.673108:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983881 00000100:00100000:1.0:1786002559.673201:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+424:19369:x1872758530966528:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 386us (2976us total) trans 4294983882 rc 0/0 00000100:00100000:1.0:1786002559.673209:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5184 00000020:00080000:1.0:1786002559.673213:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002559.694126:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.694589:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530966784 00000100:00100000:1.0:1786002559.694598:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530966784 00000100:00100000:1.0:1786002559.694657:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24026 00000100:00100000:1.0:1786002559.694667:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+424:19369:x1872758530966784:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002559.694689:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002559.694709:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415e1d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af1a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.694803:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e24 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.694816:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e24 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.694826:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e24 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.694840:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db400/0x7cee4af578415e2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.694864:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db400/0x7cee4af578415e2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.694872:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db400/0x7cee4af578415e2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002559.695183:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f0:0x0], index 0: 0 00010000:00010000:1.0:1786002559.695336:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dac00/0x7cee4af578415e32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695346:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dac00/0x7cee4af578415e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695354:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dac00/0x7cee4af578415e32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002559.695407:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983883 00010000:00010000:1.0:1786002559.695441:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e24 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695448:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e24 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695454:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e24 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695460:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e24 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695466:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455da000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002559.695470:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e24 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695477:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e24 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695489:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002559.695492:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002559.695496:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e24 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695513:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e24 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002559.695527:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b84d51a2 reply state 00000000aa617b76 transno 4294983884 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db400/0x7cee4af578415e2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695537:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db400/0x7cee4af578415e2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695543:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x4de4b8ce (ffff9ed2456c9600) 00010000:00010000:1.0:1786002559.695545:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002559.695548:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002559.695574:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415e1d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af1a expref: 428 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695588:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dac00/0x7cee4af578415e32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af1a expref: 427 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.695597:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff9ed2456c9300) 00010000:00010000:1.0:1786002559.695599:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002559.695601:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2455dac00, rc 0) 00000100:00100000:1.0:1786002559.695661:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+428:19369:x1872758530966784:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 995us (1543us total) trans 4294983884 rc 0/0 00000100:00100000:1.0:1786002559.695668:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24026 00000020:00080000:1.0:1786002559.695672:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002559.711200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.711558:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530967040 00000100:00100000:1.0:1786002559.711566:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530967040 00000100:00100000:1.0:1786002559.711626:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5185 00000100:00100000:1.0:1786002559.711636:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+428:19369:x1872758530967040:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002559.711899:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983885 00000100:00100000:1.0:1786002559.711999:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+430:19369:x1872758530967040:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 363us (806us total) trans 4294983886 rc 0/0 00000100:00100000:1.0:1786002559.712007:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5185 00000020:00080000:1.0:1786002559.712012:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.727184:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002559.729589:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530967296 00000100:00100000:0.0:1786002559.729600:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530967296 00000100:00100000:0.0:1786002559.729670:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24027 00000100:00100000:0.0:1786002559.729680:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+430:19369:x1872758530967296:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002559.729703:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002559.729721:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578415e40 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af21 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.729813:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415e47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.729827:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415e47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.729837:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415e47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.729887:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578415e4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.729896:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578415e4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.729903:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578415e4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002559.730310:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f0:0x0], index 1: 0 00010000:00010000:0.0:1786002559.730460:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578415e55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.730469:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578415e55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.730477:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578415e55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002559.732166:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983887 00010000:00010000:0.0:1786002559.732215:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415e47 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.732224:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415e47 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.732231:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415e47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.732237:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415e47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.732242:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002559.732246:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415e47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.732253:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415e47 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.732266:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002559.732269:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002559.732273:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415e47 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.732279:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415e47 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002559.732291:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c40be8d reply state 00000000fb41a988 transno 4294983888 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578415e4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.732305:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578415e4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.732311:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5501ae7b (ffff9ed351207500) 00010000:00010000:0.0:1786002559.732314:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002559.732316:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002559.732351:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578415e40 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af21 expref: 434 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.732366:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578415e55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af21 expref: 433 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002559.732372:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff9ed351207e00) 00010000:00010000:0.0:1786002559.732374:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002559.732377:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2423b4000, rc 0) 00000100:00100000:0.0:1786002559.732493:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+434:19369:x1872758530967296:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2813us (5315us total) trans 4294983888 rc 0/0 00000100:00100000:0.0:1786002559.732509:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24027 00000020:00080000:0.0:1786002559.732516:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.753230:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002559.753315:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530967552 00000100:00100000:0.0:1786002559.753326:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530967552 00000100:00100000:0.0:1786002559.753382:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5186 00000100:00100000:0.0:1786002559.753392:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+434:19369:x1872758530967552:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002559.753665:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983889 00000100:00100000:0.0:1786002559.753755:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+436:19369:x1872758530967552:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 364us (533us total) trans 4294983890 rc 0/0 00000100:00100000:0.0:1786002559.753767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5186 00000020:00080000:0.0:1786002559.753771:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002559.763355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.763558:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530967808 00000100:00100000:1.0:1786002559.763568:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530967808 00000100:00100000:1.0:1786002559.763636:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24028 00000100:00100000:1.0:1786002559.763645:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+436:19369:x1872758530967808:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002559.763670:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002559.763690:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415e63 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.763781:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.763794:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.763804:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.763816:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415e71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.763823:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415e71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.763828:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415e71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002559.764188:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f1:0x0], index 0: 0 00010000:00010000:1.0:1786002559.764325:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415e78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764333:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415e78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764340:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415e78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002559.764396:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983891 00010000:00010000:1.0:1786002559.764430:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e6a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764438:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e6a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764445:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764452:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764457:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455da000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002559.764461:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764470:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e6a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764482:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002559.764484:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002559.764489:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e6a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764495:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e6a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002559.764525:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6ab4694 reply state 0000000090b16513 transno 4294983892 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415e71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764541:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415e71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764547:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb3d7b (ffff9ed2456c9b00) 00010000:00010000:1.0:1786002559.764549:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002559.764551:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002559.764578:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415e63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af28 expref: 440 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764591:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415e78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af28 expref: 439 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.764598:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff9ed2456c9700) 00010000:00010000:1.0:1786002559.764600:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002559.764602:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2455db600, rc 0) 00000100:00100000:1.0:1786002559.764669:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+440:19369:x1872758530967808:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1024us (1321us total) trans 4294983892 rc 0/0 00000100:00100000:1.0:1786002559.764677:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24028 00000020:00080000:1.0:1786002559.764682:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.796161:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002559.796250:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530968064 00000100:00100000:3.0:1786002559.796259:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530968064 00000100:00100000:3.0:1786002559.796314:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5187 00000100:00100000:3.0:1786002559.796324:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+440:19369:x1872758530968064:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002559.796729:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983893 00000100:00100000:3.0:1786002559.796824:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+442:19369:x1872758530968064:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 500us (670us total) trans 4294983894 rc 0/0 00000100:00100000:3.0:1786002559.796833:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5187 00000020:00080000:3.0:1786002559.796838:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002559.813001:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.813109:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530968320 00000100:00100000:1.0:1786002559.813118:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530968320 00000100:00100000:1.0:1786002559.813175:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24029 00000100:00100000:1.0:1786002559.813184:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+442:19369:x1872758530968320:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002559.813205:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002559.813223:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415e86 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af2f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.813328:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.813342:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.813353:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.813367:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dae00/0x7cee4af578415e94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x170e687b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.813374:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dae00/0x7cee4af578415e94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.813380:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dae00/0x7cee4af578415e94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002559.813690:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f1:0x0], index 1: 0 00010000:00010000:1.0:1786002559.813870:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578415e9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.813880:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578415e9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.813888:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578415e9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002559.813943:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983895 00010000:00010000:1.0:1786002559.813986:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e8d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.813998:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e8d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.814004:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.814012:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.814019:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455da000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002559.814023:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.814031:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e8d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.814042:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002559.814045:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002559.814050:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e8d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.814056:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415e8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002559.814069:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f78adfa1 reply state 00000000835b2c62 transno 4294983896 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dae00/0x7cee4af578415e94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.814079:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dae00/0x7cee4af578415e94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.814085:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x170e687b (ffff9ed2456c9c00) 00010000:00010000:1.0:1786002559.814087:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002559.814090:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002559.814118:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415e86 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af2f expref: 446 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.814131:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578415e9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af2f expref: 445 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002559.814138:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff9ed2456c9800) 00010000:00010000:1.0:1786002559.814140:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002559.814142:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed35a228200, rc 0) 00000100:00100000:1.0:1786002559.814209:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+446:19369:x1872758530968320:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1025us (1216us total) trans 4294983896 rc 0/0 00000100:00100000:1.0:1786002559.814217:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24029 00000020:00080000:1.0:1786002559.814223:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002559.832168:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.832563:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530968576 00000100:00100000:1.0:1786002559.832572:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530968576 00000100:00100000:1.0:1786002559.832630:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5188 00000100:00100000:1.0:1786002559.832639:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+446:19369:x1872758530968576:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002559.832905:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983897 00000100:00100000:2.0:1786002559.833078:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+448:19369:x1872758530968576:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 438us (915us total) trans 4294983898 rc 0/0 00000100:00100000:2.0:1786002559.833086:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5188 00000020:00080000:2.0:1786002559.833091:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002559.855597:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002559.855974:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530968832 00000100:00100000:2.0:1786002559.855983:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530968832 00000100:00100000:2.0:1786002559.856049:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24030 00000100:00100000:2.0:1786002559.856059:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+448:19369:x1872758530968832:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002559.856084:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002559.856104:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415ea9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af36 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.856201:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415eb0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.856214:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.856224:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.856249:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415eb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.856256:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.856261:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002559.856578:0:8759:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8759:1872758561008640:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1786002559.856591:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f2:0x0], index 0: 0 00000100:00100000:1.0:1786002559.856625:0:8759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002559.856679:0:8759:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e4a0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1786002559.856769:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578415ebe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002559.856776:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561008640 00010000:00010000:2.0:1786002559.856778:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578415ebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002559.856780:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561008640 00010000:00010000:2.0:1786002559.856786:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578415ebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002559.856820:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5242 00000100:00100000:0.0:1786002559.856828:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:8759:x1872758561008640:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1786002559.856883:0:14685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2562 00000001:00080000:2.0:1786002559.857112:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983899 00010000:00010000:2.0:1786002559.857154:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415eb0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.857162:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415eb0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.857172:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415eb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.857179:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415eb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.857185:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570c800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002559.857189:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415eb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.857196:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415eb0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.857208:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002559.857211:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002559.857216:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415eb0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.857222:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af578415eb0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002559.857248:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000241fcf05 reply state 00000000c90aac6a transno 4294983900 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.857259:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415eb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.857266:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x95f89f7b (ffff9ed366e57100) 00010000:00010000:2.0:1786002559.857268:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002559.857271:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002559.857298:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af578415ea9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af36 expref: 452 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.857413:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578415ebe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af36 expref: 451 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.857421:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff9ed366e57400) 00010000:00010000:2.0:1786002559.857423:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002559.857425:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999a00, rc 0) 00000100:00100000:2.0:1786002559.857470:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+452:19369:x1872758530968832:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1413us (1882us total) trans 4294983900 rc 0/0 00000100:00100000:2.0:1786002559.857478:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24030 00000020:00080000:2.0:1786002559.857483:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002559.858170:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:8759:x1872758561008640:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1341us (1543us total) trans 4294969901 rc 0/0 00000100:00100000:0.0:1786002559.858177:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5242 00000100:00100000:3.0:1786002559.858421:0:8759:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8759:1872758561008640:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1786002559.858433:0:8759:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x9f2:0x0]-[0x280000401:0xa21:0x0] 00000100:00100000:3.0:1786002559.887991:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002559.891735:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530969088 00000100:00100000:1.0:1786002559.891746:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530969088 00000100:00100000:1.0:1786002559.891814:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5189 00000100:00100000:1.0:1786002559.891823:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+452:19369:x1872758530969088:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002559.892107:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983901 00000100:00100000:1.0:1786002559.892209:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+454:19369:x1872758530969088:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 385us (4226us total) trans 4294983902 rc 0/0 00000100:00100000:1.0:1786002559.892217:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5189 00000020:00080000:1.0:1786002559.892221:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002559.896368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002559.896488:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530969344 00000100:00100000:2.0:1786002559.896499:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530969344 00000100:00100000:2.0:1786002559.896564:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24031 00000100:00100000:2.0:1786002559.896575:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+454:19369:x1872758530969344:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002559.896596:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002559.896614:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578415ecc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af3d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.896713:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415ed3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.896726:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415ed3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.896736:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415ed3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.896753:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998600/0x7cee4af578415eda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.896760:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998600/0x7cee4af578415eda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.896766:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998600/0x7cee4af578415eda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002559.897114:0:9839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9839:1872758561008768:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1786002559.897162:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002559.897228:0:9839:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245de7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786002559.897314:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561008768 00000100:00100000:1.0:1786002559.897319:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561008768 00000100:00100000:1.0:1786002559.897373:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5243 00000100:00100000:1.0:1786002559.897381:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9839:x1872758561008768:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1786002559.897410:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2562 00000004:00080000:2.0:1786002559.897459:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f2:0x0], index 1: 0 00010000:00010000:2.0:1786002559.897645:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578415ee1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.897655:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578415ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.897662:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578415ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002559.897716:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983903 00010000:00010000:2.0:1786002559.897749:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415ed3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.897756:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415ed3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.897763:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415ed3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.897770:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415ed3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.897781:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002559.897786:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415ed3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.897792:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415ed3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.897804:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002559.897807:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002559.897811:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415ed3 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.897817:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415ed3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002559.897971:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0c71bf3 reply state 0000000087e98d2c transno 4294983904 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998600/0x7cee4af578415eda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.897985:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998600/0x7cee4af578415eda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.897992:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd905ca7b (ffff9ed366e57300) 00010000:00010000:2.0:1786002559.897994:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002559.897997:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002559.898595:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578415ecc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af3d expref: 458 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.898615:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578415ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af3d expref: 457 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.898627:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff9ed366e57000) 00010000:00010000:2.0:1786002559.898629:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002559.898631:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998000, rc 0) 00000100:00100000:2.0:1786002559.898747:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+458:19369:x1872758530969344:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2173us (2387us total) trans 4294983904 rc 0/0 00000100:00100000:2.0:1786002559.898756:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24031 00000020:00080000:2.0:1786002559.898761:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1786002559.899089:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002559.902572:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:9839:x1872758561008768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5142us (5359us total) trans 4294969898 rc 0/0 00000100:00100000:1.0:1786002559.902585:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5243 00000100:00100000:0.0:1786002559.916946:0:9839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9839:1872758561008768:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1786002559.917063:0:9839:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x9f2:0x0]-[0x2c0000401:0xa21:0x0] 00000100:00100000:2.0:1786002559.947919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002559.948043:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530969600 00000100:00100000:3.0:1786002559.948053:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530969600 00000100:00100000:3.0:1786002559.948108:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5190 00000100:00100000:3.0:1786002559.948118:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+458:19369:x1872758530969600:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002559.948359:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983905 00000100:00100000:3.0:1786002559.948448:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+460:19369:x1872758530969600:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 331us (538us total) trans 4294983906 rc 0/0 00000100:00100000:3.0:1786002559.948455:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5190 00000020:00080000:3.0:1786002559.948460:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786002559.978780:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002559.987250:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002559.987349:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530969856 00000100:00100000:2.0:1786002559.987359:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530969856 00000100:00100000:2.0:1786002559.987429:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24032 00000100:00100000:2.0:1786002559.987441:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+460:19369:x1872758530969856:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002559.987466:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002559.987508:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415eef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af44 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.987662:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415ef6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.987678:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415ef6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.987690:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415ef6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.987705:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999800/0x7cee4af578415efd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.987717:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999800/0x7cee4af578415efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.987724:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999800/0x7cee4af578415efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002559.988123:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f3:0x0], index 0: 0 00010000:00010000:2.0:1786002559.988279:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578415f04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1592:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988288:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578415f04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1592:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988295:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578415f04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1592:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002559.988347:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983907 00010000:00010000:2.0:1786002559.988381:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415ef6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988389:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415ef6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988394:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415ef6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988399:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415ef6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988404:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002559.988407:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415ef6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988414:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415ef6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988426:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002559.988428:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002559.988432:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415ef6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988439:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415ef6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002559.988451:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7d8413d reply state 000000001575b2cb transno 4294983908 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999800/0x7cee4af578415efd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988460:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999800/0x7cee4af578415efd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988465:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xee04d97b (ffff9ed366e57500) 00010000:00010000:2.0:1786002559.988474:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002559.988477:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002559.988512:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578415eef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af44 expref: 464 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988528:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578415f04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1592:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af44 expref: 463 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002559.988535:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1592:0x0].0x0 (ffff9ed2434df400) 00010000:00010000:2.0:1786002559.988537:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002559.988539:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998a00, rc 0) 00000100:00100000:2.0:1786002559.988592:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+464:19369:x1872758530969856:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1154us (1350us total) trans 4294983908 rc 0/0 00000100:00100000:2.0:1786002559.988599:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24032 00000020:00080000:2.0:1786002559.988603:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.021525:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002560.021610:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530970112 00000100:00100000:0.0:1786002560.021620:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530970112 00000100:00100000:0.0:1786002560.021698:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5191 00000100:00100000:0.0:1786002560.021709:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+464:19369:x1872758530970112:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002560.022029:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983909 00000100:00100000:0.0:1786002560.022125:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+466:19369:x1872758530970112:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 417us (645us total) trans 4294983910 rc 0/0 00000100:00100000:0.0:1786002560.022133:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5191 00000020:00080000:0.0:1786002560.022138:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1786002560.022201:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002560.046803:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002560.046881:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530970368 00000100:00100000:2.0:1786002560.046891:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530970368 00000100:00100000:2.0:1786002560.046955:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24033 00000100:00100000:2.0:1786002560.046979:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+466:19369:x1872758530970368:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002560.047001:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002560.047020:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415f12 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af4b expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047120:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f19 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047134:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047144:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047159:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999e00/0x7cee4af578415f20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047166:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999e00/0x7cee4af578415f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047173:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999e00/0x7cee4af578415f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002560.047455:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f3:0x0], index 1: 0 00010000:00010000:2.0:1786002560.047628:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578415f27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1593:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047638:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578415f27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1593:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047645:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578415f27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1593:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002560.047696:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983911 00010000:00010000:2.0:1786002560.047730:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f19 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047738:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f19 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047745:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047751:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047758:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002560.047762:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047770:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f19 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047781:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002560.047785:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002560.047790:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f19 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047796:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002560.047809:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d23ce5ef reply state 00000000dc7fedc3 transno 4294983912 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999e00/0x7cee4af578415f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047819:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999e00/0x7cee4af578415f20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047826:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xdfb2047b (ffff9ed2434dfc00) 00010000:00010000:2.0:1786002560.047828:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002560.047830:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002560.047888:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415f12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af4b expref: 470 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047903:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578415f27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1593:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af4b expref: 469 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.047910:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1593:0x0].0x0 (ffff9ed2434df700) 00010000:00010000:2.0:1786002560.047912:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002560.047915:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999600, rc 0) 00000100:00100000:2.0:1786002560.047977:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+470:19369:x1872758530970368:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1005us (1183us total) trans 4294983912 rc 0/0 00000100:00100000:2.0:1786002560.047985:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24033 00000020:00080000:2.0:1786002560.047990:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.085626:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.085771:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530970624 00000100:00100000:1.0:1786002560.085781:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530970624 00000100:00100000:1.0:1786002560.085839:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5192 00000100:00100000:1.0:1786002560.085878:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+470:19369:x1872758530970624:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002560.086151:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983913 00000100:00100000:1.0:1786002560.086242:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+472:19369:x1872758530970624:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 393us (623us total) trans 4294983914 rc 0/0 00000100:00100000:1.0:1786002560.086250:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5192 00000020:00080000:1.0:1786002560.086255:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.115794:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002560.115888:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530970880 00000100:00100000:2.0:1786002560.115897:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530970880 00000100:00100000:2.0:1786002560.115956:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24034 00000100:00100000:2.0:1786002560.115966:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+472:19369:x1872758530970880:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002560.115989:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002560.116008:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f35 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af52 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116122:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415f3c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116135:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415f3c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116146:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415f3c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116160:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578415f43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116167:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578415f43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116173:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578415f43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002560.116458:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f4:0x0], index 0: 0 00010000:00010000:2.0:1786002560.116629:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578415f4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1594:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116639:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578415f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1594:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116647:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578415f4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1594:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002560.116698:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983915 00010000:00010000:2.0:1786002560.116730:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415f3c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116739:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415f3c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116745:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415f3c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116752:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415f3c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116759:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002560.116763:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415f3c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116770:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415f3c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116781:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002560.116785:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002560.116789:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415f3c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116796:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415f3c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002560.116812:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5fe898a reply state 000000000f4e744c transno 4294983916 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578415f43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116823:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578415f43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116830:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x869c3b7b (ffff9ed2434df100) 00010000:00010000:2.0:1786002560.116833:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002560.116835:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002560.116895:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415f35 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af52 expref: 476 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116909:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578415f4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1594:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af52 expref: 475 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.116917:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1594:0x0].0x0 (ffff9ed2434dfd00) 00010000:00010000:2.0:1786002560.116920:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002560.116922:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998e00, rc 0) 00000100:00100000:2.0:1786002560.116981:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+476:19369:x1872758530970880:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1015us (1195us total) trans 4294983916 rc 0/0 00000100:00100000:2.0:1786002560.116987:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24034 00000020:00080000:2.0:1786002560.116991:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.183279:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.183422:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530971136 00000100:00100000:3.0:1786002560.183431:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530971136 00000100:00100000:3.0:1786002560.183494:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5193 00000100:00100000:3.0:1786002560.183512:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+476:19369:x1872758530971136:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002560.183794:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983917 00000100:00100000:3.0:1786002560.183927:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+478:19369:x1872758530971136:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 416us (655us total) trans 4294983918 rc 0/0 00000100:00100000:3.0:1786002560.183934:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5193 00000020:00080000:3.0:1786002560.183939:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.217752:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.219119:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530971392 00000100:00100000:1.0:1786002560.219128:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530971392 00000100:00100000:1.0:1786002560.219188:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24035 00000100:00100000:1.0:1786002560.219197:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+478:19369:x1872758530971392:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002560.219220:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002560.219239:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415f58 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af59 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.219336:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f5f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.219349:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f5f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.219359:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f5f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.219373:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415f66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.219380:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415f66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.219386:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415f66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002560.219693:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f4:0x0], index 1: 0 00010000:00010000:1.0:1786002560.219891:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415f6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1595:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.219901:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415f6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1595:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.219908:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415f6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1595:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002560.219959:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983919 00010000:00010000:1.0:1786002560.219992:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f5f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.220001:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f5f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.220008:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f5f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.220014:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f5f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.220032:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455dbc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002560.220037:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f5f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.220044:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f5f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.220055:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002560.220058:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002560.220062:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f5f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.220070:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f5f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002560.220083:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f904248 reply state 000000004bfae320 transno 4294983920 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415f66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.220099:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415f66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.220105:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x9bba767b (ffff9ed366c05c00) 00010000:00010000:1.0:1786002560.220108:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002560.220110:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002560.220135:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415f58 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af59 expref: 482 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.220146:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415f6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1595:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af59 expref: 481 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.220153:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1595:0x0].0x0 (ffff9ed366c05200) 00010000:00010000:1.0:1786002560.220155:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002560.220157:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed3429eb600, rc 0) 00000100:00100000:1.0:1786002560.220206:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+482:19369:x1872758530971392:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1011us (2463us total) trans 4294983920 rc 0/0 00000100:00100000:1.0:1786002560.220214:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24035 00000020:00080000:1.0:1786002560.220218:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.244222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002560.250947:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530971648 00000100:00100000:0.0:1786002560.250960:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530971648 00000100:00100000:0.0:1786002560.251039:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5194 00000100:00100000:0.0:1786002560.251050:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+482:19369:x1872758530971648:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002560.251284:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983921 00000100:00100000:0.0:1786002560.251378:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+484:19369:x1872758530971648:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 329us (7178us total) trans 4294983922 rc 0/0 00000100:00100000:0.0:1786002560.251387:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5194 00000020:00080000:0.0:1786002560.251392:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002560.267673:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.267771:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530971904 00000100:00100000:1.0:1786002560.267781:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530971904 00000100:00100000:1.0:1786002560.267872:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24036 00000100:00100000:1.0:1786002560.267882:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+484:19369:x1872758530971904:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002560.267904:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002560.267926:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415f7b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af60 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.268035:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f82 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.268049:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.268060:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.268074:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415f89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.268081:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415f89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.268088:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415f89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002560.268400:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f5:0x0], index 0: 0 00010000:00010000:1.0:1786002560.268802:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578415f90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1596:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.268811:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578415f90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1596:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.268818:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578415f90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1596:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002560.268978:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983923 00010000:00010000:1.0:1786002560.269013:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f82 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.269083:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f82 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.269091:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f82 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.269098:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f82 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.269105:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455dbc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002560.269110:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f82 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.269118:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f82 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.269130:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002560.269133:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002560.269137:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f82 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.269144:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578415f82 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002560.269156:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a442dd6 reply state 000000001c89c3d7 transno 4294983924 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415f89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.269166:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415f89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.269173:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8b9857b (ffff9ed366c05400) 00010000:00010000:1.0:1786002560.269176:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002560.269179:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002560.269205:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af578415f7b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af60 expref: 488 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.269219:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578415f90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1596:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af60 expref: 487 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.269226:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1596:0x0].0x0 (ffff9ed366c05100) 00010000:00010000:1.0:1786002560.269228:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002560.269230:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b400, rc 0) 00000100:00100000:1.0:1786002560.269288:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+488:19369:x1872758530971904:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1408us (1626us total) trans 4294983924 rc 0/0 00000100:00100000:1.0:1786002560.269296:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24036 00000020:00080000:1.0:1786002560.269301:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.282911:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002560.283057:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530972160 00000100:00100000:2.0:1786002560.283067:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530972160 00000100:00100000:2.0:1786002560.283124:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5195 00000100:00100000:2.0:1786002560.283135:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+488:19369:x1872758530972160:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:2.0:1786002560.283383:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983925 00000100:00100000:2.0:1786002560.283479:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+490:19369:x1872758530972160:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 345us (575us total) trans 4294983926 rc 0/0 00000100:00100000:2.0:1786002560.283487:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5195 00000020:00080000:2.0:1786002560.283492:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.295402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002560.298942:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530972416 00000100:00100000:0.0:1786002560.298954:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530972416 00000100:00100000:0.0:1786002560.299033:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24037 00000100:00100000:0.0:1786002560.299043:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+490:19369:x1872758530972416:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002560.299066:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002560.299087:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578415f9e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af67 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299212:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415fa5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299227:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299238:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299257:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578415fac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299264:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578415fac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299271:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578415fac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002560.299573:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f5:0x0], index 1: 0 00010000:00010000:0.0:1786002560.299716:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578415fb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1597:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299725:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578415fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1597:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299732:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578415fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1597:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002560.299779:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983927 00010000:00010000:0.0:1786002560.299807:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415fa5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299815:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415fa5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299821:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415fa5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299827:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415fa5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299884:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002560.299889:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415fa5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299897:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415fa5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299909:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002560.299912:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002560.299917:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415fa5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299924:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4400/0x7cee4af578415fa5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002560.299936:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005922f056 reply state 0000000006faec28 transno 4294983928 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578415fac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299947:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578415fac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299954:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb4d1abd0 (ffff9ed351207800) 00010000:00010000:0.0:1786002560.299956:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002560.299958:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002560.299984:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578415f9e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af67 expref: 494 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.299998:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578415fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1597:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af67 expref: 493 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.300011:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1597:0x0].0x0 (ffff9ed2456ef600) 00010000:00010000:0.0:1786002560.300013:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002560.300015:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46c00, rc 0) 00000100:00100000:0.0:1786002560.300079:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+494:19369:x1872758530972416:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1036us (4683us total) trans 4294983928 rc 0/0 00000100:00100000:0.0:1786002560.300086:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24037 00000020:00080000:0.0:1786002560.300091:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.306007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.306223:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530972672 00000100:00100000:1.0:1786002560.306245:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530972672 00000100:00100000:1.0:1786002560.306335:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5196 00000100:00100000:1.0:1786002560.306358:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+494:19369:x1872758530972672:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002560.306771:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983929 00000100:00100000:1.0:1786002560.306885:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+496:19369:x1872758530972672:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 528us (885us total) trans 4294983930 rc 0/0 00000100:00100000:1.0:1786002560.306893:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5196 00000020:00080000:1.0:1786002560.306898:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.319487:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002560.319595:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530972928 00000100:00100000:2.0:1786002560.319604:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530972928 00000100:00100000:2.0:1786002560.319667:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24038 00000100:00100000:2.0:1786002560.319677:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+496:19369:x1872758530972928:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002560.319699:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002560.319718:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578415fc1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af6e expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.319830:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415fc8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.319886:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415fc8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.319898:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415fc8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.319913:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415fcf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.319920:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415fcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.319927:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415fcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002560.320206:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f6:0x0], index 0: 0 00010000:00010000:2.0:1786002560.320344:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415fd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1598:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320353:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1598:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320359:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1598:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002560.320411:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983931 00010000:00010000:2.0:1786002560.320444:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415fc8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320452:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415fc8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320458:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415fc8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320464:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415fc8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320469:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002560.320474:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415fc8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320481:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415fc8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320493:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002560.320506:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002560.320511:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415fc8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320518:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578415fc8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002560.320531:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db9ed367 reply state 000000004fece396 transno 4294983932 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415fcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320541:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415fcf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320546:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7db3ad0 (ffff9ed2434dfa00) 00010000:00010000:2.0:1786002560.320549:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002560.320551:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002560.320579:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578415fc1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af6e expref: 500 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320592:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1598:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af6e expref: 499 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.320600:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1598:0x0].0x0 (ffff9ed2434dfb00) 00010000:00010000:2.0:1786002560.320602:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002560.320604:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998c00, rc 0) 00000100:00100000:2.0:1786002560.320664:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+500:19369:x1872758530972928:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 989us (1185us total) trans 4294983932 rc 0/0 00000100:00100000:2.0:1786002560.320671:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24038 00000020:00080000:2.0:1786002560.320676:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.338279:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.338548:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530973184 00000100:00100000:1.0:1786002560.338558:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530973184 00000100:00100000:1.0:1786002560.338619:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5197 00000100:00100000:1.0:1786002560.338630:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+500:19369:x1872758530973184:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002560.338920:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983933 00000100:00100000:1.0:1786002560.339017:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+502:19369:x1872758530973184:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 388us (744us total) trans 4294983934 rc 0/0 00000100:00100000:1.0:1786002560.339026:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5197 00000020:00080000:1.0:1786002560.339030:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.361782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002560.362100:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002560.362119:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24322fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561008896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002560.362168:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002560.362225:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561008896 00000100:00100000:2.0:1786002560.362231:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561008896 00000100:00100000:2.0:1786002560.362276:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1786002560.362285:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561008896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002560.362306:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1786002560.362345:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561008896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002560.362352:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00080000:2.0:1786002560.362372:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002560.362400:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24322fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561008896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002560.362594:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786002560.362604:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561009024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002560.362634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002560.362704:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561009024 00000100:00100000:3.0:1786002560.362708:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561009024 00000100:00100000:3.0:1786002560.362741:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1786002560.362749:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1872758561009024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786002560.362759:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1786002560.362790:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1872758561009024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002560.362796:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1786002560.362895:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561009024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002560.363098:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561009280:0@lo:400:kworker.0 00000100:00100000:3.0:1786002560.363125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002560.363141:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561009792:0@lo:400:kworker.0 00000100:00100000:3.0:1786002560.363161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002560.363180:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561010304:0@lo:400:kworker.0 00000100:00100000:3.0:1786002560.363195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002560.363212:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1786002560.363215:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561009152:0@lo:400:kworker.0 00000100:00100000:3.0:1786002560.363236:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002560.363254:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561009664:0@lo:400:kworker.0 00000100:00100000:3.0:1786002560.363273:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002560.363285:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561010176:0@lo:400:kworker.0 00000100:00100000:3.0:1786002560.363324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002560.363347:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561009152 00000100:00100000:3.0:1786002560.363351:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561009152 00000100:00100000:3.0:1786002560.363373:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1786002560.363379:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561009152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002560.363406:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561009152:12345-0@lo:400:kworker.0 Request processed in 27us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002560.363411:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1786002560.363433:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561009664 00000100:00100000:3.0:1786002560.363436:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561009664 00000100:00100000:3.0:1786002560.363454:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047 00000100:00100000:3.0:1786002560.363458:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561009664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002560.363484:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561009664:12345-0@lo:400:kworker.0 Request processed in 26us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002560.363490:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047 00000100:00100000:3.0:1786002560.363521:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561009152:0@lo:400:kworker.0 00000100:00100000:3.0:1786002560.363530:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561009664:0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.363638:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561009408:0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.363664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002560.363689:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561009920:0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.363707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002560.363717:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786002560.363722:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758561009536:0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.363738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002560.363746:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561010048:0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.363764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002560.363786:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530973440 00000100:00100000:0.0:1786002560.363790:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530973440 00000100:00100000:0.0:1786002560.363810:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561009280 00000100:00100000:0.0:1786002560.363813:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561009280 00000100:00100000:0.0:1786002560.363824:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561009792 00000100:00100000:0.0:1786002560.363826:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561009792 00000100:00080000:0.0:1786002560.363866:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002560.363879:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561010304 00000100:00100000:0.0:1786002560.363882:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561010304 00000100:00080000:0.0:1786002560.363893:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002560.363905:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561010176 00000100:00100000:0.0:1786002560.363908:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561010176 00000100:00080000:0.0:1786002560.363917:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002560.363930:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561009920 00000100:00100000:0.0:1786002560.363933:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561009920 00000100:00080000:0.0:1786002560.363944:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002560.363955:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561009536 00000100:00100000:0.0:1786002560.363958:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561009536 00000100:00100000:0.0:1786002560.363970:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:0.0:1786002560.363976:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561009280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.364012:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561009280:12345-0@lo:400:kworker.0 Request processed in 36us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002560.364030:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:0.0:1786002560.364055:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561009280:0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.364072:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:0.0:1786002560.364079:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561009792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.364111:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561009792:12345-0@lo:400:kworker.0 Request processed in 33us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002560.364117:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:0.0:1786002560.364139:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561009792:0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.364155:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:0.0:1786002560.364162:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561010304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.364194:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561010304:12345-0@lo:400:kworker.0 Request processed in 33us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002560.364200:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:0.0:1786002560.364220:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561010304:0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.364235:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:0.0:1786002560.364241:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561010176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.364270:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561010176:12345-0@lo:400:kworker.0 Request processed in 30us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002560.364275:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:0.0:1786002560.364297:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561010176:0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.364312:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1786002560.364319:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561009920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.364349:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561009920:12345-0@lo:400:kworker.0 Request processed in 31us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002560.364355:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1786002560.364377:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561009920:0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.364391:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:0.0:1786002560.364397:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758561009536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.364423:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758561009536:12345-0@lo:400:kworker.0 Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002560.364429:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:0.0:1786002560.364446:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758561009536:0@lo:400:kworker.0 00000100:00100000:0.0:1786002560.364462:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24039 00000100:00100000:0.0:1786002560.364469:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+502:19369:x1872758530973440:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002560.364482:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002560.364510:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578415fe4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af75 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.364606:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578415feb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.364622:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578415feb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.364633:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578415feb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.364647:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578415ff2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.364654:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578415ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.364661:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578415ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002560.364956:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f6:0x0], index 1: 0 00010000:00010000:0.0:1786002560.365115:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578415ff9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1599:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365124:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578415ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1599:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365131:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578415ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1599:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002560.365201:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983935 00010000:00010000:0.0:1786002560.365236:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578415feb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365243:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578415feb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365248:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578415feb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365254:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578415feb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365260:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002560.365264:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578415feb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365271:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578415feb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365282:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002560.365285:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002560.365289:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578415feb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365296:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578415feb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002560.365308:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cee722d4 reply state 000000009428bd31 transno 4294983936 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578415ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365322:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578415ff2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365328:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x798865d0 (ffff9ed2456ef700) 00010000:00010000:0.0:1786002560.365330:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002560.365333:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002560.365360:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578415fe4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af75 expref: 506 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365373:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578415ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1599:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af75 expref: 505 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.365380:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1599:0x0].0x0 (ffff9ed2456ef500) 00010000:00010000:0.0:1786002560.365382:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002560.365384:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47200, rc 0) 00000100:00100000:0.0:1786002560.365424:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+506:19369:x1872758530973440:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 954us (3649us total) trans 4294983936 rc 0/0 00000100:00100000:0.0:1786002560.365430:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24039 00000020:00080000:0.0:1786002560.365435:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.366971:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561009408 00000100:00100000:2.0:1786002560.366980:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561009408 00000100:00100000:2.0:1786002560.367035:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048 00000100:00100000:2.0:1786002560.367044:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561009408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002560.367117:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561009408:12345-0@lo:400:kworker.0 Request processed in 75us (3452us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002560.367124:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048 00000100:00100000:1.0:1786002560.367261:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561009408:0@lo:400:kworker.0 00000100:00100000:3.0:1786002560.367547:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561010048 00000100:00100000:3.0:1786002560.367552:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561010048 00000100:00100000:3.0:1786002560.367604:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1786002560.367612:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561010048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002560.367652:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561010048:12345-0@lo:400:kworker.0 Request processed in 40us (3886us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002560.367658:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00080000:1.0:1786002560.367802:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002560.367824:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561010048:0@lo:400:kworker.0 00000100:00100000:2.0:1786002560.393616:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.393787:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530973696 00000100:00100000:3.0:1786002560.393797:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530973696 00000100:00100000:3.0:1786002560.393896:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5198 00000100:00100000:3.0:1786002560.393907:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+506:19369:x1872758530973696:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002560.394241:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983937 00000100:00100000:3.0:1786002560.394323:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+508:19369:x1872758530973696:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 418us (717us total) trans 4294983938 rc 0/0 00000100:00100000:3.0:1786002560.394330:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5198 00000020:00080000:3.0:1786002560.394335:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.408428:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002560.408534:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530973952 00000100:00100000:0.0:1786002560.408544:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530973952 00000100:00100000:0.0:1786002560.408612:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24040 00000100:00100000:0.0:1786002560.408623:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+508:19369:x1872758530973952:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002560.408646:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002560.408666:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416007 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af7c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.408770:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841600e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.408784:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841600e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.408794:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841600e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.408806:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416015 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.408813:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416015 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.408819:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416015 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002560.409399:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f7:0x0], index 0: 0 00010000:00010000:1.0:1786002560.409551:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841601c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409561:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841601c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409569:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841601c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002560.409624:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983939 00010000:00010000:1.0:1786002560.409657:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841600e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409665:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841600e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409672:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841600e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409679:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841600e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409686:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002560.409690:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841600e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409698:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841600e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409710:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002560.409713:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002560.409718:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841600e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409724:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af57841600e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002560.409737:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070556601 reply state 000000005c9535cb transno 4294983940 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416015 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409747:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416015 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409753:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa0729cd0 (ffff9ed2456ef300) 00010000:00010000:1.0:1786002560.409756:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002560.409758:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002560.409785:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416007 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af7c expref: 512 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409798:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841601c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af7c expref: 511 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.409812:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff9ed366c05300) 00010000:00010000:1.0:1786002560.409814:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002560.409817:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a200, rc 0) 00000100:00100000:1.0:1786002560.409928:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+512:19369:x1872758530973952:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1306us (1508us total) trans 4294983940 rc 0/0 00000100:00100000:1.0:1786002560.409935:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24040 00000020:00080000:1.0:1786002560.409940:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.413559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.413648:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530974208 00000100:00100000:1.0:1786002560.413656:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530974208 00000100:00100000:1.0:1786002560.413706:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5199 00000100:00100000:1.0:1786002560.413715:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+512:19369:x1872758530974208:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002560.413952:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983941 00000100:00100000:1.0:1786002560.414053:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+514:19369:x1872758530974208:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 337us (502us total) trans 4294983942 rc 0/0 00000100:00100000:1.0:1786002560.414061:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5199 00000020:00080000:1.0:1786002560.414065:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.429981:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.430102:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530974464 00000100:00100000:1.0:1786002560.430110:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530974464 00000100:00100000:1.0:1786002560.430164:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24041 00000100:00100000:1.0:1786002560.430173:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+514:19369:x1872758530974464:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002560.430196:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002560.430226:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af57841602a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af83 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.430325:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578416031 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.430339:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578416031 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.430349:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578416031 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.430363:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af578416038 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.430370:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af578416038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.430376:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af578416038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002560.430718:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f7:0x0], index 1: 0 00010000:00010000:1.0:1786002560.431072:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af57841603f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431082:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af57841603f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431089:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af57841603f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002560.431143:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983943 00010000:00010000:1.0:1786002560.431174:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578416031 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431180:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578416031 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431189:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578416031 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431195:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578416031 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431200:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455dbc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002560.431203:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578416031 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431209:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578416031 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431219:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002560.431221:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002560.431225:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578416031 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431229:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbc00/0x7cee4af578416031 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002560.431241:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f82e9a95 reply state 00000000cef93268 transno 4294983944 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af578416038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431249:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af578416038 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431255:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe37fc7d0 (ffff9ed366c05d00) 00010000:00010000:1.0:1786002560.431257:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002560.431259:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002560.431281:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228800/0x7cee4af57841602a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af83 expref: 518 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431293:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af57841603f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af83 expref: 517 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.431299:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159b:0x0].0x0 (ffff9ed366c05b00) 00010000:00010000:1.0:1786002560.431301:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002560.431303:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245771a00, rc 0) 00000100:00100000:1.0:1786002560.431357:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+518:19369:x1872758530974464:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1184us (1384us total) trans 4294983944 rc 0/0 00000100:00100000:1.0:1786002560.431364:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24041 00000020:00080000:1.0:1786002560.431369:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.452951:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.453606:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530974720 00000100:00100000:1.0:1786002560.453616:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530974720 00000100:00100000:1.0:1786002560.453674:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5200 00000100:00100000:1.0:1786002560.453685:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+518:19369:x1872758530974720:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002560.453956:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983945 00000100:00100000:1.0:1786002560.454157:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+520:19369:x1872758530974720:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 472us (1211us total) trans 4294983946 rc 0/0 00000100:00100000:1.0:1786002560.454166:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5200 00000020:00080000:1.0:1786002560.454170:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.460553:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002560.460651:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530974976 00000100:00100000:2.0:1786002560.460659:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530974976 00000100:00100000:2.0:1786002560.460721:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24042 00000100:00100000:2.0:1786002560.460731:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+520:19369:x1872758530974976:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002560.460751:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002560.460769:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af57841604d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af8a expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.460904:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416054 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.460917:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416054 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.460928:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416054 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.460941:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af57841605b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.460947:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af57841605b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.460953:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af57841605b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002560.461245:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f8:0x0], index 0: 0 00010000:00010000:2.0:1786002560.461393:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416062 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461401:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461408:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002560.461453:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983947 00010000:00010000:2.0:1786002560.461483:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416054 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461491:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416054 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461507:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416054 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461515:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416054 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461521:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002560.461525:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416054 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461532:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416054 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461545:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002560.461548:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002560.461552:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416054 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461559:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416054 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002560.461573:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034ea738d reply state 000000005948c241 transno 4294983948 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af57841605b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461583:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af57841605b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461591:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x507ed6d0 (ffff9ed2434df500) 00010000:00010000:2.0:1786002560.461593:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002560.461595:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002560.461618:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af57841604d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af8a expref: 524 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461630:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af8a expref: 523 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.461636:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff9ed2434df000) 00010000:00010000:2.0:1786002560.461638:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002560.461640:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999000, rc 0) 00000100:00100000:2.0:1786002560.461699:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+524:19369:x1872758530974976:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 970us (1154us total) trans 4294983948 rc 0/0 00000100:00100000:2.0:1786002560.461706:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24042 00000020:00080000:2.0:1786002560.461710:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.470443:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.470521:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530975232 00000100:00100000:3.0:1786002560.470532:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530975232 00000100:00100000:3.0:1786002560.470594:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5201 00000100:00100000:3.0:1786002560.470604:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+524:19369:x1872758530975232:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002560.470899:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983949 00000100:00100000:3.0:1786002560.470993:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+526:19369:x1872758530975232:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 390us (558us total) trans 4294983950 rc 0/0 00000100:00100000:3.0:1786002560.471001:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5201 00000020:00080000:3.0:1786002560.471006:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.486394:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002560.495079:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530975488 00000100:00100000:2.0:1786002560.495093:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530975488 00000100:00100000:3.0:1786002560.501382:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24043 00000100:00100000:3.0:1786002560.501395:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+526:19369:x1872758530975488:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002560.501419:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002560.501440:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578416070 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af91 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.501556:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416077 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.501570:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416077 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.501582:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416077 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.501596:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841607e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.501605:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841607e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.501612:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841607e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002560.505220:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f8:0x0], index 1: 0 00010000:00010000:3.0:1786002560.505409:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620000/0x7cee4af578416085 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505425:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620000/0x7cee4af578416085 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505437:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620000/0x7cee4af578416085 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002560.505516:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983951 00010000:00010000:3.0:1786002560.505554:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416077 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505563:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416077 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505569:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416077 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505576:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416077 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505582:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002560.505586:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416077 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505594:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416077 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505605:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002560.505608:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002560.505613:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416077 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505619:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416077 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002560.505635:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1a580c9 reply state 00000000688103f1 transno 4294983952 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841607e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505652:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841607e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505658:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xea2c01d0 (ffff9ed24556ec00) 00010000:00010000:3.0:1786002560.505661:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002560.505664:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002560.505697:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b000/0x7cee4af578416070 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af91 expref: 530 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505711:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620000/0x7cee4af578416085 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af91 expref: 529 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.505719:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159d:0x0].0x0 (ffff9ed24556e700) 00010000:00010000:3.0:1786002560.505721:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002560.505723:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245620000, rc 0) 00000100:00100000:3.0:1786002560.505795:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+530:19369:x1872758530975488:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 4401us (19407us total) trans 4294983952 rc 0/0 00000100:00100000:3.0:1786002560.505805:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24043 00000020:00080000:3.0:1786002560.505811:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002560.517943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.518064:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530975744 00000100:00100000:1.0:1786002560.518074:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530975744 00000100:00100000:1.0:1786002560.518130:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5202 00000100:00100000:1.0:1786002560.518139:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+530:19369:x1872758530975744:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002560.518376:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983953 00000100:00100000:1.0:1786002560.518478:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+532:19369:x1872758530975744:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 339us (543us total) trans 4294983954 rc 0/0 00000100:00100000:1.0:1786002560.518486:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5202 00000020:00080000:1.0:1786002560.518490:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.535601:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.535924:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530976000 00000100:00100000:1.0:1786002560.535932:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530976000 00000100:00100000:1.0:1786002560.535990:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24044 00000100:00100000:1.0:1786002560.536000:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+532:19369:x1872758530976000:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002560.536031:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002560.536051:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af578416093 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.536149:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841609a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.536162:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841609a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.536172:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841609a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.536184:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784160a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.536190:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784160a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.536195:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784160a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002560.536517:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f9:0x0], index 0: 0 00010000:00010000:1.0:1786002560.536690:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771c00/0x7cee4af5784160a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.536699:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771c00/0x7cee4af5784160a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.536707:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771c00/0x7cee4af5784160a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002560.536778:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983955 00010000:00010000:1.0:1786002560.536811:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841609a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.536819:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841609a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.536826:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841609a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.536832:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841609a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.538626:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002560.538631:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841609a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.538641:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841609a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.538655:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002560.538659:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002560.538663:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841609a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.538676:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841609a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002560.538693:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3250245 reply state 000000001f170a5c transno 4294983956 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784160a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.538704:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784160a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.538710:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe91638d0 (ffff9ed366c05800) 00010000:00010000:1.0:1786002560.538712:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002560.538716:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002560.538755:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af578416093 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af98 expref: 536 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.538768:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771c00/0x7cee4af5784160a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af98 expref: 535 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.538775:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159e:0x0].0x0 (ffff9ed366c05a00) 00010000:00010000:1.0:1786002560.538777:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002560.538779:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245771c00, rc 0) 00000100:00100000:1.0:1786002560.538967:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+536:19369:x1872758530976000:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2967us (3374us total) trans 4294983956 rc 0/0 00000100:00100000:1.0:1786002560.538975:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24044 00000020:00080000:1.0:1786002560.538981:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.568393:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.568480:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530976256 00000100:00100000:1.0:1786002560.568489:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530976256 00000100:00100000:1.0:1786002560.568553:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5203 00000100:00100000:1.0:1786002560.568565:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+536:19369:x1872758530976256:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002560.568800:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983957 00000100:00100000:1.0:1786002560.568921:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+538:19369:x1872758530976256:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 358us (536us total) trans 4294983958 rc 0/0 00000100:00100000:1.0:1786002560.568929:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5203 00000020:00080000:1.0:1786002560.568933:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002560.595100:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.595165:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530976512 00000100:00100000:1.0:1786002560.595204:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530976512 00000100:00100000:1.0:1786002560.595271:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24045 00000100:00100000:1.0:1786002560.595280:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+538:19369:x1872758530976512:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002560.595303:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002560.595338:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784160b6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3af9f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.595558:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784160bd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.595581:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784160bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.595592:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784160bd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.595617:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784160c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.595624:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784160c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.595631:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784160c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002560.595985:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f9:0x0], index 1: 0 00010000:00010000:1.0:1786002560.596130:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770800/0x7cee4af5784160cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x159f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596140:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770800/0x7cee4af5784160cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596148:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770800/0x7cee4af5784160cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x159f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002560.596195:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983959 00010000:00010000:1.0:1786002560.596224:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784160bd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596232:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784160bd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596239:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784160bd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596246:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784160bd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596252:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002560.596256:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784160bd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596263:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784160bd lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596275:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002560.596278:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002560.596282:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784160bd lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596289:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784160bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002560.596301:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3f2c2c9 reply state 00000000a6a76179 transno 4294983960 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784160c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596310:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784160c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596316:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xfe3473d0 (ffff9ed366c05f00) 00010000:00010000:1.0:1786002560.596318:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002560.596320:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002560.596346:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784160b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af9f expref: 542 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596360:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770800/0x7cee4af5784160cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x159f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af9f expref: 541 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.596367:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159f:0x0].0x0 (ffff9ed366c05700) 00010000:00010000:1.0:1786002560.596370:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002560.596372:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245770800, rc 0) 00000100:00100000:1.0:1786002560.596433:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+542:19369:x1872758530976512:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1153us (1340us total) trans 4294983960 rc 0/0 00000100:00100000:1.0:1786002560.596441:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24045 00000020:00080000:1.0:1786002560.596446:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.607124:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.607211:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530976768 00000100:00100000:3.0:1786002560.607221:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530976768 00000100:00100000:3.0:1786002560.607276:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5204 00000100:00100000:3.0:1786002560.607286:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+542:19369:x1872758530976768:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002560.607564:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983961 00000100:00100000:3.0:1786002560.607662:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+544:19369:x1872758530976768:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 377us (547us total) trans 4294983962 rc 0/0 00000100:00100000:3.0:1786002560.607674:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5204 00000020:00080000:3.0:1786002560.607679:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.617284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.617955:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530977024 00000100:00100000:3.0:1786002560.617965:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530977024 00000100:00100000:3.0:1786002560.618020:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24046 00000100:00100000:3.0:1786002560.618092:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+544:19369:x1872758530977024:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002560.618116:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002560.618136:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784160d9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3afa6 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618261:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784160e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618276:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784160e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618289:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784160e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618303:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784160e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618310:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784160e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618316:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784160e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002560.618629:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fa:0x0], index 0: 0 00010000:00010000:3.0:1786002560.618779:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621400/0x7cee4af5784160ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618790:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621400/0x7cee4af5784160ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618798:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621400/0x7cee4af5784160ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002560.618886:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983963 00010000:00010000:3.0:1786002560.618923:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784160e0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618931:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784160e0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618938:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784160e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618945:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784160e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618952:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002560.618955:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784160e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618962:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784160e0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618973:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002560.618975:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002560.618980:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784160e0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.618991:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784160e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002560.619004:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ac6710e reply state 0000000070c49691 transno 4294983964 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784160e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.619014:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784160e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.619020:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x133382d0 (ffff9ed24556e200) 00010000:00010000:3.0:1786002560.619022:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002560.619025:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002560.619052:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784160d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afa6 expref: 548 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.619066:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621400/0x7cee4af5784160ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afa6 expref: 547 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.619074:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a0:0x0].0x0 (ffff9ed24556eb00) 00010000:00010000:3.0:1786002560.619076:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002560.619078:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245621400, rc 0) 00000100:00100000:3.0:1786002560.619137:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+548:19369:x1872758530977024:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1049us (1868us total) trans 4294983964 rc 0/0 00000100:00100000:3.0:1786002560.619145:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24046 00000020:00080000:3.0:1786002560.619149:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002560.630928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.631005:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530977280 00000100:00100000:1.0:1786002560.631015:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530977280 00000100:00100000:1.0:1786002560.631072:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5205 00000100:00100000:1.0:1786002560.631082:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+548:19369:x1872758530977280:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002560.631321:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983965 00000100:00100000:1.0:1786002560.631416:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+550:19369:x1872758530977280:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 334us (497us total) trans 4294983966 rc 0/0 00000100:00100000:1.0:1786002560.631424:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5205 00000020:00080000:1.0:1786002560.631429:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002560.639980:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.641172:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530977536 00000100:00100000:1.0:1786002560.641182:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530977536 00000100:00100000:1.0:1786002560.641243:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24047 00000100:00100000:1.0:1786002560.641252:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+550:19369:x1872758530977536:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002560.641273:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002560.641290:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784160fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3afad expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.641388:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416103 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.641402:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416103 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.641412:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416103 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.641425:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af57841610a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.641432:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af57841610a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.641438:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af57841610a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002560.641727:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fa:0x0], index 1: 0 00010000:00010000:1.0:1786002560.641904:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771400/0x7cee4af578416111 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.641914:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771400/0x7cee4af578416111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.641921:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771400/0x7cee4af578416111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002560.641971:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983967 00010000:00010000:1.0:1786002560.642004:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416103 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.642011:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416103 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.642111:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416103 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.642119:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416103 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.642126:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002560.642130:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416103 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.642137:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416103 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.642149:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002560.642153:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002560.642156:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416103 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.642163:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416103 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002560.642177:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2574e02 reply state 0000000045f24296 transno 4294983968 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af57841610a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.642187:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af57841610a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.642193:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xeedd9295 (ffff9ed366c05600) 00010000:00010000:1.0:1786002560.642196:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002560.642198:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002560.642221:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784160fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afad expref: 554 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.642234:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771400/0x7cee4af578416111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afad expref: 553 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.642241:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a1:0x0].0x0 (ffff9ed366c05e00) 00010000:00010000:1.0:1786002560.642244:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002560.642246:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245771400, rc 0) 00000100:00100000:1.0:1786002560.642305:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+554:19369:x1872758530977536:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1054us (2333us total) trans 4294983968 rc 0/0 00000100:00100000:1.0:1786002560.642312:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24047 00000020:00080000:1.0:1786002560.642317:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002560.651235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.653889:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530977792 00000100:00100000:1.0:1786002560.653903:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530977792 00000100:00100000:1.0:1786002560.653969:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5206 00000100:00100000:1.0:1786002560.653980:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+554:19369:x1872758530977792:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002560.654228:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983969 00000100:00100000:1.0:1786002560.654598:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+556:19369:x1872758530977792:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 618us (3368us total) trans 4294983970 rc 0/0 00000100:00100000:1.0:1786002560.654607:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5206 00000020:00080000:1.0:1786002560.654612:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.666234:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.666357:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530978048 00000100:00100000:1.0:1786002560.666368:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530978048 00000100:00100000:1.0:1786002560.666432:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24048 00000100:00100000:1.0:1786002560.666443:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+556:19369:x1872758530978048:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002560.666483:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002560.666511:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af57841611f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3afb4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.666611:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416126 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.666626:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416126 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.666636:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416126 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.666651:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841612d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.666664:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841612d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.666671:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841612d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002560.668128:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fb:0x0], index 0: 0 00010000:00010000:1.0:1786002560.668283:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771800/0x7cee4af578416134 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668295:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771800/0x7cee4af578416134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668304:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771800/0x7cee4af578416134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002560.668364:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983971 00010000:00010000:1.0:1786002560.668398:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416126 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668406:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416126 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668412:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416126 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668418:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416126 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668423:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002560.668427:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416126 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668435:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416126 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668446:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002560.668449:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002560.668453:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416126 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668458:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416126 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002560.668472:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040c48fa9 reply state 00000000e22a0452 transno 4294983972 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841612d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668482:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841612d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668488:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6be72195 (ffff9ed366c05900) 00010000:00010000:1.0:1786002560.668491:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002560.668493:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002560.668535:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af57841611f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afb4 expref: 560 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668551:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771800/0x7cee4af578416134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afb4 expref: 559 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.668558:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a2:0x0].0x0 (ffff9ed366c05000) 00010000:00010000:1.0:1786002560.668561:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002560.668563:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245771800, rc 0) 00000100:00100000:1.0:1786002560.668617:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+560:19369:x1872758530978048:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2176us (2393us total) trans 4294983972 rc 0/0 00000100:00100000:1.0:1786002560.668626:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24048 00000020:00080000:1.0:1786002560.668631:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002560.680678:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.680790:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530978304 00000100:00100000:3.0:1786002560.680800:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530978304 00000100:00100000:3.0:1786002560.680874:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5207 00000100:00100000:3.0:1786002560.680883:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+560:19369:x1872758530978304:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002560.681125:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983973 00000100:00100000:3.0:1786002560.681211:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+562:19369:x1872758530978304:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 328us (542us total) trans 4294983974 rc 0/0 00000100:00100000:3.0:1786002560.681218:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5207 00000020:00080000:3.0:1786002560.681223:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002560.703505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002560.703557:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530978560 00000100:00100000:2.0:1786002560.703567:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530978560 00000100:00100000:2.0:1786002560.703633:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24049 00000100:00100000:2.0:1786002560.703643:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+562:19369:x1872758530978560:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002560.703668:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002560.703691:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416142 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3afbb expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.703789:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416149 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.703804:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416149 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.703815:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416149 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.703827:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416150 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.703873:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416150 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.703882:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416150 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002560.705236:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fb:0x0], index 1: 0 00010000:00010000:0.0:1786002560.706151:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af578416157 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706166:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af578416157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706177:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af578416157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002560.706235:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983975 00010000:00010000:0.0:1786002560.706266:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416149 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706275:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416149 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706282:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416149 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706289:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416149 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706295:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002560.706533:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416149 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706543:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416149 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706555:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002560.706558:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002560.706562:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416149 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706569:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416149 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002560.706589:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c221f61 reply state 0000000061b47eff transno 4294983976 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416150 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706599:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416150 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706606:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6d724c95 (ffff9ed2434df200) 00010000:00010000:0.0:1786002560.706609:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002560.706612:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002560.706646:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416142 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afbb expref: 566 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706659:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af578416157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afbb expref: 565 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.706666:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a3:0x0].0x0 (ffff9ed2456ef900) 00010000:00010000:0.0:1786002560.706669:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002560.706671:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46a00, rc 0) 00000100:00100000:0.0:1786002560.706743:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+566:19369:x1872758530978560:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 3101us (3254us total) trans 4294983976 rc 0/0 00000100:00100000:0.0:1786002560.706752:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24049 00000020:00080000:0.0:1786002560.706757:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002560.717633:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002560.717719:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530978816 00000100:00100000:0.0:1786002560.717728:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530978816 00000100:00100000:0.0:1786002560.717782:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5208 00000100:00100000:0.0:1786002560.717791:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+566:19369:x1872758530978816:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002560.718077:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983977 00000100:00100000:0.0:1786002560.718169:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+568:19369:x1872758530978816:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 378us (545us total) trans 4294983978 rc 0/0 00000100:00100000:0.0:1786002560.718178:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5208 00000020:00080000:0.0:1786002560.718183:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.740129:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002560.740215:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530979072 00000100:00100000:0.0:1786002560.740225:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530979072 00000100:00100000:0.0:1786002560.740284:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24050 00000100:00100000:0.0:1786002560.740294:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+568:19369:x1872758530979072:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002560.740328:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002560.740348:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416165 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3afc2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.740447:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841616c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.740461:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841616c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.740472:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841616c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.740504:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416173 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.740512:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.740519:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002560.740798:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fc:0x0], index 0: 0 00010000:00010000:0.0:1786002560.741113:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af57841617a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741123:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af57841617a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741131:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af57841617a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002560.741186:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983979 00010000:00010000:0.0:1786002560.741217:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841616c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741225:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841616c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741232:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841616c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741239:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841616c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741245:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002560.741249:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841616c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741257:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841616c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741269:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002560.741272:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002560.741276:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841616c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741288:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841616c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002560.741585:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5683a2e reply state 00000000f6bd9d6e transno 4294983980 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741598:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416173 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741605:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6a5c8395 (ffff9ed2456ef800) 00010000:00010000:0.0:1786002560.741608:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002560.741611:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002560.741638:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416165 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afc2 expref: 572 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741653:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af57841617a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afc2 expref: 571 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.741661:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a4:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:0.0:1786002560.741663:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002560.741666:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c46400, rc 0) 00000100:00100000:0.0:1786002560.741776:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+572:19369:x1872758530979072:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1482us (1655us total) trans 4294983980 rc 0/0 00000100:00100000:0.0:1786002560.741783:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24050 00000020:00080000:0.0:1786002560.741788:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.765591:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002560.766393:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530979328 00000100:00100000:0.0:1786002560.766403:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530979328 00000100:00100000:0.0:1786002560.766471:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5209 00000100:00100000:0.0:1786002560.766490:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+572:19369:x1872758530979328:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:0.0:1786002560.766753:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983981 00000100:00100000:0.0:1786002560.766884:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+574:19369:x1872758530979328:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 360us (1265us total) trans 4294983982 rc 0/0 00000100:00100000:0.0:1786002560.766892:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5209 00000020:00080000:0.0:1786002560.766901:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002560.777784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.777867:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530979584 00000100:00100000:3.0:1786002560.777877:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530979584 00000100:00100000:3.0:1786002560.777937:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24051 00000100:00100000:3.0:1786002560.777947:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+574:19369:x1872758530979584:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002560.777978:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002560.777999:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416188 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3afc9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778099:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841618f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778114:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841618f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778125:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841618f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778138:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af578416196 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778145:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af578416196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778158:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af578416196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002560.778440:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fc:0x0], index 1: 0 00010000:00010000:3.0:1786002560.778611:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620c00/0x7cee4af57841619d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778621:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620c00/0x7cee4af57841619d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778628:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620c00/0x7cee4af57841619d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002560.778682:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983983 00010000:00010000:3.0:1786002560.778720:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841618f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778728:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841618f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778734:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841618f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778741:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841618f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778747:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002560.778751:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841618f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778758:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841618f lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778770:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002560.778773:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002560.778778:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841618f lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778785:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841618f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002560.778799:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d44b30f5 reply state 00000000e2731580 transno 4294983984 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af578416196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778809:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af578416196 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778816:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x609ae95 (ffff9ed24206ac00) 00010000:00010000:3.0:1786002560.778819:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002560.778821:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002560.778893:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416188 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afc9 expref: 578 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778910:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620c00/0x7cee4af57841619d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afc9 expref: 577 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.778917:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a5:0x0].0x0 (ffff9ed24206ad00) 00010000:00010000:3.0:1786002560.778919:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002560.778922:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245620c00, rc 0) 00000100:00100000:3.0:1786002560.778983:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+578:19369:x1872758530979584:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1036us (1206us total) trans 4294983984 rc 0/0 00000100:00100000:3.0:1786002560.778990:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24051 00000020:00080000:3.0:1786002560.778996:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.791657:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.791941:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530979840 00000100:00100000:3.0:1786002560.791951:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530979840 00000100:00100000:3.0:1786002560.792008:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5210 00000100:00100000:3.0:1786002560.792018:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+578:19369:x1872758530979840:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002560.792250:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983985 00000100:00100000:3.0:1786002560.792434:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+580:19369:x1872758530979840:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 416us (784us total) trans 4294983986 rc 0/0 00000100:00100000:3.0:1786002560.792443:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5210 00000020:00080000:3.0:1786002560.792448:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.830695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002560.830790:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530980096 00000100:00100000:0.0:1786002560.830800:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530980096 00000100:00100000:0.0:1786002560.830893:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24052 00000100:00100000:0.0:1786002560.830904:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+580:19369:x1872758530980096:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002560.830929:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002560.830949:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784161ab lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3afd0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831057:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831072:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831084:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831098:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784161b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831105:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784161b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831112:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784161b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002560.831489:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fd:0x0], index 0: 0 00010000:00010000:0.0:1786002560.831655:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47800/0x7cee4af5784161c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831665:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47800/0x7cee4af5784161c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831673:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47800/0x7cee4af5784161c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002560.831729:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983987 00010000:00010000:0.0:1786002560.831765:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161b2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831774:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161b2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831780:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831787:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831793:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002560.831797:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831804:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161b2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831817:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002560.831821:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002560.831825:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161b2 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831833:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002560.831879:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cf7a93e reply state 0000000043009fa2 transno 4294983988 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784161b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831891:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784161b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831897:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x9d08bd95 (ffff9ed2456ef100) 00010000:00010000:0.0:1786002560.831899:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002560.831902:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002560.831926:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784161ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afd0 expref: 584 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831940:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47800/0x7cee4af5784161c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afd0 expref: 583 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.831948:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a6:0x0].0x0 (ffff9ed2456ef200) 00010000:00010000:0.0:1786002560.831950:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002560.831952:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47800, rc 0) 00000100:00100000:0.0:1786002560.832016:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+584:19369:x1872758530980096:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1113us (1329us total) trans 4294983988 rc 0/0 00000100:00100000:0.0:1786002560.832023:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24052 00000020:00080000:0.0:1786002560.832027:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.844231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.844316:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530980352 00000100:00100000:3.0:1786002560.844325:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530980352 00000100:00100000:3.0:1786002560.844377:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5211 00000100:00100000:3.0:1786002560.844387:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+584:19369:x1872758530980352:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002560.844646:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983989 00000100:00100000:3.0:1786002560.844739:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+586:19369:x1872758530980352:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 352us (515us total) trans 4294983990 rc 0/0 00000100:00100000:3.0:1786002560.844747:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5211 00000020:00080000:3.0:1786002560.844752:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002560.852787:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002560.852941:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530980608 00000100:00100000:0.0:1786002560.852951:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530980608 00000100:00100000:0.0:1786002560.853023:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24053 00000100:00100000:0.0:1786002560.853034:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+586:19369:x1872758530980608:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002560.853056:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002560.853076:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3afd7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853171:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af5784161d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853185:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af5784161d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853197:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af5784161d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853210:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784161dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853217:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784161dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853224:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784161dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002560.853520:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fd:0x0], index 1: 0 00010000:00010000:0.0:1786002560.853657:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af5784161e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853666:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af5784161e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853677:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af5784161e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002560.853724:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983991 00010000:00010000:0.0:1786002560.853755:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af5784161d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853763:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af5784161d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853769:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af5784161d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853775:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af5784161d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853781:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002560.853784:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af5784161d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853792:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af5784161d5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853803:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002560.853806:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002560.853810:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af5784161d5 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853816:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af5784161d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002560.853844:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbc0937e reply state 000000009b43867e transno 4294983992 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784161dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853901:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784161dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853907:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x3615e895 (ffff9ed2456efa00) 00010000:00010000:0.0:1786002560.853910:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002560.853912:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002560.853937:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784161ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afd7 expref: 590 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853950:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af5784161e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afd7 expref: 589 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002560.853958:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a7:0x0].0x0 (ffff9ed2456efd00) 00010000:00010000:0.0:1786002560.853960:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002560.853963:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245c47e00, rc 0) 00000100:00100000:0.0:1786002560.854012:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+590:19369:x1872758530980608:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 980us (1233us total) trans 4294983992 rc 0/0 00000100:00100000:0.0:1786002560.854019:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24053 00000020:00080000:0.0:1786002560.854023:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002560.871894:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.871966:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530980864 00000100:00100000:1.0:1786002560.871976:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530980864 00000100:00100000:1.0:1786002560.872027:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5212 00000100:00100000:1.0:1786002560.872036:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+590:19369:x1872758530980864:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:1.0:1786002560.872280:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983993 00000100:00100000:1.0:1786002560.872375:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+592:19369:x1872758530980864:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 337us (487us total) trans 4294983994 rc 0/0 00000100:00100000:1.0:1786002560.872383:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5212 00000020:00080000:1.0:1786002560.872388:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002560.897935:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002560.898020:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530981120 00000100:00100000:2.0:1786002560.898029:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530981120 00000100:00100000:2.0:1786002560.898094:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24054 00000100:00100000:2.0:1786002560.898107:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+592:19369:x1872758530981120:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002560.898130:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002560.898148:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af5784161f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3afde expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.898243:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af5784161f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.898257:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af5784161f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.898271:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af5784161f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.898302:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784161ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.898310:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784161ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.898317:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784161ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002560.898663:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fe:0x0], index 0: 0 00010000:00010000:2.0:1786002560.898829:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2de00/0x7cee4af578416206 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.898839:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2de00/0x7cee4af578416206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.898877:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2de00/0x7cee4af578416206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002560.898940:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983995 00010000:00010000:2.0:1786002560.898973:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af5784161f8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.898980:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af5784161f8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.898986:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af5784161f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.898992:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af5784161f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.898999:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570c800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002560.899003:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af5784161f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.899011:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af5784161f8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.899022:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002560.899025:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002560.899029:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af5784161f8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.899036:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c800/0x7cee4af5784161f8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002560.899049:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b85ad81 reply state 00000000987e628d transno 4294983996 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784161ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.899063:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784161ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.899069:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb3001f95 (ffff9ed2434dff00) 00010000:00010000:2.0:1786002560.899071:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002560.899074:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002560.899101:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b600/0x7cee4af5784161f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afde expref: 596 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.899114:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2de00/0x7cee4af578416206 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afde expref: 595 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002560.899122:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9ed2434df900) 00010000:00010000:2.0:1786002560.899124:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002560.899126:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2de00, rc 0) 00000100:00100000:2.0:1786002560.899185:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+596:19369:x1872758530981120:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1079us (1258us total) trans 4294983996 rc 0/0 00000100:00100000:2.0:1786002560.899192:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24054 00000020:00080000:2.0:1786002560.899197:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.907116:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.907304:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530981376 00000100:00100000:3.0:1786002560.907315:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530981376 00000100:00100000:3.0:1786002560.907367:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5213 00000100:00100000:3.0:1786002560.907377:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+596:19369:x1872758530981376:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002560.907705:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983997 00000100:00100000:3.0:1786002560.907828:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+598:19369:x1872758530981376:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 450us (720us total) trans 4294983998 rc 0/0 00000100:00100000:3.0:1786002560.907840:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5213 00000020:00080000:3.0:1786002560.907879:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002560.934263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002560.934359:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530981632 00000100:00100000:1.0:1786002560.934369:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530981632 00000100:00100000:1.0:1786002560.934431:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24055 00000100:00100000:1.0:1786002560.934442:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+598:19369:x1872758530981632:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002560.934467:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002560.934505:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416214 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3afe5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.934606:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af57841621b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.934620:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af57841621b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.934631:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af57841621b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.934648:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416222 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.934655:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416222 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.934661:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416222 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002560.935000:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fe:0x0], index 1: 0 00010000:00010000:1.0:1786002560.935172:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771e00/0x7cee4af578416229 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15a9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935182:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771e00/0x7cee4af578416229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935189:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771e00/0x7cee4af578416229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002560.935241:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294983999 00010000:00010000:1.0:1786002560.935272:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af57841621b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935280:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af57841621b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935286:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af57841621b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935296:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af57841621b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935301:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002560.935305:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af57841621b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935312:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af57841621b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935323:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002560.935326:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002560.935330:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af57841621b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935336:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af57841621b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002560.935349:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3f2ef5c reply state 0000000092304fab transno 4294984000 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416222 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935359:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416222 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935366:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x35965a95 (ffff9ed343228600) 00010000:00010000:1.0:1786002560.935369:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002560.935371:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002560.935396:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416214 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afe5 expref: 602 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935416:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771e00/0x7cee4af578416229 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afe5 expref: 601 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002560.935423:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a9:0x0].0x0 (ffff9ed343228100) 00010000:00010000:1.0:1786002560.935425:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002560.935427:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245771e00, rc 0) 00000100:00100000:1.0:1786002560.935475:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+602:19369:x1872758530981632:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1035us (1222us total) trans 4294984000 rc 0/0 00000100:00100000:1.0:1786002560.935483:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24055 00000020:00080000:1.0:1786002560.935487:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002560.940040:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.940108:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530981888 00000100:00100000:3.0:1786002560.940118:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530981888 00000100:00100000:3.0:1786002560.940167:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5214 00000100:00100000:3.0:1786002560.940176:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+602:19369:x1872758530981888:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002560.940411:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984001 00000100:00100000:3.0:1786002560.940522:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+604:19369:x1872758530981888:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 346us (492us total) trans 4294984002 rc 0/0 00000100:00100000:3.0:1786002560.940531:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5214 00000020:00080000:3.0:1786002560.940536:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.961267:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.961339:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530982144 00000100:00100000:3.0:1786002560.961348:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530982144 00000100:00100000:3.0:1786002560.961408:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24056 00000100:00100000:3.0:1786002560.961418:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+604:19369:x1872758530982144:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002560.961440:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002560.961458:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416237 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3afec expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.961574:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841623e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.961588:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841623e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.961598:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841623e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.961617:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416245 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x74956995 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.961624:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416245 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.961631:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416245 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002560.961994:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ff:0x0], index 0: 0 00010000:00010000:3.0:1786002560.962145:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621a00/0x7cee4af57841624c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15aa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962154:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621a00/0x7cee4af57841624c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962161:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621a00/0x7cee4af57841624c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002560.962212:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984003 00010000:00010000:3.0:1786002560.962245:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841623e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962252:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841623e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962258:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841623e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962264:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841623e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962274:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002560.962277:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841623e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962284:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841623e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962295:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002560.962297:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002560.962302:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841623e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962308:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af57841623e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002560.962320:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7673032 reply state 00000000daf5ada3 transno 4294984004 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416245 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962330:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416245 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962336:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x74956995 (ffff9ed24206a500) 00010000:00010000:3.0:1786002560.962339:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002560.962341:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002560.962365:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416237 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afec expref: 608 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962379:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621a00/0x7cee4af57841624c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afec expref: 607 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002560.962391:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15aa:0x0].0x0 (ffff9ed24206aa00) 00010000:00010000:3.0:1786002560.962393:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002560.962396:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245621a00, rc 0) 00000100:00100000:3.0:1786002560.962455:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+608:19369:x1872758530982144:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1037us (1195us total) trans 4294984004 rc 0/0 00000100:00100000:3.0:1786002560.962462:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24056 00000020:00080000:3.0:1786002560.962467:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002560.995252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002560.999126:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530982400 00000100:00100000:3.0:1786002560.999138:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530982400 00000100:00100000:3.0:1786002560.999203:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5215 00000100:00100000:3.0:1786002560.999214:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+608:19369:x1872758530982400:12345-192.168.203.49@tcp:35:createmany.0 00000001:00080000:3.0:1786002560.999460:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984005 00000100:00100000:3.0:1786002560.999578:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+610:19369:x1872758530982400:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 365us (4333us total) trans 4294984006 rc 0/0 00000100:00100000:3.0:1786002560.999587:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5215 00000020:00080000:3.0:1786002560.999592:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786002561.003105:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002561.085342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.085462:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530982656 00000100:00100000:0.0:1786002561.085484:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530982656 00000100:00100000:0.0:1786002561.085552:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24057 00000100:00100000:0.0:1786002561.085562:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+610:19370:x1872758530982656:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.085624:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.085651:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784154a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1547:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad30 expref: 610 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.085671:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff9ed245e35100) 00010000:00010000:0.0:1786002561.085682:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.085708:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841625a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.085720:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841625a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.085729:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841625a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.085740:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416261 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.085747:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416261 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.085753:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416261 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.085812:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416268 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.085820:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416268 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.085827:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416268 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.086292:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2502, 64 off168320 00000004:00080000:0.0:1786002561.086311:0:10360:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 921267463523ns, next at 922267461246ns, rc = 0 00010000:00010000:0.0:1786002561.086373:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af57841626f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086382:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af57841626f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086390:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af57841626f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086397:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af57841626f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086403:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af57841626f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086408:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af57841626f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086429:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.086445:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416268 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086452:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416268 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086459:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416268 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086465:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.086601:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416268 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086611:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416268 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086621:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff9ed2456efb00) 00010000:00010000:0.0:1786002561.086624:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.086628:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416268 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086633:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416268 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1547:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086648:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841625a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086654:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841625a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086659:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841625a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086664:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841625a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086669:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.086671:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841625a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086676:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841625a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086686:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.086688:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.086691:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841625a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086697:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841625a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.086704:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001480f020 reply state 00000000759e120e transno 4294984007 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416261 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086714:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416261 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.086720:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8b93e778 (ffff9ed245e35500) 00010000:00010000:0.0:1786002561.086722:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.086724:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002561.086873:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002561.086880:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af57841626f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.086886:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002561.086889:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af57841626f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.086896:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af57841626f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.086906:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1547:0x0].0x0 (ffff9ed2456efb00) 00010000:00010000:3.0:1786002561.086908:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002561.086911:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af57841626f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.086917:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af57841626f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1547:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.086930:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.086931:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.086933:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002561.087564:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+611:19370:x1872758530982656:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 2000us (2228us total) trans 4294984007 rc 0/0 00000100:00100000:0.0:1786002561.087572:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24057 00000100:00100000:2.0:1786002561.116436:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.116580:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530982912 00000100:00100000:0.0:1786002561.116589:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530982912 00000100:00100000:0.0:1786002561.116644:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24058 00000100:00100000:0.0:1786002561.116654:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+611:19370:x1872758530982912:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.116704:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.116727:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784154e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1548:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad3e expref: 611 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.116750:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff9ed245e35a00) 00010000:00010000:0.0:1786002561.116759:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.116779:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416276 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.116790:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416276 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.116799:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416276 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.116808:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af57841627d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.116815:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af57841627d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.116821:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af57841627d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.116933:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416284 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.116943:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416284 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.116950:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416284 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.117369:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786002561.117394:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1786002561.118104:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000004:00080000:0.0:1786002561.118114:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 921299265781ns, next at 922299263279ns, rc = 0 00010000:00010000:0.0:1786002561.118177:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af57841628b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118187:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af57841628b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118194:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af57841628b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118201:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af57841628b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118207:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af57841628b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118211:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af57841628b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118267:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.118284:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416284 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118289:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416284 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118294:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416284 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118298:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.118303:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416284 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118310:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416284 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118319:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:0.0:1786002561.118322:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.118326:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416284 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118331:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416284 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1548:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118350:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416276 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118355:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416276 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118361:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416276 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118367:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416276 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118372:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.118374:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416276 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118380:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416276 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118388:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.118390:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.118394:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416276 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118400:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416276 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.118410:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd46adea reply state 00000000ad544c3a transno 4294984008 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af57841627d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118420:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af57841627d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.118427:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x53a9537d (ffff9ed245e35b00) 00010000:00010000:0.0:1786002561.118429:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.118432:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.119637:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+612:19370:x1872758530982912:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 2980us (3205us total) trans 4294984008 rc 0/0 00000100:00100000:0.0:1786002561.119646:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24058 00000100:00100000:2.0:1786002561.125648:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002561.125729:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530983168 00000100:00100000:3.0:1786002561.125738:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530983168 00000100:00100000:3.0:1786002561.125791:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24059 00000100:00100000:3.0:1786002561.125801:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+612:19370:x1872758530983168:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002561.125891:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002561.125916:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578415509 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1549:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad45 expref: 612 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.125934:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff9ed2456f9300) 00010000:00010000:3.0:1786002561.125945:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002561.125965:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416292 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.125978:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416292 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.125987:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416292 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.126002:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416299 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.126009:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416299 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.126026:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416299 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.126084:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784162a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.126092:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784162a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.126099:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784162a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002561.126292:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2503, 64 off168384 00010000:00010000:3.0:1786002561.131684:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784162a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.131704:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784162a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.131715:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784162a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.131724:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784162a7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.131731:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784162a7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.131739:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784162a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.134957:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002561.134973:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af57841628b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.134982:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002561.134986:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af57841628b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.134994:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af57841628b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.135008:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1548:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:1.0:1786002561.135011:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002561.135014:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af57841628b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.135024:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af57841628b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1548:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.135046:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002561.135049:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784162a7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.135055:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002561.135058:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784162a7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.135064:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784162a7 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.135071:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:1.0:1786002561.135073:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002561.135076:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784162a7 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.135083:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.135085:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.135086:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.139921:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.139925:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786002561.139937:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784162a7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1549:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.139983:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784162a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.139991:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784162a0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.139996:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784162a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.140002:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.140006:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784162a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.140013:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784162a0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.140923:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1549:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:3.0:1786002561.140926:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002561.140931:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784162a0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.140937:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784162a0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1549:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.140969:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416292 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.140976:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416292 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.140982:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416292 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.140987:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416292 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.140992:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.140995:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416292 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.141001:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416292 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.141009:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002561.141012:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002561.141346:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416292 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.141356:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af578416292 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002561.141369:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1e6f569 reply state 0000000067a0533c transno 4294984009 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416299 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.141382:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416299 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.141391:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x756ed0d2 (ffff9ed2456f9000) 00010000:00010000:3.0:1786002561.141394:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002561.141397:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002561.141576:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+613:19370:x1872758530983168:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 15772us (15934us total) trans 4294984009 rc 0/0 00000100:00100000:3.0:1786002561.141585:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24059 00000100:00100000:2.0:1786002561.158467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.158605:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530983424 00000100:00100000:0.0:1786002561.158615:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530983424 00000100:00100000:0.0:1786002561.158672:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24060 00000100:00100000:0.0:1786002561.158682:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+613:19370:x1872758530983424:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.158753:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.158778:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af57841552c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad4c expref: 613 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.158795:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff9ed2456f9100) 00010000:00010000:0.0:1786002561.158804:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.158825:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.158877:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.158888:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.158899:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784162b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.158908:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784162b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.158914:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784162b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.158977:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.158985:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.158993:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.159203:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 64 off8320 00010000:00010000:0.0:1786002561.159261:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159269:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159281:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159288:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162c3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159294:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162c3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159391:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159414:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.159430:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159437:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162bc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159442:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159448:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.159452:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159459:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162bc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159467:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:0.0:1786002561.159470:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002561.159526:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002561.159532:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159535:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162bc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.159539:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002561.159541:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162bc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.159542:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.159554:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159558:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162ae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.159562:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154a:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:0.0:1786002561.159564:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162ae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.159565:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002561.159567:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162c3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159570:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.159574:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162c3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159576:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159581:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.159583:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.159585:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.159586:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.159588:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.159590:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162ae lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159597:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.159599:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.159602:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162ae lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159609:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.159618:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090134353 reply state 000000005777580f transno 4294984010 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784162b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159628:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784162b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.159634:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd3ce983f (ffff9ed2456f9900) 00010000:00010000:0.0:1786002561.159636:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.159639:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.159703:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+614:19370:x1872758530983424:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1021us (1243us total) trans 4294984010 rc 0/0 00000100:00100000:0.0:1786002561.159710:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24060 00000100:00100000:2.0:1786002561.178770:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.178929:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530983680 00000100:00100000:0.0:1786002561.178938:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530983680 00000100:00100000:0.0:1786002561.179004:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24061 00000100:00100000:0.0:1786002561.179014:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+614:19370:x1872758530983680:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.179071:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.179096:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af57841554f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad53 expref: 614 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.179115:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff9ed2456f9400) 00010000:00010000:0.0:1786002561.179125:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.179145:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.179158:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.179167:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.179182:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.179189:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.179195:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.179252:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.179260:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.179267:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.184757:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2504, 64 off168448 00010000:00010000:0.0:1786002561.184908:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af5784162df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.184925:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af5784162df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.184935:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af5784162df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.184944:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af5784162df lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.184951:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af5784162df lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.184959:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af5784162df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.184975:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.184996:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185003:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162d8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185010:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185016:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.185021:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185028:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162d8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185038:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002561.185041:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.185045:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162d8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185051:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af5784162d8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185072:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162ca lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185083:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162ca lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185089:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185094:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185099:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.185102:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185109:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162ca lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185117:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.185119:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.185122:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162ca lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185128:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af5784162ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.185138:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077bb4009 reply state 00000000dfba159c transno 4294984011 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185149:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.185155:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xdb9e9594 (ffff9ed2456f9c00) 00010000:00010000:0.0:1786002561.185158:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.185161:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.185246:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+615:19370:x1872758530983680:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 6229us (6481us total) trans 4294984011 rc 0/0 00000100:00100000:0.0:1786002561.185255:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24061 00010000:00010000:2.0:1786002561.185530:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.185537:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af5784162df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.185544:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.185547:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af5784162df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.185553:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af5784162df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.185563:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154b:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:2.0:1786002561.185565:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.185568:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af5784162df lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.185573:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af5784162df lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.185587:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.185588:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.185590:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002561.201574:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002561.201701:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530983936 00000100:00100000:3.0:1786002561.201710:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530983936 00000100:00100000:3.0:1786002561.201775:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24062 00000100:00100000:3.0:1786002561.201784:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+615:19370:x1872758530983936:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002561.201880:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002561.201904:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a600/0x7cee4af578415572 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad5a expref: 615 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.201921:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff9ed245fedc00) 00010000:00010000:3.0:1786002561.201932:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002561.205288:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784162e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205315:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784162e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205326:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784162e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205340:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784162ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205346:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784162ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205351:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784162ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205408:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784162f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205414:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784162f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205419:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784162f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002561.205646:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 64 off8384 00010000:00010000:2.0:1786002561.205710:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784162fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205719:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784162fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205739:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784162fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205747:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784162fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205754:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784162fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205761:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784162fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205781:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002561.205799:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784162f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205805:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784162f4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205812:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784162f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205818:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002561.205822:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784162f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205830:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784162f4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205840:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff9ed2434df600) 00010000:00010000:2.0:1786002561.205843:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002561.205872:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784162f4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205879:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784162f4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205896:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784162e6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205903:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784162e6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205914:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784162e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205921:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784162e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205926:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002561.205929:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784162e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205935:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784162e6 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205942:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002561.205944:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002561.205947:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784162e6 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205953:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784162e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002561.205963:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017b61f5f reply state 000000007b31a32d transno 4294984012 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784162ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205973:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784162ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.205979:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe663f479 (ffff9ed245ddc600) 00010000:00010000:2.0:1786002561.205982:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002561.205984:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002561.206534:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002561.206541:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784162fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.206547:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002561.206550:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784162fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.206556:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784162fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.206566:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154c:0x0].0x0 (ffff9ed2434df600) 00010000:00010000:1.0:1786002561.206569:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002561.206572:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784162fb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.206578:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784162fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.206593:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.206595:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.206597:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002561.208557:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+616:19370:x1872758530983936:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 6766us (6983us total) trans 4294984012 rc 0/0 00000100:00100000:2.0:1786002561.208567:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24062 00000100:00100000:3.0:1786002561.233951:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.234037:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530984192 00000100:00100000:0.0:1786002561.234047:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530984192 00000100:00100000:0.0:1786002561.234109:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24063 00000100:00100000:0.0:1786002561.234120:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+616:19370:x1872758530984192:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.234171:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.234195:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578415595 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad61 expref: 616 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234213:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff9ed245e35400) 00010000:00010000:0.0:1786002561.234222:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.234242:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416302 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234254:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416302 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234262:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416302 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234272:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416309 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234279:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234289:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234345:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416310 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234352:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416310 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234359:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416310 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.234575:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2505, 64 off168512 00010000:00010000:0.0:1786002561.234635:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416317 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234643:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234651:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234657:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416317 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234663:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416317 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234668:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416317 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234692:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.234708:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416310 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234714:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416310 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234720:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416310 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234726:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.234731:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416310 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234738:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416310 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234745:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002561.234748:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.234751:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416310 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234757:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416310 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234772:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416302 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234778:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416302 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234783:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416302 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234792:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416302 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234796:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.234799:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416302 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234804:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416302 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234810:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.234812:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.234815:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416302 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234820:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416302 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.234828:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e29c739 reply state 000000007167c132 transno 4294984013 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234838:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416309 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.234844:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xf8b3f1ce (ffff9ed245e35600) 00010000:00010000:0.0:1786002561.234885:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.234889:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.234959:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+617:19370:x1872758530984192:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 840us (1015us total) trans 4294984013 rc 0/0 00000100:00100000:0.0:1786002561.234967:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24063 00010000:00010000:3.0:1786002561.235149:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002561.235156:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416317 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.235163:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002561.235166:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416317 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.235173:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416317 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.235188:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154d:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:3.0:1786002561.235190:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002561.235193:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416317 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.235198:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416317 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.235213:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.235215:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.235217:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002561.253270:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.253381:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530984448 00000100:00100000:0.0:1786002561.253392:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530984448 00000100:00100000:0.0:1786002561.253462:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24064 00000100:00100000:0.0:1786002561.253610:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+617:19370:x1872758530984448:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.253667:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.253702:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a400/0x7cee4af5784155b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad68 expref: 617 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.253722:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff9ed245fed500) 00010000:00010000:0.0:1786002561.253734:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.253756:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841631e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.253770:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841631e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.253779:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841631e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.253789:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416325 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.253796:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416325 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.253802:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416325 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.253947:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af57841632c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.253961:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af57841632c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.253968:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af57841632c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.254174:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 64 off8448 00010000:00010000:0.0:1786002561.254255:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416333 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254264:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416333 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254272:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416333 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254279:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416333 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254285:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416333 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254291:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416333 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254310:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.254327:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af57841632c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254333:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af57841632c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254344:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af57841632c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254350:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.254354:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af57841632c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254362:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af57841632c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.254370:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002561.254370:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:0.0:1786002561.254373:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002561.254377:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416333 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254377:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af57841632c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254383:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af57841632c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.254384:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.254387:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416333 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.254392:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416333 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254398:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841631e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.254400:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154e:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:2.0:1786002561.254403:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002561.254403:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841631e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.254406:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416333 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254410:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841631e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.254411:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af578416333 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254415:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841631e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254419:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.254422:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841631e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.254423:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.254425:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.254426:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.254429:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841631e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254435:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.254438:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.254440:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841631e lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254446:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af57841631e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.254454:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db0dff86 reply state 00000000488ef346 transno 4294984014 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416325 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.254462:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416325 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.257753:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7d12be7b (ffff9ed245fede00) 00010000:00010000:0.0:1786002561.257759:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.257763:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.257926:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+618:19370:x1872758530984448:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 4317us (4662us total) trans 4294984014 rc 0/0 00000100:00100000:0.0:1786002561.257935:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24064 00000100:00100000:2.0:1786002561.286952:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.287032:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530984704 00000100:00100000:0.0:1786002561.287041:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530984704 00000100:00100000:0.0:1786002561.287099:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24065 00000100:00100000:0.0:1786002561.287110:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+618:19370:x1872758530984704:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.287163:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.287190:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a200/0x7cee4af5784155db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x154f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad6f expref: 618 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287206:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff9ed245fed700) 00010000:00010000:0.0:1786002561.287218:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.287240:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841633a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287251:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841633a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287260:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841633a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287269:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578416341 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287276:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578416341 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287282:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578416341 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287339:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416348 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287347:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416348 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287354:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416348 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.287573:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2506, 64 off168576 00010000:00010000:0.0:1786002561.287651:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af57841634f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287662:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af57841634f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287670:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af57841634f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287678:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af57841634f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287685:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af57841634f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287692:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af57841634f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287710:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.287726:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416348 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287732:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416348 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287738:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416348 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287744:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.287748:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416348 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287755:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416348 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287764:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:0.0:1786002561.287767:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.287770:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416348 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287775:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416348 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x154f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287790:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841633a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287796:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841633a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287801:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841633a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287806:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841633a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287811:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.287814:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841633a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287819:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841633a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287826:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.287829:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.287832:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841633a lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287842:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841633a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.287882:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001833a8e0 reply state 00000000c2eb098e transno 4294984015 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578416341 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287893:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578416341 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.287899:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6e2bbd0 (ffff9ed245fed100) 00010000:00010000:0.0:1786002561.287901:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.287904:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002561.287906:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002561.287912:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af57841634f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.287917:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002561.287920:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af57841634f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.287926:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af57841634f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.287934:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x154f:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:1.0:1786002561.287936:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002561.287938:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af57841634f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.287943:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af57841634f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x154f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002561.287963:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+619:19370:x1872758530984704:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 853us (1018us total) trans 4294984015 rc 0/0 00000100:00100000:0.0:1786002561.287971:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24065 00010000:00010000:1.0:1786002561.287972:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.287973:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.287975:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786002561.302647:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984015 is committed 00000004:00080000:2.0:1786002561.302669:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 91 committed 00000004:00080000:2.0:1786002561.302687:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 88 committed 00000100:00100000:0.0:1786002561.302972:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002561.302993:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561010432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002561.303058:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1786002561.303096:0:8758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 2502 count 1 00000040:00080000:3.0:1786002561.303118:0:8758:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1786002561.303121:0:8758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1786002561.303121:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561010432 00000100:00100000:0.0:1786002561.303128:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561010432 00000100:00100000:3.0:1786002561.303163:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561010560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1786002561.303178:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5244 00000100:00100000:0.0:1786002561.303186:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1872758561010432:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002561.303190:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1786002561.303210:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2509 count 1 00000100:00100000:3.0:1786002561.303221:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561010560 00000100:00100000:3.0:1786002561.303225:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561010560 00002000:00010000:0.0:1786002561.303238:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002561.303246:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578416356 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002561.303250:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5245 00000100:00100000:3.0:1786002561.303255:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3647:x1872758561010560:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002561.303263:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=921s v=(0 0) 00002000:00080000:3.0:1786002561.303267:0:14676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2510 count 1 00010000:00010000:0.0:1786002561.303268:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002561.303275:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578416356 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002561.303282:0:14676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002561.303286:0:14676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085f1d3d0/0x7cee4af57841635d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.303288:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578416356 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.303298:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578416356 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.303306:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578416356 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.303307:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ce:0x0].0x0 since=921s v=(0 0) 00010000:00010000:3.0:1786002561.303310:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002561.303315:0:14676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f1d3d0/0x7cee4af57841635d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.303323:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002561.303324:0:14676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f1d3d0/0x7cee4af57841635d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.303331:0:14676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085f1d3d0/0x7cee4af57841635d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.303337:0:14676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085f1d3d0/0x7cee4af57841635d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.303348:0:14676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1786002561.303441:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1872758561010432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 255us (381us total) trans 4294969899 rc 0/0 00000100:00100000:0.0:1786002561.303447:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5244 00010000:00010000:1.0:1786002561.303540:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784154a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303549:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784154a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303559:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784154a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303565:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.303569:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784154a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303575:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784154a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303588:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8b93e778 (ffff9ed245e35500) 00010000:00010000:1.0:1786002561.303591:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.303595:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784154a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303601:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c600/0x7cee4af5784154a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303615:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784154df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303620:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784154df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303625:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784154df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303629:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.303632:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784154df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303641:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784154df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303647:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x53a9537d (ffff9ed245e35b00) 00010000:00010000:1.0:1786002561.303649:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.303652:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784154df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303657:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d000/0x7cee4af5784154df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303667:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578415502 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303673:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578415502 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303679:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578415502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303684:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.303686:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578415502 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303691:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578415502 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303698:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x756ed0d2 (ffff9ed2456f9000) 00010000:00010000:1.0:1786002561.303700:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.303703:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578415502 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303710:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578415502 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303721:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415525 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303727:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415525 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303732:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415525 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303737:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.303739:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415525 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303745:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415525 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303752:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd3ce983f (ffff9ed2456f9900) 00010000:00010000:1.0:1786002561.303754:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.303757:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415525 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303763:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578415525 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303773:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578415548 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303779:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578415548 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303784:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578415548 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303789:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.303791:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578415548 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303796:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578415548 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303802:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xdb9e9594 (ffff9ed2456f9c00) 00010000:00010000:1.0:1786002561.303804:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.303807:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578415548 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303812:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578415548 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303821:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841556b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303827:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841556b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303833:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841556b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303838:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.303840:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841556b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303884:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841556b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303893:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe663f479 (ffff9ed245ddc600) 00010000:00010000:1.0:1786002561.303895:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.303898:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841556b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303905:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2aa00/0x7cee4af57841556b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303916:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841558e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303923:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841558e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303929:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841558e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303934:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.303937:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841558e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303943:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841558e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303950:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xf8b3f1ce (ffff9ed245e35600) 00010000:00010000:1.0:1786002561.303952:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.303955:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841558e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303961:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d200/0x7cee4af57841558e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303971:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784155b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303976:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784155b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303983:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784155b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303989:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.303992:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784155b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.303998:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784155b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304005:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7d12be7b (ffff9ed245fede00) 00010000:00010000:1.0:1786002561.304007:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304010:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784155b1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304017:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b400/0x7cee4af5784155b1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304027:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784155d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304032:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784155d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304037:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784155d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304042:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304045:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784155d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304052:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784155d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304059:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6e2bbd0 (ffff9ed245fed100) 00010000:00010000:1.0:1786002561.304061:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304064:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784155d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304069:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ba00/0x7cee4af5784155d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304079:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784155f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304084:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784155f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304089:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784155f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304094:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304097:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784155f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304106:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784155f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304113:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x40eea295 (ffff9ed245e35000) 00010000:00010000:1.0:1786002561.304115:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304118:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784155f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304123:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8da00/0x7cee4af5784155f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304137:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841561a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304142:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841561a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304148:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841561a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304153:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304155:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841561a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304160:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841561a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304166:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xea16437d (ffff9ed2456f9600) 00010000:00010000:1.0:1786002561.304168:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304170:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841561a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304176:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af57841561a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304187:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841563d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304192:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841563d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304198:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841563d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304203:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304205:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841563d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304210:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841563d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304215:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x9897527d (ffff9ed245ddcd00) 00010000:00010000:1.0:1786002561.304217:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304220:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841563d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304224:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a600/0x7cee4af57841563d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304234:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415660 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304239:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415660 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304245:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415660 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304250:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304252:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415660 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304257:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415660 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304262:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe423257d (ffff9ed2456f9500) 00010000:00010000:1.0:1786002561.304264:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304266:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415660 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304271:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578415660 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304280:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415683 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304286:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415683 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304292:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415683 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304296:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304299:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415683 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304308:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415683 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304314:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x970cb47d (ffff9ed2456f9800) 00010000:00010000:1.0:1786002561.304317:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304319:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415683 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304326:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578415683 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304339:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784156a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304345:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784156a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304350:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784156a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304355:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304357:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784156a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304363:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784156a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304370:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5239df7d (ffff9ed245ddc900) 00010000:00010000:1.0:1786002561.304372:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304375:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784156a6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304381:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b400/0x7cee4af5784156a6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304397:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784156c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304403:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784156c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304408:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784156c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304413:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304416:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784156c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304421:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784156c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304427:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa5436e7d (ffff9ed2456f9700) 00010000:00010000:1.0:1786002561.304429:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304432:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784156c9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304438:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af5784156c9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304448:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784156ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304453:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784156ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304459:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784156ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304464:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5b800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304466:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784156ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304471:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784156ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304477:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xead1417d (ffff9ed245fed600) 00010000:00010000:1.0:1786002561.304479:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304481:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784156ec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304486:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b800/0x7cee4af5784156ec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304508:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841570f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304514:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841570f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304519:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841570f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304524:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304527:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841570f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304536:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841570f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304543:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7d30507d (ffff9ed245e35f00) 00010000:00010000:1.0:1786002561.304545:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304547:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841570f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304553:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8dc00/0x7cee4af57841570f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304564:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578415732 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304570:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578415732 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304576:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578415732 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304581:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304583:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578415732 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304588:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578415732 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304595:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa468b7d (ffff9ed2456f9200) 00010000:00010000:1.0:1786002561.304597:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304599:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578415732 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304605:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229400/0x7cee4af578415732 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304615:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578415755 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304620:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578415755 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304626:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578415755 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304630:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8d400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304633:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578415755 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304638:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578415755 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304643:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xdf501a7d (ffff9ed245e35900) 00010000:00010000:1.0:1786002561.304645:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304648:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578415755 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304652:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d400/0x7cee4af578415755 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304662:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578415778 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304668:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578415778 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304673:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578415778 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304678:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2b600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304681:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578415778 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304686:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578415778 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304691:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8b6840d2 (ffff9ed245ddc800) 00010000:00010000:1.0:1786002561.304693:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304695:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578415778 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304700:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b600/0x7cee4af578415778 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304711:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af57841579b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304716:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af57841579b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304721:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af57841579b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304726:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304728:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af57841579b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304737:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af57841579b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304742:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa0674fd2 (ffff9ed351207900) 00010000:00010000:1.0:1786002561.304744:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304746:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af57841579b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304751:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228c00/0x7cee4af57841579b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304772:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784157be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304778:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784157be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304784:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784157be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304788:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ee00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304791:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784157be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304796:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784157be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304802:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x65f522d2 (ffff9ed245e35d00) 00010000:00010000:1.0:1786002561.304804:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304807:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784157be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304813:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ee00/0x7cee4af5784157be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304823:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784157e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304829:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784157e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304835:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784157e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304840:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2ba00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304843:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784157e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304884:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784157e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304891:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x38feb1d2 (ffff9ed245ddc100) 00010000:00010000:1.0:1786002561.304893:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304895:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784157e1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304900:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ba00/0x7cee4af5784157e1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304925:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415804 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304932:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415804 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304938:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415804 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304943:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.304945:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415804 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304952:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415804 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304959:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7c0bdcd2 (ffff9ed351207400) 00010000:00010000:1.0:1786002561.304961:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.304964:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415804 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304970:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229a00/0x7cee4af578415804 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304982:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578415827 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304988:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578415827 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304994:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578415827 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.304998:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305000:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578415827 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305009:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578415827 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305016:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x27156bd2 (ffff9ed245fed200) 00010000:00010000:1.0:1786002561.305018:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305021:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578415827 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305026:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a000/0x7cee4af578415827 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305038:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af57841584a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305044:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af57841584a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305049:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af57841584a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305055:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a228e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305058:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af57841584a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305064:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af57841584a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305071:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xfd213ed2 (ffff9ed351207c00) 00010000:00010000:1.0:1786002561.305073:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305075:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af57841584a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305082:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228e00/0x7cee4af57841584a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305107:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841586d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305113:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841586d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305119:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841586d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305125:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305128:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841586d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305133:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841586d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305141:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x81a24dd2 (ffff9ed245fed000) 00010000:00010000:1.0:1786002561.305144:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305147:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841586d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305154:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5be00/0x7cee4af57841586d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305167:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578415890 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305173:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578415890 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305180:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578415890 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305186:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305189:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578415890 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305196:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578415890 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305202:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6cc088d2 (ffff9ed245e35300) 00010000:00010000:1.0:1786002561.305204:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305207:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578415890 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305213:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f200/0x7cee4af578415890 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305223:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5784158b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305229:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5784158b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305236:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5784158b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305241:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305244:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5784158b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305254:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5784158b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305261:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe9ca17d2 (ffff9ed245feda00) 00010000:00010000:1.0:1786002561.305264:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305266:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5784158b3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305272:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5a800/0x7cee4af5784158b3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305283:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784158d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305290:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784158d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305296:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784158d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305301:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305303:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784158d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305309:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784158d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305315:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa846083f (ffff9ed244f15d00) 00010000:00010000:1.0:1786002561.305318:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305320:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784158d6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305327:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fc00/0x7cee4af5784158d6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305340:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784158f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305345:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784158f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305351:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784158f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305355:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed35a229800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305358:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784158f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305363:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784158f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305370:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb56f173f (ffff9ed351207300) 00010000:00010000:1.0:1786002561.305372:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305375:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784158f9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305381:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229800/0x7cee4af5784158f9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305395:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031400/0x7cee4af57841591c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305402:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031400/0x7cee4af57841591c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305409:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031400/0x7cee4af57841591c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305414:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed340031400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305417:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031400/0x7cee4af57841591c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305424:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031400/0x7cee4af57841591c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305431:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5432ea3f (ffff9ed245fed300) 00010000:00010000:1.0:1786002561.305433:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305436:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031400/0x7cee4af57841591c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305443:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031400/0x7cee4af57841591c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305455:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af57841593f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305461:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af57841593f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305467:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af57841593f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305473:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7fe00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305476:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af57841593f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305486:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af57841593f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305503:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7f3c793f (ffff9ed244f15a00) 00010000:00010000:1.0:1786002561.305506:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305509:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af57841593f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305515:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fe00/0x7cee4af57841593f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305527:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578415962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305534:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578415962 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305541:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578415962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305546:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2bc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305549:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578415962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305555:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578415962 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305561:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x98e9a43f (ffff9ed35363db00) 00010000:00010000:1.0:1786002561.305564:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305567:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578415962 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305573:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2bc00/0x7cee4af578415962 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305586:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1e00/0x7cee4af578415985 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305592:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1e00/0x7cee4af578415985 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305598:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1e00/0x7cee4af578415985 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305604:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b1e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305607:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1e00/0x7cee4af578415985 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305613:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1e00/0x7cee4af578415985 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305619:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x43f3333f (ffff9ed35363d900) 00010000:00010000:1.0:1786002561.305621:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305624:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1e00/0x7cee4af578415985 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305630:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1e00/0x7cee4af578415985 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305640:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0200/0x7cee4af5784159a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305646:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0200/0x7cee4af5784159a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305653:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0200/0x7cee4af5784159a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305658:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305661:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0200/0x7cee4af5784159a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305667:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0200/0x7cee4af5784159a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305674:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5ae1063f (ffff9ed35363d700) 00010000:00010000:1.0:1786002561.305676:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305679:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0200/0x7cee4af5784159a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305684:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0200/0x7cee4af5784159a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305694:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1c00/0x7cee4af5784159cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305701:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1c00/0x7cee4af5784159cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305707:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1c00/0x7cee4af5784159cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305712:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b1c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305715:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1c00/0x7cee4af5784159cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305723:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1c00/0x7cee4af5784159cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305730:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6fe0153f (ffff9ed35363d800) 00010000:00010000:1.0:1786002561.305732:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305735:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1c00/0x7cee4af5784159cb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305742:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1c00/0x7cee4af5784159cb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305753:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784159ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305760:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784159ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305766:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784159ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305771:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f5ac00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305774:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784159ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305781:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784159ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305787:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa91e503f (ffff9ed245fedd00) 00010000:00010000:1.0:1786002561.305789:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305792:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784159ee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305798:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ac00/0x7cee4af5784159ee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305809:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0c00/0x7cee4af578415a11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305815:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0c00/0x7cee4af578415a11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305821:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0c00/0x7cee4af578415a11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305827:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305829:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0c00/0x7cee4af578415a11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305835:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0c00/0x7cee4af578415a11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305842:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xfc27df3f (ffff9ed245ddca00) 00010000:00010000:1.0:1786002561.305844:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305870:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0c00/0x7cee4af578415a11 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305876:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0c00/0x7cee4af578415a11 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305891:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415a34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305897:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415a34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305905:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415a34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305910:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7e600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305913:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415a34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305918:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415a34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305925:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6a358594 (ffff9ed244f15500) 00010000:00010000:1.0:1786002561.305927:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305930:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415a34 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305936:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e600/0x7cee4af578415a34 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305949:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415a57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305955:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415a57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305961:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415a57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305966:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.305968:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415a57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305977:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415a57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305984:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x3f3f1494 (ffff9ed244f15900) 00010000:00010000:1.0:1786002561.305986:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.305989:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415a57 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.305995:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f000/0x7cee4af578415a57 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306008:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0a00/0x7cee4af578415a7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306014:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0a00/0x7cee4af578415a7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306020:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0a00/0x7cee4af578415a7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306025:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.306028:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0a00/0x7cee4af578415a7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306034:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0a00/0x7cee4af578415a7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306042:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x584c3f94 (ffff9ed245ddc200) 00010000:00010000:1.0:1786002561.306044:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.306046:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0a00/0x7cee4af578415a7a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306052:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0a00/0x7cee4af578415a7a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306066:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af578415a9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306072:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af578415a9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306078:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af578415a9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306083:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b1200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.306085:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af578415a9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306091:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af578415a9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306098:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x55367694 (ffff9ed24559f500) 00010000:00010000:1.0:1786002561.306099:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.306102:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af578415a9d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306107:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1200/0x7cee4af578415a9d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306118:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0400/0x7cee4af578415ac0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306124:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0400/0x7cee4af578415ac0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306129:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0400/0x7cee4af578415ac0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.306131:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002561.306134:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.306137:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0400/0x7cee4af578415ac0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.306138:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578416356 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306142:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0400/0x7cee4af578415ac0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.306148:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002561.306149:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xf0e3a194 (ffff9ed24559f700) 00010000:00010000:1.0:1786002561.306151:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002561.306152:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578416356 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306154:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0400/0x7cee4af578415ac0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306159:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0400/0x7cee4af578415ac0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.306160:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578416356 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306171:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415ae3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.306174:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578416356 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306177:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415ae3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.306182:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aca69537/0x7cee4af578416356 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306183:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415ae3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306188:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7ec00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.306190:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415ae3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.306196:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002561.306199:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415ae3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.306200:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085f1d3d0/0x7cee4af57841635d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306206:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x2fe2b094 (ffff9ed244f15300) 00010000:00010000:2.0:1786002561.306207:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002561.306209:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002561.306210:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f1d3d0/0x7cee4af57841635d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306211:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415ae3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306217:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ec00/0x7cee4af578415ae3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.306218:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085f1d3d0/0x7cee4af57841635d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.306228:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085f1d3d0/0x7cee4af57841635d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306228:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415b06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306234:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415b06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.306236:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f1d3d0/0x7cee4af57841635d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306240:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415b06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306245:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245e7f400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.306247:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415b06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.306249:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.306250:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.306252:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.306254:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415b06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306260:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xc8efdb94 (ffff9ed244f15c00) 00010000:00010000:1.0:1786002561.306262:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.306264:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415b06 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306270:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f400/0x7cee4af578415b06 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306281:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415b29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306287:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415b29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306293:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415b29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306297:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed243d2a400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.306300:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415b29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306306:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415b29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306313:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x45da1294 (ffff9ed24559f900) 00010000:00010000:1.0:1786002561.306315:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.306318:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415b29 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306323:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a400/0x7cee4af578415b29 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306337:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578415b4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306344:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578415b4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306350:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578415b4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306355:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.306357:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578415b4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306363:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578415b4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306370:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd2f04d94 (ffff9ed244f15200) 00010000:00010000:1.0:1786002561.306372:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.306375:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578415b4c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306380:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578415b4c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306392:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415b6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306397:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415b6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306403:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415b6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306407:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.306409:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415b6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306417:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415b6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306423:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7df9dc94 (ffff9ed244f15100) 00010000:00010000:1.0:1786002561.306425:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.306427:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415b6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306432:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ca00/0x7cee4af578415b6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306442:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ce00/0x7cee4af578415b92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306447:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ce00/0x7cee4af578415b92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306452:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ce00/0x7cee4af578415b92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306456:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.306459:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ce00/0x7cee4af578415b92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306464:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ce00/0x7cee4af578415b92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306469:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xda336479 (ffff9ed24559f600) 00010000:00010000:1.0:1786002561.306471:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.306473:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ce00/0x7cee4af578415b92 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306478:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ce00/0x7cee4af578415b92 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.306488:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577aa00/0x7cee4af578415bb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786002561.310039:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786002561.310048:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786002561.310189:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002561.314668:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3647:x1872758561010560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11402us (11466us total) trans 4294969902 rc 0/0 00000100:00100000:3.0:1786002561.314681:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5245 00010000:00010000:1.0:1786002561.315615:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577aa00/0x7cee4af578415bb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315625:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577aa00/0x7cee4af578415bb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315632:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24577aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.315637:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577aa00/0x7cee4af578415bb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315646:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577aa00/0x7cee4af578415bb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315663:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x3abc7379 (ffff9ed366e56700) 00010000:00010000:1.0:1786002561.315666:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.315670:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577aa00/0x7cee4af578415bb5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315678:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577aa00/0x7cee4af578415bb5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315704:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b000/0x7cee4af578415bd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315710:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b000/0x7cee4af578415bd8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315716:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b000/0x7cee4af578415bd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315721:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24577b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.315724:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b000/0x7cee4af578415bd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315730:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b000/0x7cee4af578415bd8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315738:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x32204679 (ffff9ed366e56400) 00010000:00010000:1.0:1786002561.315740:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.315743:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b000/0x7cee4af578415bd8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315750:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b000/0x7cee4af578415bd8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315762:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b400/0x7cee4af578415bfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315768:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b400/0x7cee4af578415bfb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315775:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b400/0x7cee4af578415bfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315780:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24577b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.315783:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b400/0x7cee4af578415bfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315794:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b400/0x7cee4af578415bfb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315802:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x2f29d579 (ffff9ed24556e100) 00010000:00010000:1.0:1786002561.315804:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.315806:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b400/0x7cee4af578415bfb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315812:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b400/0x7cee4af578415bfb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315825:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c400/0x7cee4af578415c1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315830:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c400/0x7cee4af578415c1e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315837:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c400/0x7cee4af578415c1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.315843:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570c400 already unused, calling callback (ffffffffc18af4f0) 00000100:00100000:3.0:1786002561.319756:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.320593:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530984960 00000100:00100000:0.0:1786002561.320602:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530984960 00000100:00100000:0.0:1786002561.320661:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24066 00000100:00100000:0.0:1786002561.320671:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+156:19370:x1872758530984960:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.320725:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.320749:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af5784155fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1550:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad76 expref: 156 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.320774:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff9ed2456f9a00) 00010000:00010000:0.0:1786002561.320787:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.320807:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578416364 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.320819:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578416364 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.320829:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578416364 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.320844:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841636b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.320867:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841636b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.320874:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841636b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.320935:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416372 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.320943:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416372 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002561.320946:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f536680/2, rc 0, transno 4294969902 00010000:00010000:0.0:1786002561.320949:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416372 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002561.321096:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561010560:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1786002561.321176:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 64 off8512 00010000:00010000:0.0:1786002561.321247:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416379 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.322962:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416379 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.322976:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416379 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.322985:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416379 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.322991:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416379 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.322997:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416379 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323025:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.323048:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416372 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323053:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416372 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.323055:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002561.323059:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416372 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.323061:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416379 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323066:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002561.323067:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed382166c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002561.323070:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416372 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.323071:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416379 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.323079:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416379 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323079:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416372 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.323147:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c400/0x7cee4af578415c1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.323158:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c400/0x7cee4af578415c1e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002561.323233:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454c3b80/2, rc 0, transno 4294969899 00000100:00100000:3.0:1786002561.323252:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561010432:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786002561.323458:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:0.0:1786002561.323462:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.323519:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416372 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323527:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416372 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1550:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323549:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578416364 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323556:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578416364 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323562:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578416364 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323568:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578416364 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323573:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.323576:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578416364 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323583:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578416364 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323591:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.323593:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.323596:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578416364 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323608:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4a00/0x7cee4af578416364 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.323618:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c823c8ec reply state 00000000d3b2d508 transno 4294984016 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841636b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323628:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841636b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.323634:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x40eea295 (ffff9ed2456efc00) 00010000:00010000:0.0:1786002561.323637:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.323639:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.323725:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+157:19370:x1872758530984960:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 3053us (3977us total) trans 4294984016 rc 0/0 00000100:00100000:0.0:1786002561.323735:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24066 00010000:00010000:1.0:1786002561.325574:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xcad70079 (ffff9ed24559f100) 00010000:00010000:1.0:1786002561.325578:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.325584:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c400/0x7cee4af578415c1e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325593:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c400/0x7cee4af578415c1e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325625:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db200/0x7cee4af578415c41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325632:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db200/0x7cee4af578415c41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325638:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db200/0x7cee4af578415c41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325644:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455db200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.325647:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db200/0x7cee4af578415c41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325654:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db200/0x7cee4af578415c41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325662:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x71408f79 (ffff9ed2456c9200) 00010000:00010000:1.0:1786002561.325664:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.325667:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db200/0x7cee4af578415c41 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325672:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db200/0x7cee4af578415c41 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325686:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b200/0x7cee4af578415c64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325693:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b200/0x7cee4af578415c64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325700:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b200/0x7cee4af578415c64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325705:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24577b200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.325708:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b200/0x7cee4af578415c64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325713:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b200/0x7cee4af578415c64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325720:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa2c3e279 (ffff9ed24556e800) 00010000:00010000:1.0:1786002561.325722:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.325725:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b200/0x7cee4af578415c64 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325732:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577b200/0x7cee4af578415c64 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325746:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570cc00/0x7cee4af578415c87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325752:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570cc00/0x7cee4af578415c87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325758:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570cc00/0x7cee4af578415c87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325763:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.325766:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570cc00/0x7cee4af578415c87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325775:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570cc00/0x7cee4af578415c87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325782:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x77cd7179 (ffff9ed24559f400) 00010000:00010000:1.0:1786002561.325785:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.325788:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570cc00/0x7cee4af578415c87 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325793:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570cc00/0x7cee4af578415c87 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325805:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da600/0x7cee4af578415caa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325810:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da600/0x7cee4af578415caa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325816:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da600/0x7cee4af578415caa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325820:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455da600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.325823:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da600/0x7cee4af578415caa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325828:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da600/0x7cee4af578415caa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325836:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe58bac79 (ffff9ed2456c9000) 00010000:00010000:1.0:1786002561.325838:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.325841:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da600/0x7cee4af578415caa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325862:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da600/0x7cee4af578415caa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325875:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ccd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325882:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ccd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325887:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ccd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325892:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24577a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.325894:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ccd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325899:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ccd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325905:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8bf53b79 (ffff9ed24556e300) 00010000:00010000:1.0:1786002561.325908:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.325910:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ccd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325915:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a200/0x7cee4af578415ccd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325941:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbe00/0x7cee4af578415cf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325948:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbe00/0x7cee4af578415cf0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325954:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbe00/0x7cee4af578415cf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325959:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455dbe00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.325962:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbe00/0x7cee4af578415cf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325968:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbe00/0x7cee4af578415cf0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325976:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa6a2e1ce (ffff9ed2456c9f00) 00010000:00010000:1.0:1786002561.325978:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.325981:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbe00/0x7cee4af578415cf0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325987:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dbe00/0x7cee4af578415cf0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.325999:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da200/0x7cee4af578415d13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326005:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da200/0x7cee4af578415d13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326011:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da200/0x7cee4af578415d13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326016:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455da200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326019:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da200/0x7cee4af578415d13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326029:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da200/0x7cee4af578415d13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326036:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x4d0c70ce (ffff9ed2456c9a00) 00010000:00010000:1.0:1786002561.326038:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326182:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da200/0x7cee4af578415d13 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326189:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da200/0x7cee4af578415d13 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326204:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d600/0x7cee4af578415d36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326210:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d600/0x7cee4af578415d36 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326216:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d600/0x7cee4af578415d36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326220:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570d600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326223:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d600/0x7cee4af578415d36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326228:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d600/0x7cee4af578415d36 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326236:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe8b99bce (ffff9ed24559fd00) 00010000:00010000:1.0:1786002561.326238:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326241:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d600/0x7cee4af578415d36 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326247:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d600/0x7cee4af578415d36 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326258:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415d59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326263:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415d59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326268:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415d59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326273:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326275:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415d59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326280:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415d59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326286:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x91a3d2ce (ffff9ed24556e000) 00010000:00010000:1.0:1786002561.326287:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326290:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415d59 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326294:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0600/0x7cee4af578415d59 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326308:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af578415d7c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326314:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af578415d7c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326320:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af578415d7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326326:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed340031c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326328:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af578415d7c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326335:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af578415d7c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326342:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa0d0fdce (ffff9ed24556ef00) 00010000:00010000:1.0:1786002561.326344:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326346:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af578415d7c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326351:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340031c00/0x7cee4af578415d7c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326365:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570da00/0x7cee4af578415d9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326371:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570da00/0x7cee4af578415d9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326376:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570da00/0x7cee4af578415d9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326381:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326384:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570da00/0x7cee4af578415d9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326394:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570da00/0x7cee4af578415d9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326401:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x95b00cce (ffff9ed24559f800) 00010000:00010000:1.0:1786002561.326403:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326405:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570da00/0x7cee4af578415d9f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326411:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570da00/0x7cee4af578415d9f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326424:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578415dc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326430:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578415dc2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326435:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578415dc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326440:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326443:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578415dc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326448:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578415dc2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326455:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd0dd37ce (ffff9ed351207700) 00010000:00010000:1.0:1786002561.326458:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326461:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578415dc2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326467:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4600/0x7cee4af578415dc2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326478:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415de5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326484:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415de5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326500:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415de5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326507:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326510:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415de5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326516:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415de5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326524:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x77c76ece (ffff9ed366e57e00) 00010000:00010000:1.0:1786002561.326526:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326529:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415de5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326535:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d000/0x7cee4af578415de5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326547:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415e08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326553:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415e08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326560:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415e08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326566:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326568:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415e08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326575:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415e08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326581:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe585a9ce (ffff9ed366e57800) 00010000:00010000:1.0:1786002561.326583:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326586:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415e08 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326592:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570ca00/0x7cee4af578415e08 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326602:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db400/0x7cee4af578415e2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326608:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db400/0x7cee4af578415e2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326615:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db400/0x7cee4af578415e2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326620:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455db400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326622:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db400/0x7cee4af578415e2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326633:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db400/0x7cee4af578415e2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326640:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x4de4b8ce (ffff9ed2456c9600) 00010000:00010000:1.0:1786002561.326642:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326645:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db400/0x7cee4af578415e2b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326651:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db400/0x7cee4af578415e2b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326661:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578415e4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326667:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578415e4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326673:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578415e4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326678:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2423b4c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326681:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578415e4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326687:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578415e4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326692:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5501ae7b (ffff9ed351207500) 00010000:00010000:1.0:1786002561.326694:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326697:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578415e4e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326702:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4c00/0x7cee4af578415e4e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326711:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415e71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326717:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415e71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326722:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415e71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326726:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455da800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326729:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415e71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326734:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415e71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326739:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb3d7b (ffff9ed2456c9b00) 00010000:00010000:1.0:1786002561.326741:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326743:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415e71 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326748:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da800/0x7cee4af578415e71 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326757:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dae00/0x7cee4af578415e94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326763:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dae00/0x7cee4af578415e94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326768:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dae00/0x7cee4af578415e94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326774:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455dae00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326776:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dae00/0x7cee4af578415e94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326782:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dae00/0x7cee4af578415e94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326789:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x170e687b (ffff9ed2456c9c00) 00010000:00010000:1.0:1786002561.326791:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326794:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dae00/0x7cee4af578415e94 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326799:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dae00/0x7cee4af578415e94 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326810:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415eb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326815:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415eb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326820:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415eb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326825:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed24570dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326827:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415eb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326836:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415eb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326843:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x95f89f7b (ffff9ed366e57100) 00010000:00010000:1.0:1786002561.326869:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326872:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415eb7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326879:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570dc00/0x7cee4af578415eb7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326893:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998600/0x7cee4af578415eda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326899:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998600/0x7cee4af578415eda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326905:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998600/0x7cee4af578415eda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326910:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326913:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998600/0x7cee4af578415eda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326919:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998600/0x7cee4af578415eda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326926:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd905ca7b (ffff9ed366e57300) 00010000:00010000:1.0:1786002561.326928:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326931:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998600/0x7cee4af578415eda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326937:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998600/0x7cee4af578415eda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326948:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999800/0x7cee4af578415efd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326954:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999800/0x7cee4af578415efd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326959:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999800/0x7cee4af578415efd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326964:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.326967:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999800/0x7cee4af578415efd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326973:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999800/0x7cee4af578415efd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326978:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xee04d97b (ffff9ed366e57500) 00010000:00010000:1.0:1786002561.326980:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.326982:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999800/0x7cee4af578415efd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326987:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999800/0x7cee4af578415efd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.326999:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999e00/0x7cee4af578415f20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327004:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999e00/0x7cee4af578415f20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327010:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999e00/0x7cee4af578415f20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327016:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327019:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999e00/0x7cee4af578415f20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327025:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999e00/0x7cee4af578415f20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327032:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xdfb2047b (ffff9ed2434dfc00) 00010000:00010000:1.0:1786002561.327034:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327036:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999e00/0x7cee4af578415f20 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327042:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999e00/0x7cee4af578415f20 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327054:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578415f43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327060:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578415f43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327066:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578415f43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327071:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327073:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578415f43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327082:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578415f43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327090:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x869c3b7b (ffff9ed2434df100) 00010000:00010000:1.0:1786002561.327092:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327095:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578415f43 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327101:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578415f43 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327113:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415f66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327120:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415f66 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327126:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415f66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327131:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2455da000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327134:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415f66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327139:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415f66 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327147:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x9bba767b (ffff9ed366c05c00) 00010000:00010000:1.0:1786002561.327149:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327151:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415f66 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327158:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da000/0x7cee4af578415f66 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327172:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415f89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327178:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415f89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327182:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415f89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327187:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327189:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415f89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327195:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415f89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327203:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8b9857b (ffff9ed366c05400) 00010000:00010000:1.0:1786002561.327204:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327207:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415f89 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327212:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578415f89 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327225:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578415fac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327231:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578415fac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327237:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578415fac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327242:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327245:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578415fac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327251:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578415fac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327258:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb4d1abd0 (ffff9ed351207800) 00010000:00010000:1.0:1786002561.327260:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327263:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578415fac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327269:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578415fac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327280:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415fcf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327286:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415fcf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327292:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415fcf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327296:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327299:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415fcf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327309:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415fcf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327316:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7db3ad0 (ffff9ed2434dfa00) 00010000:00010000:1.0:1786002561.327318:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327320:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415fcf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327326:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578415fcf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327339:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578415ff2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327345:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578415ff2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327351:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578415ff2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327356:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327359:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578415ff2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327365:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578415ff2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327372:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x798865d0 (ffff9ed2456ef700) 00010000:00010000:1.0:1786002561.327374:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327377:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578415ff2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327383:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578415ff2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327394:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416015 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327399:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416015 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327405:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416015 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327410:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327412:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416015 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327417:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416015 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327423:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa0729cd0 (ffff9ed2456ef300) 00010000:00010000:1.0:1786002561.327425:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327427:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416015 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327432:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416015 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327443:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af578416038 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327448:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af578416038 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327454:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af578416038 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327459:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327461:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af578416038 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327466:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af578416038 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327472:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe37fc7d0 (ffff9ed366c05d00) 00010000:00010000:1.0:1786002561.327474:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327477:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af578416038 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327483:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af578416038 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327506:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af57841605b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327513:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af57841605b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327520:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af57841605b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327525:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327528:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af57841605b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327539:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af57841605b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327545:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x507ed6d0 (ffff9ed2434df500) 00010000:00010000:1.0:1786002561.327547:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327550:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af57841605b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327556:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af57841605b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327567:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841607e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327574:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841607e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327580:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841607e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327585:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327587:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841607e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327592:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841607e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327597:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xea2c01d0 (ffff9ed24556ec00) 00010000:00010000:1.0:1786002561.327599:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327602:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841607e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327607:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841607e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327619:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784160a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327625:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784160a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327630:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784160a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327636:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327638:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784160a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327644:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784160a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327649:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe91638d0 (ffff9ed366c05800) 00010000:00010000:1.0:1786002561.327651:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327653:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784160a1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327658:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784160a1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327668:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784160c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327673:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784160c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327680:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784160c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327684:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327687:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784160c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327691:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784160c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327697:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xfe3473d0 (ffff9ed366c05f00) 00010000:00010000:1.0:1786002561.327699:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327701:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784160c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327706:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784160c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327716:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784160e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327721:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784160e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327727:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784160e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327731:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327734:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784160e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327743:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784160e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327750:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x133382d0 (ffff9ed24556e200) 00010000:00010000:1.0:1786002561.327752:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327754:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784160e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327760:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784160e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327773:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af57841610a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327778:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af57841610a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327784:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af57841610a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327788:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327791:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af57841610a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327797:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af57841610a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327804:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xeedd9295 (ffff9ed366c05600) 00010000:00010000:1.0:1786002561.327806:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327809:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af57841610a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327814:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af57841610a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327826:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841612d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327832:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841612d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327838:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841612d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327843:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327865:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841612d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327872:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841612d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327878:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6be72195 (ffff9ed366c05900) 00010000:00010000:1.0:1786002561.327880:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327882:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841612d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327887:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841612d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327899:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416150 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327905:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416150 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327912:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416150 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327916:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327919:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416150 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327924:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416150 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327930:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6d724c95 (ffff9ed2434df200) 00010000:00010000:1.0:1786002561.327932:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327935:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416150 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327940:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416150 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327949:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416173 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327954:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416173 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327960:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416173 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327964:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.327967:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416173 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327976:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416173 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327983:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6a5c8395 (ffff9ed2456ef800) 00010000:00010000:1.0:1786002561.327985:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.327987:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416173 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.327992:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416173 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328003:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af578416196 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328009:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af578416196 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328014:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af578416196 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328019:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.328022:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af578416196 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328028:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af578416196 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328034:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x609ae95 (ffff9ed24206ac00) 00010000:00010000:1.0:1786002561.328036:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.328039:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af578416196 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328045:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af578416196 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328058:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784161b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328064:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784161b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328070:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784161b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328075:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.328077:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784161b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328083:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784161b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328091:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x9d08bd95 (ffff9ed2456ef100) 00010000:00010000:1.0:1786002561.328093:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.328096:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784161b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328102:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784161b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328113:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784161dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328119:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784161dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328126:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784161dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328131:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.328134:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784161dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328139:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784161dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328146:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x3615e895 (ffff9ed2456efa00) 00010000:00010000:1.0:1786002561.328148:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.328151:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784161dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328157:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af5784161dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328169:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784161ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328175:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784161ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328180:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784161ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328185:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.328188:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784161ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328197:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784161ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328204:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb3001f95 (ffff9ed2434dff00) 00010000:00010000:1.0:1786002561.328206:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.328208:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784161ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328214:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784161ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328224:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416222 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328229:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416222 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328234:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416222 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328239:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.328241:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416222 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328246:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416222 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328251:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x35965a95 (ffff9ed343228600) 00010000:00010000:1.0:1786002561.328253:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.328255:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416222 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328261:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416222 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328272:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416245 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328277:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416245 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328282:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416245 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328287:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.328290:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416245 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328295:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416245 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328300:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x74956995 (ffff9ed24206a500) 00010000:00010000:1.0:1786002561.328303:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.328305:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416245 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328310:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416245 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328321:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416261 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328327:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416261 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328333:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416261 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328338:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.328340:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416261 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328345:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416261 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328351:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8b93e778 (ffff9ed245e35500) 00010000:00010000:1.0:1786002561.328353:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.328355:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416261 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328361:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416261 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8b93e778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328372:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af57841627d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328378:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af57841627d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328383:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af57841627d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328387:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.328390:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af57841627d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328398:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af57841627d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328404:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x53a9537d (ffff9ed245e35b00) 00010000:00010000:1.0:1786002561.328406:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.328408:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af57841627d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328412:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af57841627d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x53a9537d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328423:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416299 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328428:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416299 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328434:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416299 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328438:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.328440:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416299 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328445:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416299 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328451:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x756ed0d2 (ffff9ed2456f9000) 00010000:00010000:1.0:1786002561.328453:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.328455:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416299 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328461:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416299 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x756ed0d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328474:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784162b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328479:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784162b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328484:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784162b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.328488:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002561.339996:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1550:0x0].0x0 (ffff9ed2456ef400) 00010000:00010000:2.0:1786002561.340007:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.340024:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416379 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.340036:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416379 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1550:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.340071:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.340073:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.340076:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.348586:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784162b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348604:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784162b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348624:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd3ce983f (ffff9ed2456f9900) 00010000:00010000:1.0:1786002561.348627:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.348632:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784162b5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348640:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c400/0x7cee4af5784162b5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd3ce983f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348675:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348681:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348689:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348695:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.348697:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348702:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348710:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xdb9e9594 (ffff9ed2456f9c00) 00010000:00010000:1.0:1786002561.348712:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.348715:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348722:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af5784162d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xdb9e9594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348735:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784162ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348742:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784162ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348748:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784162ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348753:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.348756:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784162ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348767:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784162ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348774:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe663f479 (ffff9ed245ddc600) 00010000:00010000:1.0:1786002561.348776:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.348779:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784162ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348786:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784162ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe663f479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348800:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416309 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348807:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416309 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348813:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416309 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348819:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.348821:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416309 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348827:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416309 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348833:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xf8b3f1ce (ffff9ed245e35600) 00010000:00010000:1.0:1786002561.348836:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.348839:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416309 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348867:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416309 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xf8b3f1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348883:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416325 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348889:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416325 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348894:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416325 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348899:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.348902:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416325 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348907:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416325 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348914:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7d12be7b (ffff9ed245fede00) 00010000:00010000:1.0:1786002561.348916:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.348919:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416325 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348924:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c000/0x7cee4af578416325 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7d12be7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348940:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578416341 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348947:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578416341 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348953:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578416341 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348958:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c8c200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.348961:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578416341 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348967:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578416341 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348975:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6e2bbd0 (ffff9ed245fed100) 00010000:00010000:1.0:1786002561.348978:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.348980:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578416341 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.348986:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8c200/0x7cee4af578416341 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6e2bbd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002561.398700:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.399571:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530985216 00000100:00100000:0.0:1786002561.399582:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530985216 00000100:00100000:0.0:1786002561.399649:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24067 00000100:00100000:0.0:1786002561.399660:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+102:19370:x1872758530985216:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.399716:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.399742:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578415621 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1551:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad7d expref: 102 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.399762:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff9ed2456f9f00) 00010000:00010000:0.0:1786002561.399773:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.399796:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416380 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.399812:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416380 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.399821:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416380 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.399836:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af578416387 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xea16437d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.399843:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af578416387 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.399892:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af578416387 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.399948:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841638e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.399956:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841638e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.399963:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841638e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.400180:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2507, 64 off168640 00010000:00010000:0.0:1786002561.400240:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416395 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400250:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416395 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400258:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416395 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400266:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416395 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400273:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416395 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400280:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416395 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400301:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.400318:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841638e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400324:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841638e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400330:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841638e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400336:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.400340:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841638e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400347:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841638e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400355:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002561.400358:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.400362:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841638e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.400366:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.400372:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416395 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400372:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841638e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1551:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.400379:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.400382:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416395 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.400387:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416395 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400387:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416380 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400393:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416380 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.400397:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1551:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:2.0:1786002561.400399:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002561.400399:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416380 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.400402:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416395 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400405:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416380 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.400408:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416395 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1551:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400410:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed382166c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.400413:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416380 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.400419:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.400419:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416380 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.400421:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.400422:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.400426:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.400428:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.400431:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416380 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400436:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416380 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.400445:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c45e8f8 reply state 0000000012e7f845 transno 4294984017 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af578416387 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400456:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af578416387 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.400461:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xea16437d (ffff9ed2456eff00) 00010000:00010000:0.0:1786002561.400464:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.400466:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.400551:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+103:19370:x1872758530985216:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 892us (1859us total) trans 4294984017 rc 0/0 00000100:00100000:0.0:1786002561.400559:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24067 00000100:00100000:2.0:1786002561.412238:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002561.412887:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530985472 00000100:00100000:3.0:1786002561.412897:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530985472 00000100:00100000:3.0:1786002561.412956:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24068 00000100:00100000:3.0:1786002561.412974:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+103:19370:x1872758530985472:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002561.413031:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002561.413056:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b200/0x7cee4af578415644 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1552:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad84 expref: 103 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413075:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff9ed245ddcc00) 00010000:00010000:3.0:1786002561.413084:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002561.413105:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af57841639c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413116:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af57841639c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413124:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af57841639c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413135:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620600/0x7cee4af5784163a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x9897527d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413142:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620600/0x7cee4af5784163a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413147:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620600/0x7cee4af5784163a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413196:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163aa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413202:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413207:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002561.413407:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 64 off8576 00010000:00010000:3.0:1786002561.413463:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784163b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413471:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784163b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413479:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784163b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413487:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784163b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413503:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784163b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413509:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784163b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413773:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002561.413792:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413798:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163aa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413804:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413810:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.413815:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413822:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163aa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413839:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff9ed24206a600) 00010000:00010000:3.0:1786002561.413842:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002561.413874:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163aa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413882:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163aa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1552:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413897:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af57841639c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413903:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af57841639c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413908:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af57841639c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413913:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af57841639c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413918:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.413920:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af57841639c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413925:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af57841639c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413931:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002561.413933:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002561.413936:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af57841639c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413946:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af57841639c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002561.413955:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082879cc5 reply state 0000000022339880 transno 4294984018 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620600/0x7cee4af5784163a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413972:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620600/0x7cee4af5784163a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.413977:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x9897527d (ffff9ed24206a200) 00010000:00010000:3.0:1786002561.413979:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002561.413982:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002561.414166:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+104:19370:x1872758530985472:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1200us (1936us total) trans 4294984018 rc 0/0 00000100:00100000:3.0:1786002561.414174:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24068 00010000:00010000:2.0:1786002561.419386:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.419399:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784163b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.419410:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.419415:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784163b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.419424:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784163b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.419441:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1552:0x0].0x0 (ffff9ed24206a600) 00010000:00010000:2.0:1786002561.419444:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.419449:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784163b1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.419455:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784163b1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1552:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.419478:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.419480:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.419481:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002561.428314:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.428427:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530985728 00000100:00100000:0.0:1786002561.428436:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530985728 00000100:00100000:0.0:1786002561.428502:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24069 00000100:00100000:0.0:1786002561.428512:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+104:19370:x1872758530985728:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.428568:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.428592:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b800/0x7cee4af578415667 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1553:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad8b expref: 104 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.428609:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff9ed245ddc000) 00010000:00010000:0.0:1786002561.428618:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.428638:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784163b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.428650:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784163b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.428659:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784163b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.428676:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784163bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe423257d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.428682:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784163bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.428688:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784163bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.428933:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784163c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.428943:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784163c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.428950:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784163c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.434463:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2508, 64 off168704 00010000:00010000:0.0:1786002561.434581:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784163cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.434597:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784163cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.434609:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784163cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.434618:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784163cd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.434626:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784163cd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.434633:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784163cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438673:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.438714:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784163c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438725:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784163c6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438732:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784163c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438738:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.438743:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784163c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438750:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784163c6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438764:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff9ed2456efa00) 00010000:00010000:0.0:1786002561.438768:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.438773:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784163c6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438779:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784163c6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1553:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438804:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784163b8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438815:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784163b8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438820:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784163b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438825:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784163b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438830:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.438832:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784163b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438838:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784163b8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438858:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.438860:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.438863:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784163b8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438869:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784163b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.438878:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e10862df reply state 0000000033f64b3a transno 4294984019 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784163bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438889:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784163bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.438897:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe423257d (ffff9ed2456ef000) 00010000:00010000:0.0:1786002561.438899:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.438902:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.439270:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+105:19370:x1872758530985728:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 10755us (10968us total) trans 4294984019 rc 0/0 00000100:00100000:0.0:1786002561.439278:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24069 00010000:00010000:2.0:1786002561.449128:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.449140:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784163cd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.449150:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.449154:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784163cd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.449163:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784163cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.449179:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1553:0x0].0x0 (ffff9ed2456efa00) 00010000:00010000:2.0:1786002561.449183:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.449186:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784163cd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.449193:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784163cd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1553:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.449210:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.449212:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.449213:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002561.468190:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002561.468276:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530985984 00000100:00100000:1.0:1786002561.468286:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530985984 00000100:00100000:1.0:1786002561.468348:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24070 00000100:00100000:1.0:1786002561.468357:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+105:19370:x1872758530985984:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002561.468409:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002561.468432:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af57841568a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1554:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad92 expref: 105 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468451:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff9ed2456f9d00) 00010000:00010000:1.0:1786002561.468461:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002561.468481:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784163d4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468501:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784163d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468511:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784163d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468525:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af5784163db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468533:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af5784163db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468539:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af5784163db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468597:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784163e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468606:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784163e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468612:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784163e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002561.468810:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].7, 64 off8640 00010000:00010000:1.0:1786002561.468927:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784163e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468935:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784163e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468945:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784163e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468951:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784163e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.468958:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784163e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469152:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784163e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469173:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002561.469190:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784163e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469196:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784163e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469202:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784163e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469207:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.469211:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784163e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469218:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784163e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469225:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff9ed343228700) 00010000:00010000:1.0:1786002561.469228:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002561.469232:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784163e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469237:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784163e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1554:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469252:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784163d4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469258:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784163d4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469263:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784163d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469268:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784163d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469272:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.469274:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784163d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469280:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784163d4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469286:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002561.469288:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002561.469354:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.469360:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784163e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.469366:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.469370:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784163e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.469376:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784163e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.469384:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1554:0x0].0x0 (ffff9ed343228700) 00010000:00010000:2.0:1786002561.469386:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.469389:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784163e9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.469394:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784163e9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1554:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.469407:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.469409:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.469410:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.469431:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784163d4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469438:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784163d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002561.469447:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000480226c2 reply state 00000000c46fc759 transno 4294984020 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af5784163db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469458:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af5784163db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.469463:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x970cb47d (ffff9ed343228600) 00010000:00010000:1.0:1786002561.469466:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002561.469468:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002561.469542:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+106:19370:x1872758530985984:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1185us (1361us total) trans 4294984020 rc 0/0 00000100:00100000:1.0:1786002561.469550:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24070 00000100:00100000:1.0:1786002561.496625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002561.496707:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530986240 00000100:00100000:3.0:1786002561.496716:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530986240 00000100:00100000:3.0:1786002561.496775:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24071 00000100:00100000:3.0:1786002561.496785:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+106:19370:x1872758530986240:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002561.496838:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002561.496900:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ac00/0x7cee4af5784156ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1555:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad99 expref: 106 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.496922:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff9ed245ddcf00) 00010000:00010000:3.0:1786002561.496933:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002561.496965:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784163f0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.496983:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784163f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.496992:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784163f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497007:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497024:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497031:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497089:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af5784163fe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497097:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af5784163fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497103:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af5784163fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002561.497313:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2509, 64 off168768 00010000:00010000:3.0:1786002561.497379:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416405 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497388:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416405 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497396:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416405 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497403:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416405 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497410:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416405 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497416:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416405 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497439:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002561.497455:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af5784163fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497462:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af5784163fe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497623:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af5784163fe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497630:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.497634:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af5784163fe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497642:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af5784163fe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497651:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff9ed24206a900) 00010000:00010000:3.0:1786002561.497654:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002561.497658:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af5784163fe lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497667:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af5784163fe lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1555:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497683:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784163f0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497689:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784163f0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497695:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784163f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497701:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784163f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497705:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.497708:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784163f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497714:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784163f0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497721:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002561.497723:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002561.497726:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784163f0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497731:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784163f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002561.497742:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b568a36 reply state 000000005bde88c7 transno 4294984021 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497753:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.497759:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5239df7d (ffff9ed24206a100) 00010000:00010000:3.0:1786002561.497762:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002561.497764:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002561.497926:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+107:19370:x1872758530986240:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1141us (1307us total) trans 4294984021 rc 0/0 00010000:00010000:2.0:1786002561.497926:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.497932:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416405 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002561.497934:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24071 00010000:00010000:2.0:1786002561.497938:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.497941:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416405 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.497947:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416405 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.497957:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1555:0x0].0x0 (ffff9ed24206a900) 00010000:00010000:2.0:1786002561.497959:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.497962:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416405 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.497978:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416405 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1555:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.497991:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.497993:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.497994:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002561.526666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.526900:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530986496 00000100:00100000:0.0:1786002561.526911:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530986496 00000100:00100000:0.0:1786002561.526961:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24072 00000100:00100000:0.0:1786002561.526980:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+107:19370:x1872758530986496:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.527057:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.527084:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228600/0x7cee4af5784156d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1556:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ada0 expref: 107 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527103:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff9ed2456f9e00) 00010000:00010000:0.0:1786002561.527114:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.527137:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841640c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527150:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841640c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527160:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841640c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527173:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578416413 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527179:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578416413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527190:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578416413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527239:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841641a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527246:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841641a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527252:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841641a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.527456:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].8, 64 off8704 00010000:00010000:0.0:1786002561.527529:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416421 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527538:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416421 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527544:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416421 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527552:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416421 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527557:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416421 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.527563:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416421 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528056:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.528075:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841641a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528083:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841641a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528090:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841641a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528095:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.528100:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841641a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528107:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841641a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528117:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff9ed2456ef800) 00010000:00010000:0.0:1786002561.528119:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.528123:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841641a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528128:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841641a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1556:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528144:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841640c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528150:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841640c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528156:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841640c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528165:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841640c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528170:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.528173:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841640c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528178:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841640c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528184:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.528186:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.528189:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841640c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528193:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841640c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.528201:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c392213a reply state 00000000c5d31ad7 transno 4294984022 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578416413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528210:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578416413 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.528215:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa5436e7d (ffff9ed2456ef100) 00010000:00010000:0.0:1786002561.528217:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.528219:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.528285:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+108:19370:x1872758530986496:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1306us (1627us total) trans 4294984022 rc 0/0 00000100:00100000:0.0:1786002561.531059:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24072 00010000:00010000:2.0:1786002561.537060:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.537073:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416421 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.537085:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.537089:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416421 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.537099:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416421 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.537125:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1556:0x0].0x0 (ffff9ed2456ef800) 00010000:00010000:2.0:1786002561.537129:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.537133:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416421 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.537140:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416421 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1556:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.537163:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.537165:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.537167:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002561.543646:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002561.544214:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530986752 00000100:00100000:1.0:1786002561.544223:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530986752 00000100:00100000:1.0:1786002561.544280:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24073 00000100:00100000:1.0:1786002561.544289:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+108:19370:x1872758530986752:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002561.544349:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002561.544373:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b200/0x7cee4af5784156f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1557:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ada7 expref: 108 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.544392:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff9ed245fed800) 00010000:00010000:1.0:1786002561.544402:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002561.544421:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af578416428 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.544434:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af578416428 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.544443:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af578416428 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.544456:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af57841642f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xead1417d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.544463:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af57841642f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.544469:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af57841642f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.544532:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416436 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.544541:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416436 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.544547:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416436 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002561.544753:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2510, 64 off168832 00010000:00010000:1.0:1786002561.544812:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841643d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.544829:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841643d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.544837:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841643d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.544844:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841643d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545020:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841643d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545027:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841643d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545084:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002561.545102:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416436 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545109:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416436 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545115:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416436 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545120:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.545124:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416436 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545130:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416436 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545138:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff9ed343228e00) 00010000:00010000:1.0:1786002561.545141:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002561.545144:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416436 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545150:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416436 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1557:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545164:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af578416428 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545174:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af578416428 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545179:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af578416428 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545184:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af578416428 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545188:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.545191:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af578416428 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545195:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af578416428 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545201:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002561.545203:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.545206:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af578416428 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545211:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af578416428 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002561.545218:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dabd159 reply state 00000000d951cd3c transno 4294984023 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af57841642f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545227:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af57841642f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.545232:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xead1417d (ffff9ed343228200) 00010000:00010000:1.0:1786002561.545235:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002561.545238:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002561.545305:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+109:19370:x1872758530986752:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1016us (1666us total) trans 4294984023 rc 0/0 00000100:00100000:1.0:1786002561.545312:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24073 00010000:00010000:0.0:1786002561.559220:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002561.559232:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841643d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.559242:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002561.559246:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841643d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.559256:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841643d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.559273:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1557:0x0].0x0 (ffff9ed343228e00) 00010000:00010000:0.0:1786002561.559276:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002561.559281:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841643d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.559287:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841643d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1557:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.559315:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.559317:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.559319:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002561.580435:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002561.580525:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530987008 00000100:00100000:3.0:1786002561.580534:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530987008 00000100:00100000:3.0:1786002561.580595:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24074 00000100:00100000:3.0:1786002561.580604:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+109:19370:x1872758530987008:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002561.580658:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002561.580683:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8ce00/0x7cee4af578415716 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1558:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adae expref: 109 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.580701:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff9ed245e35c00) 00010000:00010000:3.0:1786002561.580710:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002561.580743:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416444 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.580755:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416444 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.580764:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416444 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.580781:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af57841644b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.580787:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af57841644b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.580793:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af57841644b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.580903:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416452 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.580912:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416452 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.580919:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416452 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002561.581413:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].9, 64 off8768 00010000:00010000:3.0:1786002561.581467:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416459 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581475:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416459 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581483:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416459 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581498:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416459 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581504:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416459 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581511:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416459 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581531:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002561.581549:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416452 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581555:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416452 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581561:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416452 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581567:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.581571:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416452 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581578:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416452 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581586:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff9ed24206a300) 00010000:00010000:3.0:1786002561.581589:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002561.581592:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416452 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581597:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af578416452 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1558:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581612:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416444 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581622:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416444 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581627:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416444 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581632:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416444 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581636:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.581639:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416444 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581644:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416444 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581650:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002561.581653:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002561.581655:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416444 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581661:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416444 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002561.581669:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000171b9dc5 reply state 00000000979b04f3 transno 4294984024 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af57841644b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581678:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af57841644b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.581684:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7d30507d (ffff9ed24206ae00) 00010000:00010000:3.0:1786002561.581686:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002561.581689:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002561.581759:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+110:19370:x1872758530987008:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1156us (1331us total) trans 4294984024 rc 0/0 00000100:00100000:3.0:1786002561.581767:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24074 00010000:00010000:2.0:1786002561.582071:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.582078:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416459 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.582084:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.582087:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416459 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.582094:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416459 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.582103:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1558:0x0].0x0 (ffff9ed24206a300) 00010000:00010000:2.0:1786002561.582106:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.582108:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416459 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.582114:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416459 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1558:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.582126:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.582128:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.582130:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002561.619170:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.619259:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530987264 00000100:00100000:0.0:1786002561.619267:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530987264 00000100:00100000:0.0:1786002561.619324:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24075 00000100:00100000:0.0:1786002561.619334:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+110:19370:x1872758530987264:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.619386:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.619410:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229200/0x7cee4af578415739 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1559:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adb5 expref: 110 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619433:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff9ed2456f9b00) 00010000:00010000:0.0:1786002561.619443:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.619462:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416460 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619474:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416460 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619483:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416460 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619503:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af578416467 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619510:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af578416467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619516:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af578416467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619569:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841646e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619577:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841646e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619584:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841646e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.619796:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2511, 64 off168896 00010000:00010000:0.0:1786002561.619914:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416475 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619923:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416475 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619930:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416475 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619937:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416475 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619943:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416475 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619948:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416475 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619958:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.619981:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841646e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619987:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841646e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619992:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841646e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.619998:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.620003:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841646e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620009:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841646e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620017:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:0.0:1786002561.620020:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.620023:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841646e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620029:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841646e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1559:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620042:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416460 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620048:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416460 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620053:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416460 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620057:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416460 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620061:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.620064:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416460 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620069:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416460 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620075:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.620077:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.620080:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416460 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620089:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416460 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.620097:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb263214 reply state 00000000fffdcfb8 transno 4294984025 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af578416467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620106:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af578416467 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.620112:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa468b7d (ffff9ed2456ef300) 00010000:00010000:0.0:1786002561.620114:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.620116:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.620175:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+111:19370:x1872758530987264:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 842us (1013us total) trans 4294984025 rc 0/0 00000100:00100000:0.0:1786002561.620182:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24075 00010000:00010000:2.0:1786002561.620326:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.620332:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416475 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.620338:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.620342:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416475 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.620348:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416475 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.620357:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1559:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:2.0:1786002561.620359:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.620362:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416475 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.620367:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416475 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1559:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.620379:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.620381:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.620382:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002561.664049:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002561.664133:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530987520 00000100:00100000:2.0:1786002561.664141:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530987520 00000100:00100000:2.0:1786002561.664201:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24076 00000100:00100000:2.0:1786002561.664212:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+111:19370:x1872758530987520:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002561.664268:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002561.664304:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8cc00/0x7cee4af57841575c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adbc expref: 111 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664323:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:2.0:1786002561.664334:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002561.664355:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af57841647c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664367:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af57841647c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664377:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af57841647c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664390:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d800/0x7cee4af578416483 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664397:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d800/0x7cee4af578416483 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664403:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d800/0x7cee4af578416483 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664459:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841648a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664467:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841648a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664475:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841648a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002561.664683:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].10, 64 off8832 00010000:00010000:2.0:1786002561.664741:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416491 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664750:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416491 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664757:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416491 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664765:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416491 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664771:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416491 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664777:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416491 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664799:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002561.664816:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841648a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664822:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841648a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664828:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841648a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664834:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002561.664838:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841648a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664882:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841648a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664891:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff9ed37f5a4800) 00010000:00010000:2.0:1786002561.664893:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002561.664896:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841648a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664901:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841648a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664914:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af57841647c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664919:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af57841647c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664923:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af57841647c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664928:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af57841647c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664931:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002561.664934:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af57841647c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664938:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af57841647c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664943:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002561.664944:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002561.664947:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af57841647c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664957:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af57841647c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002561.664965:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049d5932a reply state 00000000eabf2d4a transno 4294984026 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d800/0x7cee4af578416483 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664975:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d800/0x7cee4af578416483 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.664981:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xdf501a7d (ffff9ed37f5a4000) 00010000:00010000:2.0:1786002561.664984:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002561.664986:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002561.665047:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+112:19370:x1872758530987520:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 836us (1006us total) trans 4294984026 rc 0/0 00000100:00100000:2.0:1786002561.665054:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24076 00010000:00010000:0.0:1786002561.665277:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002561.665283:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416491 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.665297:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002561.665300:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416491 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.665307:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416491 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.665316:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155a:0x0].0x0 (ffff9ed37f5a4800) 00010000:00010000:0.0:1786002561.665318:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002561.665321:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416491 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.665327:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416491 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.665338:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.665340:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.665342:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002561.679363:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.679467:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530987776 00000100:00100000:0.0:1786002561.679476:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530987776 00000100:00100000:0.0:1786002561.679553:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24077 00000100:00100000:0.0:1786002561.679564:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+112:19370:x1872758530987776:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.679622:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.679648:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2ae00/0x7cee4af57841577f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adc3 expref: 112 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.679672:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff9ed245ddcb00) 00010000:00010000:0.0:1786002561.679682:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.679705:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416498 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.679718:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416498 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.679728:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416498 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.679742:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841649f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.679753:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841649f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.679760:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841649f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.679816:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784164a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.679824:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784164a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.679843:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784164a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.680121:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2512, 64 off168960 00010000:00010000:0.0:1786002561.680186:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af5784164ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680194:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af5784164ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680202:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af5784164ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680209:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af5784164ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680216:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af5784164ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680223:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af5784164ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680246:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.680264:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784164a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680270:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784164a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680276:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784164a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680281:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.680285:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784164a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680292:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784164a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680301:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff9ed2456efb00) 00010000:00010000:0.0:1786002561.680304:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.680307:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784164a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680313:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784164a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680327:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416498 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680334:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416498 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680344:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416498 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680350:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416498 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680356:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.680359:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416498 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680365:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416498 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.680366:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.680376:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af5784164ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680379:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.680386:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002561.680390:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002561.680391:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416498 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.680396:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af5784164ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680403:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af578416498 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.680410:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af5784164ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.680417:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6c1174c reply state 000000003921b0a4 transno 4294984027 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841649f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.680423:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155b:0x0].0x0 (ffff9ed2456efb00) 00010000:00010000:2.0:1786002561.680428:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002561.680429:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841649f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.680433:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af5784164ad lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680440:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8b6840d2 (ffff9ed2456ef400) 00010000:00010000:2.0:1786002561.680443:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af5784164ad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.680444:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.680450:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002561.680462:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.680465:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.680467:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002561.680543:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+113:19370:x1872758530987776:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 980us (1188us total) trans 4294984027 rc 0/0 00000100:00100000:0.0:1786002561.680551:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24077 00000100:00100000:2.0:1786002561.690707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002561.693616:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530988032 00000100:00100000:1.0:1786002561.693630:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530988032 00000100:00100000:1.0:1786002561.693744:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24078 00000100:00100000:1.0:1786002561.693754:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+113:19370:x1872758530988032:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002561.693807:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002561.693839:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f800/0x7cee4af5784157a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adca expref: 113 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.693872:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff9ed245e35200) 00010000:00010000:1.0:1786002561.693883:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002561.693903:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164b4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.693915:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.693924:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.693936:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784164bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.693943:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784164bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.693950:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784164bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.693998:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694004:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694011:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002561.694197:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].11, 64 off8896 00010000:00010000:1.0:1786002561.694258:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784164c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694267:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784164c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694274:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784164c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694280:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784164c9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694287:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784164c9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694294:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784164c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694320:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002561.694335:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694341:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164c2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694347:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694353:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.694357:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694364:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164c2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694371:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff9ed343228c00) 00010000:00010000:1.0:1786002561.694373:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002561.694376:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164c2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694382:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164c2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694397:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164b4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694403:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164b4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694408:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694418:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694423:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.694426:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694431:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164b4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694437:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002561.694439:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.694441:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164b4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694447:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002561.694455:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c63a064 reply state 00000000e310773b transno 4294984028 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784164bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694464:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784164bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.694469:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa0674fd2 (ffff9ed343228d00) 00010000:00010000:1.0:1786002561.694471:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002561.694473:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002561.694774:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+114:19370:x1872758530988032:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1020us (4075us total) trans 4294984028 rc 0/0 00000100:00100000:1.0:1786002561.694781:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24078 00010000:00010000:3.0:1786002561.694839:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002561.694858:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784164c9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.694865:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002561.694869:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784164c9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.694876:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784164c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.694885:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155c:0x0].0x0 (ffff9ed343228c00) 00010000:00010000:3.0:1786002561.694887:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002561.694890:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784164c9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.694896:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af5784164c9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.694909:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.694910:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.694912:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002561.712388:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002561.712477:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530988288 00000100:00100000:3.0:1786002561.712494:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530988288 00000100:00100000:3.0:1786002561.712557:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24079 00000100:00100000:3.0:1786002561.712566:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+114:19370:x1872758530988288:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002561.712639:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002561.712666:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7f600/0x7cee4af5784157c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3add1 expref: 114 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.712686:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff9ed245e35800) 00010000:00010000:3.0:1786002561.712696:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002561.712717:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784164d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.712730:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784164d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.712739:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784164d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.712753:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784164d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.712760:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784164d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.712767:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784164d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.712822:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af5784164de lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.712842:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af5784164de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.712895:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af5784164de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002561.713116:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2513, 64 off169024 00010000:00010000:3.0:1786002561.713184:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784164e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713193:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784164e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713201:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784164e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713208:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784164e5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713214:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784164e5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713221:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784164e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713245:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002561.713262:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af5784164de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713269:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af5784164de lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713275:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af5784164de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713280:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.713284:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af5784164de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713291:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af5784164de lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713298:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff9ed24206af00) 00010000:00010000:3.0:1786002561.713301:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002561.713304:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af5784164de lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713309:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af5784164de lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713324:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784164d0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713329:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784164d0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713334:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784164d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713338:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784164d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713343:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.713345:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784164d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713350:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784164d0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713357:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002561.713359:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002561.713361:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784164d0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713367:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af5784164d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002561.713375:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e29ac953 reply state 000000007544210e transno 4294984029 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784164d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713384:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784164d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.713390:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x65f522d2 (ffff9ed24206ab00) 00010000:00010000:3.0:1786002561.713392:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002561.713394:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002561.713462:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+115:19370:x1872758530988288:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 896us (1080us total) trans 4294984029 rc 0/0 00000100:00100000:3.0:1786002561.713469:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24079 00010000:00010000:2.0:1786002561.713809:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.713815:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784164e5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.713822:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.713825:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784164e5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.713831:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784164e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.713840:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155d:0x0].0x0 (ffff9ed24206af00) 00010000:00010000:2.0:1786002561.713843:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.713871:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784164e5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.713877:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784164e5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.713890:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.713892:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.713893:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002561.737095:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002561.737192:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530988544 00000100:00100000:1.0:1786002561.737201:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530988544 00000100:00100000:1.0:1786002561.737300:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24080 00000100:00100000:1.0:1786002561.737310:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+115:19370:x1872758530988544:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002561.737363:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002561.737390:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a200/0x7cee4af5784157e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3add8 expref: 115 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.737413:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff9ed245ddc400) 00010000:00010000:1.0:1786002561.737423:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002561.737465:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.737520:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.737530:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.737567:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.737586:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.737595:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.737680:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784164fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.737693:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784164fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.737700:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784164fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002561.737973:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].12, 64 off8960 00010000:00010000:1.0:1786002561.738038:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416501 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738047:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416501 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738055:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416501 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738061:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416501 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738067:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416501 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738072:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416501 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738087:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002561.738104:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784164fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738110:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784164fa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738119:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784164fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738125:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.738128:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784164fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738134:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784164fa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738141:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff9ed343228500) 00010000:00010000:1.0:1786002561.738144:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002561.738148:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784164fa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738153:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af5784164fa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738168:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164ec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738175:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164ec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738180:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738185:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738190:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.738194:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738199:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164ec lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738207:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002561.738209:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.738212:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164ec lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738219:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784164ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002561.738228:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbd5f55b reply state 0000000011060148 transno 4294984030 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738238:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.738243:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x38feb1d2 (ffff9ed343228a00) 00010000:00010000:1.0:1786002561.738246:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002561.738248:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002561.738309:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+116:19370:x1872758530988544:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 999us (1222us total) trans 4294984030 rc 0/0 00000100:00100000:1.0:1786002561.738316:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24080 00010000:00010000:0.0:1786002561.738905:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002561.738912:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416501 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.738918:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002561.738922:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416501 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.738929:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416501 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.738939:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155e:0x0].0x0 (ffff9ed343228500) 00010000:00010000:0.0:1786002561.738941:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002561.738944:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416501 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.738950:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416501 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.738963:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.738965:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.738967:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002561.754663:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002561.754795:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530988800 00000100:00100000:1.0:1786002561.754804:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530988800 00000100:00100000:1.0:1786002561.754904:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24081 00000100:00100000:1.0:1786002561.754915:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+116:19370:x1872758530988800:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002561.754996:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002561.755030:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229000/0x7cee4af57841580b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x155f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3addf expref: 116 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755048:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff9ed351207000) 00010000:00010000:1.0:1786002561.755058:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002561.755080:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416508 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755093:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416508 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755102:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416508 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755115:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841650f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755122:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841650f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755129:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841650f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755185:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416516 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755193:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416516 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755200:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416516 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002561.755411:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2514, 64 off169088 00010000:00010000:1.0:1786002561.755475:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841651d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755485:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841651d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755503:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841651d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755510:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841651d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755516:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841651d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755522:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841651d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755552:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002561.755570:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416516 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755577:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416516 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755584:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416516 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755590:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.755594:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416516 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755601:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416516 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755610:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff9ed343228500) 00010000:00010000:1.0:1786002561.755612:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002561.755615:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416516 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755621:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af578416516 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x155f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755635:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416508 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755641:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416508 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755646:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416508 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755651:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416508 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755656:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.755658:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416508 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755663:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416508 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755670:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002561.755673:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.755676:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416508 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755681:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af578416508 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002561.755690:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c47d2eb6 reply state 00000000a90a5bf6 transno 4294984031 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841650f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755700:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841650f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.755704:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7c0bdcd2 (ffff9ed343228f00) 00010000:00010000:1.0:1786002561.755706:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002561.755708:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002561.755764:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+117:19370:x1872758530988800:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 851us (1109us total) trans 4294984031 rc 0/0 00000100:00100000:1.0:1786002561.755771:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24081 00010000:00010000:2.0:1786002561.756298:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.756305:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841651d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.756312:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.756315:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841651d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.756321:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841651d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.756331:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x155f:0x0].0x0 (ffff9ed343228500) 00010000:00010000:2.0:1786002561.756333:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.756336:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841651d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.756342:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841651d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x155f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.756356:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.756358:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.756359:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002561.770405:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.770509:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530989056 00000100:00100000:0.0:1786002561.770519:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530989056 00000100:00100000:0.0:1786002561.770586:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24082 00000100:00100000:0.0:1786002561.770596:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+117:19370:x1872758530989056:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.770655:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.770683:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5aa00/0x7cee4af57841582e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1560:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ade6 expref: 117 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.770703:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff9ed245fedb00) 00010000:00010000:0.0:1786002561.770715:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.770736:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416524 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.770748:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416524 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.770756:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416524 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.770769:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841652b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.770776:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841652b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.770782:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841652b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.770885:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416532 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.770893:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416532 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.770900:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416532 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.771401:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].13, 64 off9024 00010000:00010000:0.0:1786002561.771465:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416539 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771524:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416539 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771577:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416539 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771585:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416539 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771591:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416539 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771597:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416539 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771645:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.771662:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416532 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771668:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416532 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771675:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416532 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771681:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.771685:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416532 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771693:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416532 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771702:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:0.0:1786002561.771704:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.771708:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416532 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771714:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416532 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1560:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771729:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416524 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771734:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416524 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771740:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416524 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771746:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416524 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771751:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.771754:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416524 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771759:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416524 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771765:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.771767:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.771770:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416524 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771780:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416524 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.771788:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000895a5e40 reply state 0000000059b0df71 transno 4294984032 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841652b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771798:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841652b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.771804:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x27156bd2 (ffff9ed2456efb00) 00010000:00010000:0.0:1786002561.771806:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.771808:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.771976:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+118:19370:x1872758530989056:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1380us (1579us total) trans 4294984032 rc 0/0 00000100:00100000:0.0:1786002561.771983:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24082 00000100:00100000:0.0:1786002561.776118:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002561.776231:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530989312 00000100:00100000:3.0:1786002561.776240:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530989312 00000100:00100000:3.0:1786002561.776295:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24083 00000100:00100000:3.0:1786002561.776306:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+118:19370:x1872758530989312:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002561.776359:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002561.776384:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2be00/0x7cee4af578415851 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1561:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aded expref: 118 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776406:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff9ed245ddc700) 00010000:00010000:3.0:1786002561.776416:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002561.776437:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416540 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776449:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416540 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776458:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416540 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776483:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416547 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776498:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776504:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776567:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841654e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776574:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841654e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776580:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841654e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002561.776776:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2515, 64 off169152 00010000:00010000:3.0:1786002561.776879:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af578416555 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776889:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af578416555 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776897:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af578416555 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776904:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af578416555 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776910:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af578416555 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.776916:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af578416555 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.779642:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002561.779666:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416539 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.779679:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.779683:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416539 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.779693:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416539 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.779708:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1560:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:2.0:1786002561.779711:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.779715:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416539 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.779722:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416539 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1560:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.779743:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.779748:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af578416555 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.779753:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.779756:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af578416555 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.779763:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af578416555 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.779770:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff9ed24206a300) 00010000:00010000:2.0:1786002561.779772:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.779775:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af578416555 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.779781:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.779783:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.779785:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.781619:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786002561.781630:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af578416555 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1561:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781670:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841654e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781679:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841654e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781686:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841654e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781692:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.781695:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841654e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781702:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841654e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781718:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1561:0x0].0x0 (ffff9ed24206a300) 00010000:00010000:3.0:1786002561.781721:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002561.781725:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841654e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781730:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841654e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1561:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781755:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416540 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781763:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416540 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781768:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416540 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781774:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416540 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781779:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.781782:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416540 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781788:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416540 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781796:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002561.781799:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002561.781802:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416540 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781811:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416540 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002561.781821:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffde2543 reply state 00000000c9beb76b transno 4294984033 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781843:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416547 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.781874:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xfd213ed2 (ffff9ed24206af00) 00010000:00010000:3.0:1786002561.781876:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002561.781879:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002561.781966:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+119:19370:x1872758530989312:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 5658us (5852us total) trans 4294984033 rc 0/0 00000100:00100000:3.0:1786002561.781976:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24083 00010000:00010000:0.0:1786002561.785966:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002561.802209:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.802309:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530989568 00000100:00100000:0.0:1786002561.802318:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530989568 00000100:00100000:0.0:1786002561.802380:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24084 00000100:00100000:0.0:1786002561.802391:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+119:19370:x1872758530989568:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.802447:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.802478:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5bc00/0x7cee4af578415874 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1562:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adf4 expref: 119 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.802506:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff9ed245fedf00) 00010000:00010000:0.0:1786002561.802519:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.802553:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af57841655c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.802566:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af57841655c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.802575:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af57841655c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.802589:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416563 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.802597:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416563 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.802604:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416563 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.802659:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841656a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.802667:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841656a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.802675:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841656a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.802953:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].14, 64 off9088 00010000:00010000:0.0:1786002561.803019:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416571 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803029:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416571 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803041:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416571 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803049:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416571 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803055:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416571 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803062:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416571 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803084:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.803102:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841656a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803108:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841656a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803114:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841656a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803121:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.803125:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841656a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803132:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841656a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803141:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff9ed2456efa00) 00010000:00010000:0.0:1786002561.803144:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.803147:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841656a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803153:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841656a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1562:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803169:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af57841655c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803175:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af57841655c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803181:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af57841655c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803186:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af57841655c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803191:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.803194:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af57841655c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803200:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af57841655c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803207:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.803210:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.803214:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af57841655c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803220:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af57841655c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.803230:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039083d46 reply state 00000000868f274a transno 4294984034 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416563 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803240:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416563 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.803246:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x81a24dd2 (ffff9ed2456ef800) 00010000:00010000:0.0:1786002561.803248:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.803250:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.803317:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+120:19370:x1872758530989568:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 928us (1116us total) trans 4294984034 rc 0/0 00000100:00100000:0.0:1786002561.803323:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24084 00010000:00010000:3.0:1786002561.803875:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002561.803881:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416571 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.803888:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002561.803891:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416571 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.803897:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416571 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.803908:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1562:0x0].0x0 (ffff9ed2456efa00) 00010000:00010000:3.0:1786002561.803910:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002561.803913:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416571 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.803918:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578416571 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1562:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.803932:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.803934:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.803936:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002561.814308:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002561.814388:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530989824 00000100:00100000:0.0:1786002561.814399:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530989824 00000100:00100000:0.0:1786002561.814462:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24085 00000100:00100000:0.0:1786002561.814473:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+120:19370:x1872758530989824:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002561.814549:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002561.814577:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7fa00/0x7cee4af578415897 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1563:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3adfb expref: 120 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.814594:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:0.0:1786002561.814604:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002561.814625:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416578 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.814637:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416578 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.814645:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416578 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.814662:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841657f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.814668:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841657f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.814674:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841657f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.814729:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578416586 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.814737:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578416586 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.814743:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578416586 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002561.815018:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2516, 64 off169216 00010000:00010000:0.0:1786002561.815086:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841658d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815094:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841658d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815102:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841658d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815109:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841658d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815116:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841658d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815122:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841658d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815149:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002561.815167:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578416586 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815174:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578416586 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815180:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578416586 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815185:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.815189:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578416586 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815197:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578416586 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815206:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:0.0:1786002561.815209:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002561.815212:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578416586 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815218:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578416586 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1563:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815233:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416578 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815244:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416578 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815249:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416578 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815256:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416578 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815260:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002561.815263:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416578 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815270:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416578 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815277:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002561.815279:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002561.815282:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416578 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815287:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416578 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002561.815296:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f1076eb reply state 00000000f9ad8e0d transno 4294984035 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841657f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815305:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841657f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.815311:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6cc088d2 (ffff9ed2456efa00) 00010000:00010000:0.0:1786002561.815314:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002561.815316:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002561.815377:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+121:19370:x1872758530989824:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 905us (1076us total) trans 4294984035 rc 0/0 00000100:00100000:0.0:1786002561.815384:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24085 00010000:00010000:3.0:1786002561.815584:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002561.815591:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841658d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.815598:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002561.815601:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841658d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.815607:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841658d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.815616:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1563:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:3.0:1786002561.815618:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002561.815621:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841658d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.815627:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af57841658d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1563:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.815640:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.815642:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.815644:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002561.825040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002561.825184:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530990080 00000100:00100000:3.0:1786002561.825194:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530990080 00000100:00100000:3.0:1786002561.825253:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24086 00000100:00100000:3.0:1786002561.825263:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+121:19370:x1872758530990080:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002561.825318:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002561.825343:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5b600/0x7cee4af5784158ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1564:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae02 expref: 121 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825359:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002561.825370:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002561.825390:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416594 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825401:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416594 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825410:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416594 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825424:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841659b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825431:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841659b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825437:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841659b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825503:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825510:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825520:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002561.825750:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].15, 64 off9152 00010000:00010000:3.0:1786002561.825816:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825826:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825834:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825841:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165a9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825870:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165a9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825878:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825895:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002561.825911:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825918:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165a2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825923:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825932:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.825936:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825942:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165a2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825950:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff9ed24206a900) 00010000:00010000:3.0:1786002561.825953:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002561.825956:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165a2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825962:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165a2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1564:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825978:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416594 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825984:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416594 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825989:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416594 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.825995:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416594 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.826000:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.826002:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416594 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.826158:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416594 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.826167:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002561.826169:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002561.826173:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416594 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.826178:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416594 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002561.826188:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a289accf reply state 00000000fdff3f1a transno 4294984036 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841659b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.826197:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841659b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.826204:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe9ca17d2 (ffff9ed24206a300) 00010000:00010000:3.0:1786002561.826206:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002561.826208:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002561.826873:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+122:19370:x1872758530990080:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1609us (1840us total) trans 4294984036 rc 0/0 00000100:00100000:3.0:1786002561.826882:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24086 00010000:00010000:2.0:1786002561.827009:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.827026:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.827033:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.827037:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.827044:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.827055:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1564:0x0].0x0 (ffff9ed24206a900) 00010000:00010000:2.0:1786002561.827057:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.827060:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165a9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.827066:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165a9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1564:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.827080:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.827083:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.827084:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002561.841108:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002561.841181:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530990336 00000100:00100000:1.0:1786002561.841190:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530990336 00000100:00100000:1.0:1786002561.841249:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24087 00000100:00100000:1.0:1786002561.841259:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+122:19370:x1872758530990336:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002561.841314:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002561.841340:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7ea00/0x7cee4af5784158dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1565:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae09 expref: 122 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841358:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff9ed244f15000) 00010000:00010000:1.0:1786002561.841367:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002561.841390:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af5784165b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841403:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af5784165b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841412:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af5784165b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841428:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784165b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa846083f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841434:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784165b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841441:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784165b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841520:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af5784165be lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841529:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af5784165be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841547:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af5784165be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002561.841760:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2517, 64 off169280 00010000:00010000:1.0:1786002561.841827:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784165c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841836:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784165c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841879:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784165c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841888:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784165c5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841894:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784165c5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841900:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784165c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841917:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002561.841935:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af5784165be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841940:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af5784165be lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841945:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af5784165be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841951:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.841954:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af5784165be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841960:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af5784165be lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841968:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff9ed343228e00) 00010000:00010000:1.0:1786002561.841970:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002561.841974:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af5784165be lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841979:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af5784165be lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1565:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.841994:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af5784165b0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.842000:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af5784165b0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.842005:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af5784165b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.842011:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af5784165b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.842016:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.842019:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af5784165b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.842025:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af5784165b0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.842032:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002561.842035:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.842038:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af5784165b0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.842043:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af5784165b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002561.842052:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000464a4b34 reply state 00000000a5fdbe0b transno 4294984037 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784165b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.842063:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784165b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.842069:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa846083f (ffff9ed343228c00) 00010000:00010000:1.0:1786002561.842071:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002561.842074:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002561.842138:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+123:19370:x1872758530990336:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 879us (1037us total) trans 4294984037 rc 0/0 00000100:00100000:1.0:1786002561.842145:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24087 00010000:00010000:3.0:1786002561.842401:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002561.842408:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784165c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.842415:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002561.842418:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784165c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.842425:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784165c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.842441:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1565:0x0].0x0 (ffff9ed343228e00) 00010000:00010000:3.0:1786002561.842443:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002561.842446:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784165c5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.842451:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af5784165c5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1565:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.842464:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.842466:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.842468:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002561.847073:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002561.847195:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530990592 00000100:00100000:2.0:1786002561.847204:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530990592 00000100:00100000:2.0:1786002561.847260:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24088 00000100:00100000:2.0:1786002561.847270:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+123:19370:x1872758530990592:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002561.847323:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002561.847346:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af578415900 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1566:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae10 expref: 123 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847361:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff9ed351207100) 00010000:00010000:2.0:1786002561.847370:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002561.847390:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784165cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847403:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784165cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847412:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784165cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847424:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784165d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847431:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784165d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847437:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784165d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847499:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784165da lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847506:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784165da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847513:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784165da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002561.847827:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].16, 64 off9216 00010000:00010000:2.0:1786002561.847930:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784165e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847940:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784165e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847951:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784165e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847959:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784165e1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847965:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784165e1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847971:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784165e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.847987:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002561.848003:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784165da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848010:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784165da lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848015:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784165da lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848021:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002561.848026:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784165da lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848033:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784165da lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848043:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff9ed37f5a4e00) 00010000:00010000:2.0:1786002561.848045:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002561.848049:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784165da lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848055:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784165da lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1566:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848070:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784165cc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848076:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784165cc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848082:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784165cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848087:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784165cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848092:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002561.848095:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784165cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848101:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784165cc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848109:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002561.848111:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002561.848114:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784165cc lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848119:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784165cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002561.848128:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036610b9e reply state 000000001c838259 transno 4294984038 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784165d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848138:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784165d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.848144:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb56f173f (ffff9ed37f5a4400) 00010000:00010000:2.0:1786002561.848146:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002561.848148:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002561.848298:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+124:19370:x1872758530990592:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1028us (1231us total) trans 4294984038 rc 0/0 00000100:00100000:2.0:1786002561.848306:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24088 00010000:00010000:3.0:1786002561.848369:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002561.848376:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784165e1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.848383:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2da00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002561.848386:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784165e1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.848393:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784165e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.848402:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1566:0x0].0x0 (ffff9ed37f5a4e00) 00010000:00010000:3.0:1786002561.848405:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002561.848407:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784165e1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.848412:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784165e1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1566:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.848423:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.848425:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.848426:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002561.859190:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002561.859301:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530990848 00000100:00100000:3.0:1786002561.859310:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530990848 00000100:00100000:3.0:1786002561.859368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24089 00000100:00100000:3.0:1786002561.859378:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+124:19370:x1872758530990848:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002561.859433:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002561.859458:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed340030200/0x7cee4af578415923 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1567:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae17 expref: 124 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.859497:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff9ed245fed400) 00010000:00010000:3.0:1786002561.859510:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002561.859530:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af5784165e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.859553:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af5784165e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.859563:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af5784165e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.859577:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.859584:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.859590:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.859647:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.859656:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.859662:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002561.859909:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2518, 64 off169344 00010000:00010000:3.0:1786002561.859976:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784165fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.859985:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784165fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.859993:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784165fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860000:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784165fd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860007:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784165fd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860027:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784165fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860044:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002561.860061:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860072:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165f6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860077:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860083:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.860087:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860093:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165f6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860101:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff9ed24206a500) 00010000:00010000:3.0:1786002561.860104:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002561.860108:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165f6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860114:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af5784165f6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1567:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860130:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af5784165e8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860135:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af5784165e8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860140:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af5784165e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860145:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af5784165e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860150:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.860153:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af5784165e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860158:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af5784165e8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860164:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002561.860166:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002561.860170:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af5784165e8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860176:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af5784165e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002561.860184:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff84e405 reply state 000000004b856c9a transno 4294984039 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860193:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.860199:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5432ea3f (ffff9ed24206a600) 00010000:00010000:3.0:1786002561.860201:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002561.860203:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002561.860267:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+125:19370:x1872758530990848:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 889us (1110us total) trans 4294984039 rc 0/0 00000100:00100000:3.0:1786002561.860274:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24089 00010000:00010000:2.0:1786002561.860776:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.860782:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784165fd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.860789:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.860793:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784165fd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.860799:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784165fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.860809:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1567:0x0].0x0 (ffff9ed24206a500) 00010000:00010000:2.0:1786002561.860812:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.860815:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784165fd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.860821:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784165fd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1567:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.860833:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.860835:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.860837:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002561.887606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002561.887688:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530991104 00000100:00100000:1.0:1786002561.887697:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530991104 00000100:00100000:1.0:1786002561.887757:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24090 00000100:00100000:1.0:1786002561.887767:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+125:19370:x1872758530991104:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002561.887824:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002561.887896:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e000/0x7cee4af578415946 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1568:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae1e expref: 125 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.887917:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff9ed244f15700) 00010000:00010000:1.0:1786002561.887927:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002561.887949:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416604 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.887962:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416604 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.887971:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416604 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.887986:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af57841660b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.887993:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af57841660b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.887999:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af57841660b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888062:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416612 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888071:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416612 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888078:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416612 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002561.888285:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].17, 64 off9280 00010000:00010000:1.0:1786002561.888347:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416619 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888355:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416619 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888362:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416619 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888369:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416619 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888375:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416619 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888381:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416619 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888402:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002561.888419:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416612 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888426:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416612 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888432:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416612 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888438:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.888442:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416612 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888449:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416612 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888457:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff9ed343228e00) 00010000:00010000:1.0:1786002561.888459:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002561.888463:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416612 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888469:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416612 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1568:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888483:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416604 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888504:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416604 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888509:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416604 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888515:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416604 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888520:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.888522:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416604 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888528:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416604 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888534:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002561.888536:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.888539:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416604 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888545:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416604 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002561.888554:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd089295 reply state 00000000fbf846f8 transno 4294984040 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af57841660b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888564:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af57841660b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.888570:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7f3c793f (ffff9ed343228700) 00010000:00010000:1.0:1786002561.888572:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002561.888575:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002561.888636:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+126:19370:x1872758530991104:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 869us (1037us total) trans 4294984040 rc 0/0 00000100:00100000:1.0:1786002561.888643:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24090 00010000:00010000:3.0:1786002561.888708:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002561.888714:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416619 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.888722:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002561.888726:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416619 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.888732:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416619 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.888741:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1568:0x0].0x0 (ffff9ed343228e00) 00010000:00010000:3.0:1786002561.888743:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002561.888746:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416619 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.888752:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416619 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1568:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.888766:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.888768:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002561.888770:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002561.898659:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786002561.898682:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561010688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002561.898749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002561.898945:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561010688 00000100:00100000:3.0:1786002561.898953:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561010688 00000100:00100000:3.0:1786002561.899001:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049 00000100:00100000:3.0:1786002561.899020:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561010688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002561.899052:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002561.899107:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561010688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002561.899114:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049 00000100:00100000:1.0:1786002561.900025:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561010688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002561.920918:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002561.921061:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530991360 00000100:00100000:2.0:1786002561.921070:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530991360 00000100:00100000:2.0:1786002561.921132:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24091 00000100:00100000:2.0:1786002561.921143:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+126:19370:x1872758530991360:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002561.921200:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002561.921226:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2b000/0x7cee4af578415969 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1569:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae25 expref: 126 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921249:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff9ed35363dc00) 00010000:00010000:2.0:1786002561.921259:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002561.921280:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416620 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921292:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416620 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921302:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416620 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921315:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af578416627 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921322:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af578416627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921328:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af578416627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921384:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af57841662e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921393:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af57841662e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921399:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af57841662e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002561.921630:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2519, 64 off169408 00010000:00010000:2.0:1786002561.921691:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af578416635 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921700:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af578416635 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921708:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af578416635 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921715:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af578416635 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921722:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af578416635 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921727:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af578416635 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921743:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002561.921759:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af57841662e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921766:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af57841662e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921776:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af57841662e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921782:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002561.921786:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af57841662e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921792:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af57841662e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921800:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff9ed37f5a4b00) 00010000:00010000:2.0:1786002561.921802:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002561.921806:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af57841662e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921812:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af57841662e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1569:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921979:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416620 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921987:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416620 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.921993:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416620 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.922000:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416620 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.922004:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002561.922008:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416620 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.922013:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416620 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.922022:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002561.922024:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002561.922028:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416620 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.922033:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416620 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002561.922043:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce3c19b5 reply state 00000000a5be9e0b transno 4294984041 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af578416627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.922053:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af578416627 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.922059:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x98e9a43f (ffff9ed37f5a4c00) 00010000:00010000:2.0:1786002561.922061:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002561.922063:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002561.922127:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+127:19370:x1872758530991360:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 985us (1217us total) trans 4294984041 rc 0/0 00000100:00100000:2.0:1786002561.922134:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24091 00010000:00010000:0.0:1786002561.922473:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002561.922480:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af578416635 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.922497:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002561.922501:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af578416635 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.922508:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af578416635 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.922518:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1569:0x0].0x0 (ffff9ed37f5a4b00) 00010000:00010000:0.0:1786002561.922521:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002561.922524:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af578416635 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.922541:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af578416635 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1569:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.922555:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.922557:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.922559:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002561.932067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002561.932179:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530991616 00000100:00100000:1.0:1786002561.932188:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530991616 00000100:00100000:1.0:1786002561.932246:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24092 00000100:00100000:1.0:1786002561.932256:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+127:19370:x1872758530991616:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002561.932307:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002561.932331:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1600/0x7cee4af57841598c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae2c expref: 127 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932352:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff9ed35363d100) 00010000:00010000:1.0:1786002561.932361:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002561.932382:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841663c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932394:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841663c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932403:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841663c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932421:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416643 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932427:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416643 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932432:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416643 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932501:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841664a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932508:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841664a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932514:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841664a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002561.932729:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].18, 64 off9344 00010000:00010000:1.0:1786002561.932793:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416651 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932803:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416651 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932810:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416651 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932816:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416651 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932822:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416651 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932840:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416651 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932885:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002561.932903:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841664a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932909:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841664a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932915:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841664a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932921:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.932925:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841664a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932932:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841664a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932940:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff9ed343228e00) 00010000:00010000:1.0:1786002561.932942:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002561.932945:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841664a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932950:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af57841664a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932965:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841663c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932975:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841663c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932981:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841663c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932987:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841663c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.932992:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.932994:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841663c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.933000:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841663c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.933007:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002561.933210:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.933216:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416651 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.933222:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.933226:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416651 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.933232:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416651 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.933241:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156a:0x0].0x0 (ffff9ed343228e00) 00010000:00010000:2.0:1786002561.933244:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.933247:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416651 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.933253:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416651 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.933267:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.933269:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.933270:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002561.933294:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.933299:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841663c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.933305:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af57841663c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002561.933315:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa0d9a38 reply state 00000000e9a06b13 transno 4294984042 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416643 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.933325:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416643 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.933331:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x43f3333f (ffff9ed343228500) 00010000:00010000:1.0:1786002561.933333:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002561.933336:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002561.933406:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+128:19370:x1872758530991616:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1151us (1345us total) trans 4294984042 rc 0/0 00000100:00100000:1.0:1786002561.933413:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24092 00000100:00100000:0.0:1786002561.948897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002561.949029:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530991872 00000100:00100000:3.0:1786002561.949039:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530991872 00000100:00100000:3.0:1786002561.949100:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24093 00000100:00100000:3.0:1786002561.949112:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+128:19370:x1872758530991872:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002561.949167:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002561.949193:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1a00/0x7cee4af5784159af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae33 expref: 128 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949215:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff9ed35363dd00) 00010000:00010000:3.0:1786002561.949225:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002561.949245:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416658 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949258:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416658 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949267:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416658 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949280:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af57841665f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949287:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af57841665f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949294:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af57841665f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949345:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416666 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949352:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416666 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949362:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416666 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002561.949583:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2520, 64 off169472 00010000:00010000:3.0:1786002561.949650:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af57841666d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949659:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af57841666d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949667:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af57841666d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949674:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af57841666d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949680:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af57841666d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949687:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af57841666d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949712:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002561.949729:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416666 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949735:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416666 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949741:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416666 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949751:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.949756:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416666 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949763:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416666 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949771:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:3.0:1786002561.949774:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002561.949778:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416666 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949783:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416666 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949799:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416658 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949806:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416658 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949811:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416658 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949816:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416658 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949821:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.949824:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416658 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949832:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416658 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949839:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002561.949841:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002561.949844:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416658 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949887:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af578416658 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002561.949898:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ad71e7b reply state 00000000596066e5 transno 4294984043 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af57841665f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949907:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af57841665f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.949913:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5ae1063f (ffff9ed24206ac00) 00010000:00010000:3.0:1786002561.949915:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002561.949917:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002561.949979:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+129:19370:x1872758530991872:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 868us (1090us total) trans 4294984043 rc 0/0 00000100:00100000:3.0:1786002561.949987:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24093 00010000:00010000:0.0:1786002561.950306:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002561.950313:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af57841666d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.950319:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002561.950323:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af57841666d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.950329:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af57841666d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.950339:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156b:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:0.0:1786002561.950341:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002561.950344:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af57841666d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.950350:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af57841666d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.950363:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.950364:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.950367:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002561.967947:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002561.968158:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530992128 00000100:00100000:3.0:1786002561.968168:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530992128 00000100:00100000:3.0:1786002561.968215:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24094 00000100:00100000:3.0:1786002561.968223:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+129:19370:x1872758530992128:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002561.968275:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002561.968299:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1400/0x7cee4af5784159d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae3a expref: 129 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968320:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff9ed35363d400) 00010000:00010000:3.0:1786002561.968330:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002561.968349:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af578416674 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968360:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af578416674 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968369:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af578416674 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968381:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841667b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968386:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841667b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968392:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841667b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968443:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416682 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968449:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416682 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968454:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416682 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002561.968902:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].19, 64 off9408 00010000:00010000:3.0:1786002561.968966:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416689 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968975:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416689 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968982:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416689 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968988:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416689 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968994:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416689 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.968999:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416689 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969025:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002561.969042:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416682 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969049:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416682 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969055:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416682 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969061:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.969066:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416682 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969073:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416682 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969083:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:3.0:1786002561.969085:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002561.969088:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416682 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969093:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af578416682 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969108:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af578416674 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969113:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af578416674 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969118:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af578416674 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969123:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af578416674 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969127:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002561.969130:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af578416674 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969135:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af578416674 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969141:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002561.969143:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002561.969145:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af578416674 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969154:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af578416674 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002561.969161:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3e1dc44 reply state 00000000038d64c0 transno 4294984044 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841667b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969171:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841667b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002561.969292:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6fe0153f (ffff9ed24206a400) 00010000:00010000:3.0:1786002561.969294:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002561.969297:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002561.969359:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+130:19370:x1872758530992128:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1136us (1420us total) trans 4294984044 rc 0/0 00000100:00100000:3.0:1786002561.969367:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24094 00010000:00010000:2.0:1786002561.969867:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002561.969874:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416689 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.969881:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002561.969885:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416689 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.969891:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416689 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.969901:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156c:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:2.0:1786002561.969903:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002561.969906:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416689 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.969913:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af578416689 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002561.969927:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.969928:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002561.969930:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002561.992247:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002561.992341:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530992384 00000100:00100000:1.0:1786002561.992350:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530992384 00000100:00100000:1.0:1786002561.992406:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24095 00000100:00100000:1.0:1786002561.992415:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+130:19370:x1872758530992384:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002561.992477:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002561.992509:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a400/0x7cee4af5784159f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae41 expref: 130 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.992528:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff9ed38214dc00) 00010000:00010000:1.0:1786002561.992548:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002561.992570:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416690 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.992582:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416690 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.992590:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416690 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.992605:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416697 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.992610:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416697 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.992620:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416697 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.992674:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af57841669e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.992682:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af57841669e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.992689:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af57841669e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002561.993223:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2521, 64 off169536 00010000:00010000:1.0:1786002561.993288:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784166a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993297:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784166a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993304:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784166a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993310:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784166a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993316:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784166a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993322:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784166a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993335:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002561.993354:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af57841669e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993359:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af57841669e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993365:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af57841669e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993370:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.993374:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af57841669e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993380:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af57841669e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993388:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff9ed366c05900) 00010000:00010000:1.0:1786002561.993391:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002561.993394:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af57841669e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993399:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af57841669e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993413:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416690 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993420:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416690 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993425:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416690 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993433:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416690 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993438:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002561.993440:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416690 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993445:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416690 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993452:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002561.993454:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002561.993456:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416690 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993462:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416690 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002561.993493:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000071e12 reply state 00000000b495aec3 transno 4294984045 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416697 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993504:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416697 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002561.993509:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa91e503f (ffff9ed343228e00) 00010000:00010000:1.0:1786002561.993512:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002561.993514:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002561.993664:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002561.993671:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784166a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.993677:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002561.993680:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784166a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.993687:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784166a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.993701:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156d:0x0].0x0 (ffff9ed366c05900) 00010000:00010000:0.0:1786002561.993703:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002561.993706:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784166a5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.993712:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af5784166a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002561.993727:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.993729:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002561.993730:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002561.994741:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+131:19370:x1872758530992384:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 2324us (2498us total) trans 4294984045 rc 0/0 00000100:00100000:1.0:1786002561.994751:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24095 00000100:00100000:0.0:1786002562.009074:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002562.009243:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530992640 00000100:00100000:2.0:1786002562.009252:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530992640 00000100:00100000:2.0:1786002562.009325:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24096 00000100:00100000:2.0:1786002562.009336:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+131:19370:x1872758530992640:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002562.009392:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002562.009417:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1800/0x7cee4af578415a18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae48 expref: 131 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.009440:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff9ed245ddce00) 00010000:00010000:2.0:1786002562.009450:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1786002562.009548:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786002562.009661:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af5784166ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.009676:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af5784166ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.009686:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af5784166ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.009701:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d600/0x7cee4af5784166b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.009709:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d600/0x7cee4af5784166b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.009716:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d600/0x7cee4af5784166b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.009770:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784166ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.009779:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784166ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.009786:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784166ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002562.010108:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].20, 64 off9472 00010000:00010000:2.0:1786002562.010178:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784166c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010187:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784166c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010194:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784166c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010201:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784166c1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010207:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784166c1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010213:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784166c1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010226:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002562.010243:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784166ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010249:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784166ba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010255:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784166ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010260:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.010264:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784166ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010271:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784166ba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010280:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff9ed37f5a4600) 00010000:00010000:2.0:1786002562.010282:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002562.010285:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784166ba lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010291:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af5784166ba lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010306:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af5784166ac lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010313:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af5784166ac lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010319:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af5784166ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010328:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af5784166ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010333:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.010336:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af5784166ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010342:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af5784166ac lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010350:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002562.010352:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002562.010356:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af5784166ac lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010362:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af5784166ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002562.010371:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eee3c5df reply state 0000000089116f2d transno 4294984046 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d600/0x7cee4af5784166b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010380:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d600/0x7cee4af5784166b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.010386:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xfc27df3f (ffff9ed37f5a4500) 00010000:00010000:2.0:1786002562.010388:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002562.010390:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002562.010475:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+132:19370:x1872758530992640:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1133us (1401us total) trans 4294984046 rc 0/0 00000100:00100000:2.0:1786002562.010482:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24096 00010000:00010000:0.0:1786002562.012586:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002562.012597:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784166c1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.012606:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2ce00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002562.012610:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784166c1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.012618:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784166c1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.012632:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156e:0x0].0x0 (ffff9ed37f5a4600) 00010000:00010000:0.0:1786002562.012635:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002562.012639:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784166c1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.012644:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784166c1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.012661:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.012663:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.012664:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.020184:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.020250:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530992896 00000100:00100000:0.0:1786002562.020259:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530992896 00000100:00100000:0.0:1786002562.020320:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24097 00000100:00100000:0.0:1786002562.020329:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+132:19370:x1872758530992896:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.020382:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.020406:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245e7e200/0x7cee4af578415a3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x156f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae4f expref: 132 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.020420:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff9ed244f15f00) 00010000:00010000:0.0:1786002562.020427:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.020443:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784166c8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.020453:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784166c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.020459:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784166c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.020468:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784166cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.020475:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784166cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.020481:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784166cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.020555:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784166d6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.020568:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784166d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.020575:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784166d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.020789:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2522, 64 off169600 00010000:00010000:0.0:1786002562.020969:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784166dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.020979:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784166dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.020987:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784166dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.020994:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784166dd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021000:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784166dd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021005:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784166dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021098:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.021118:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784166d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021127:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784166d6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021133:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784166d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021138:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.021142:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784166d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021148:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784166d6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021156:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff9ed245e35800) 00010000:00010000:0.0:1786002562.021159:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.021161:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784166d6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021167:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af5784166d6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x156f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021183:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784166c8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021189:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784166c8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021194:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784166c8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021199:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784166c8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021204:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.021207:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784166c8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021212:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784166c8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021218:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.021220:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.021223:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784166c8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021228:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784166c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.021235:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b74b28d2 reply state 0000000089e38abf transno 4294984047 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784166cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021244:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784166cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.021250:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6a358594 (ffff9ed245e35700) 00010000:00010000:0.0:1786002562.021252:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.021254:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.021315:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+133:19370:x1872758530992896:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 985us (1139us total) trans 4294984047 rc 0/0 00000100:00100000:0.0:1786002562.021322:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24097 00010000:00010000:2.0:1786002562.024736:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002562.024748:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784166dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.024759:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002562.024762:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784166dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.024772:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784166dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.024787:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x156f:0x0].0x0 (ffff9ed245e35800) 00010000:00010000:2.0:1786002562.024790:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002562.024794:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784166dd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.024801:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784166dd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x156f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.024880:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.024882:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.024884:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.026783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00010000:00010000:0.0:1786002562.027006:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.027137:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530993152 00000100:00100000:1.0:1786002562.027146:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530993152 00000100:00100000:0.0:1786002562.027298:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24098 00000100:00100000:0.0:1786002562.027309:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+133:19370:x1872758530993152:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.027365:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.027387:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8de00/0x7cee4af578415a5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1570:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae56 expref: 133 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.027404:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff9ed244f15b00) 00010000:00010000:0.0:1786002562.027412:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.027430:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784166e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.027440:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784166e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.027448:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784166e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.027461:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af5784166eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.027480:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af5784166eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.027493:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af5784166eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.027559:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784166f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.027567:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784166f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.027574:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784166f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.027782:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].21, 64 off9536 00010000:00010000:0.0:1786002562.027978:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af5784166f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.027987:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af5784166f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.027995:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af5784166f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028002:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af5784166f9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028069:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af5784166f9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028078:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af5784166f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028142:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.028161:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784166f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028167:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784166f2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028173:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784166f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028187:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.028191:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784166f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028199:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784166f2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028208:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:0.0:1786002562.028211:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.028214:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784166f2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028220:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784166f2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1570:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028237:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784166e4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028242:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784166e4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028247:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784166e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028251:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784166e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028256:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.028258:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784166e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028263:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784166e4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028270:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.028272:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.028275:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784166e4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028279:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2600/0x7cee4af5784166e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.028287:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000637e30bc reply state 000000006d05b348 transno 4294984048 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af5784166eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028296:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af5784166eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.028301:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x3f3f1494 (ffff9ed245e35200) 00010000:00010000:0.0:1786002562.028304:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.028306:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.028368:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+134:19370:x1872758530993152:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1061us (1590us total) trans 4294984048 rc 0/0 00000100:00100000:0.0:1786002562.028376:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24098 00000100:00100000:3.0:1786002562.032655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002562.032786:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530993408 00000100:00100000:2.0:1786002562.032795:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530993408 00000100:00100000:2.0:1786002562.032887:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24099 00000100:00100000:2.0:1786002562.032898:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+134:19370:x1872758530993408:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002562.032968:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002562.032994:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0800/0x7cee4af578415a81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1571:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae5d expref: 134 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033030:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff9ed245ddc500) 00010000:00010000:2.0:1786002562.033040:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002562.033060:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416700 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033071:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416700 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033079:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416700 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033091:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416707 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033097:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416707 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033102:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416707 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033150:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af57841670e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033157:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af57841670e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033163:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af57841670e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002562.033362:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2523, 64 off169664 00010000:00010000:2.0:1786002562.033425:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af578416715 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033434:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af578416715 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033440:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af578416715 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033447:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af578416715 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033453:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af578416715 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.033457:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af578416715 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.033775:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002562.033783:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af5784166f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.033791:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed382166c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.033794:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af5784166f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.033802:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af5784166f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.033813:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1570:0x0].0x0 (ffff9ed245e35e00) 00010000:00010000:1.0:1786002562.033816:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.033819:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af5784166f9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.033836:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af5784166f9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1570:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.033865:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.033869:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af578416715 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.033875:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2da00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.033878:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af578416715 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.033884:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af578416715 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.033891:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff9ed37f5a4900) 00010000:00010000:1.0:1786002562.033895:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.033898:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af578416715 lrc: 3/0,0 mode: --/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.033903:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.033904:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.033906:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.034135:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1786002562.034141:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af578416715 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1571:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034163:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af57841670e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034169:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af57841670e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034176:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af57841670e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034181:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.034184:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af57841670e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034190:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af57841670e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034198:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1571:0x0].0x0 (ffff9ed37f5a4900) 00010000:00010000:2.0:1786002562.034200:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002562.034203:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af57841670e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034209:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af57841670e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1571:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034227:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416700 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034232:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416700 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034237:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416700 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034242:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416700 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034247:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.034249:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416700 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034254:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416700 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034261:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002562.034264:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002562.034266:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416700 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034271:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416700 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002562.034279:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046c7b98d reply state 000000004081f87f transno 4294984049 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416707 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034288:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416707 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.034293:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x584c3f94 (ffff9ed37f5a4f00) 00010000:00010000:2.0:1786002562.034294:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002562.034297:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002562.034362:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+135:19370:x1872758530993408:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1465us (1714us total) trans 4294984049 rc 0/0 00000100:00100000:2.0:1786002562.034369:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24099 00010000:00010000:0.0:1786002562.035873:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.039433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.039548:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530993664 00000100:00100000:0.0:1786002562.039557:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530993664 00000100:00100000:0.0:1786002562.039611:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24100 00000100:00100000:0.0:1786002562.039621:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+135:19370:x1872758530993664:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.039691:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.039715:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0e00/0x7cee4af578415aa4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1572:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae64 expref: 135 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.039737:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff9ed24559fe00) 00010000:00010000:0.0:1786002562.039747:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.039769:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841671c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.039782:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841671c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.039792:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841671c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.039806:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578416723 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x55367694 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.039813:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578416723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.039820:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578416723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.039909:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841672a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.039917:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841672a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.039923:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841672a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.040375:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].22, 64 off9600 00010000:00010000:0.0:1786002562.040437:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578416731 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040446:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578416731 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040454:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578416731 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040461:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578416731 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040520:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578416731 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040527:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578416731 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040583:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.040601:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841672a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040608:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841672a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040614:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841672a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040620:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.040624:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841672a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040632:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841672a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040640:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff9ed245e35600) 00010000:00010000:0.0:1786002562.040643:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.040647:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841672a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040652:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841672a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1572:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040666:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841671c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040672:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841671c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040677:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841671c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040683:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841671c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040688:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.040691:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841671c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040697:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841671c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040704:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.040706:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.040709:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841671c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040715:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841671c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.040724:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021696b87 reply state 00000000b5ac9c16 transno 4294984050 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578416723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040746:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578416723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.040752:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x55367694 (ffff9ed245e35c00) 00010000:00010000:0.0:1786002562.040755:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.040757:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.041095:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+136:19370:x1872758530993664:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1203us (1397us total) trans 4294984050 rc 0/0 00000100:00100000:0.0:1786002562.041104:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24100 00010000:00010000:2.0:1786002562.042188:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002562.042197:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578416731 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.042206:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002562.042209:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578416731 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.042217:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578416731 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.042230:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1572:0x0].0x0 (ffff9ed245e35600) 00010000:00010000:2.0:1786002562.042233:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002562.042236:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578416731 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.042242:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578416731 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1572:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.042255:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.042257:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.042259:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.046329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.046408:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530993920 00000100:00100000:0.0:1786002562.046417:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530993920 00000100:00100000:0.0:1786002562.046472:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24101 00000100:00100000:0.0:1786002562.046482:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed35a45f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+136:19370:x1872758530993920:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.046629:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.046652:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b1000/0x7cee4af578415ac7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1573:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae6b expref: 136 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.046673:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff9ed24559fc00) 00010000:00010000:0.0:1786002562.046681:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.046703:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416738 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.046714:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416738 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.046722:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416738 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.046740:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841673f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.046747:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841673f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.046753:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841673f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.046805:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416746 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.046813:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416746 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.046820:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416746 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.047179:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2524, 64 off169728 00010000:00010000:0.0:1786002562.047243:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af57841674d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047253:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af57841674d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047260:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af57841674d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047268:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af57841674d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047275:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af57841674d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047282:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af57841674d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047337:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.047355:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416746 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047362:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416746 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047369:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416746 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047375:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.047379:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416746 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047386:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416746 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047394:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff9ed245e35500) 00010000:00010000:0.0:1786002562.047397:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.047401:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416746 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047407:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416746 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1573:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047422:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416738 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047433:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416738 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047439:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416738 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047445:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416738 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047450:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.047453:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416738 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047459:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416738 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047466:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.047468:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.047471:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416738 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047477:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416738 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.047496:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034e44e97 reply state 000000004ce7a194 transno 4294984051 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841673f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047507:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841673f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.047513:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xf0e3a194 (ffff9ed245e35b00) 00010000:00010000:0.0:1786002562.047516:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.047518:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.047590:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed35a45f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+137:19370:x1872758530993920:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1108us (1267us total) trans 4294984051 rc 0/0 00000100:00100000:0.0:1786002562.047597:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24101 00010000:00010000:1.0:1786002562.049554:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.049565:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af57841674d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.049574:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.049578:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af57841674d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.049586:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af57841674d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.049600:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1573:0x0].0x0 (ffff9ed245e35500) 00010000:00010000:1.0:1786002562.049603:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.049606:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af57841674d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.049612:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af57841674d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1573:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.049753:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.049756:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.049758:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.053824:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002562.053994:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530994176 00000100:00100000:2.0:1786002562.054004:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530994176 00000100:00100000:2.0:1786002562.054070:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24102 00000100:00100000:2.0:1786002562.054080:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+137:19370:x1872758530994176:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002562.054130:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002562.054152:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578415aea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1574:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae72 expref: 137 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054169:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff9ed244f15600) 00010000:00010000:2.0:1786002562.054179:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002562.054200:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416754 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054213:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416754 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054221:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416754 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054235:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af57841675b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054242:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af57841675b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054248:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af57841675b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054300:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af578416762 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054308:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af578416762 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054316:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af578416762 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002562.054541:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].23, 64 off9664 00010000:00010000:2.0:1786002562.054605:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af578416769 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054614:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af578416769 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054622:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af578416769 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054629:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af578416769 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054635:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af578416769 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054640:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af578416769 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054693:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002562.054711:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af578416762 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054717:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af578416762 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054724:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af578416762 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054730:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.054734:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af578416762 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054741:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af578416762 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054750:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff9ed37f5a4300) 00010000:00010000:2.0:1786002562.054752:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002562.054756:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af578416762 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054760:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af578416762 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1574:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054774:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416754 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054780:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416754 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054789:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416754 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054794:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416754 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054798:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.054801:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416754 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054806:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416754 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054812:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002562.054814:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002562.054816:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416754 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054821:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416754 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002562.054829:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d051ca2 reply state 000000002726b6a3 transno 4294984052 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af57841675b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054839:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af57841675b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.054874:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x2fe2b094 (ffff9ed37f5a4900) 00010000:00010000:2.0:1786002562.054877:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002562.054879:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002562.054944:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+138:19370:x1872758530994176:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 865us (1127us total) trans 4294984052 rc 0/0 00000100:00100000:2.0:1786002562.054952:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24102 00010000:00010000:0.0:1786002562.056080:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002562.056088:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af578416769 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.056096:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2cc00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002562.056099:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af578416769 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.056107:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af578416769 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.056118:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1574:0x0].0x0 (ffff9ed37f5a4300) 00010000:00010000:0.0:1786002562.056121:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002562.056124:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af578416769 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.056129:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af578416769 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1574:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.056142:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.056144:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.056146:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.064336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.064422:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530994432 00000100:00100000:0.0:1786002562.064433:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530994432 00000100:00100000:0.0:1786002562.064495:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24103 00000100:00100000:0.0:1786002562.064505:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+138:19370:x1872758530994432:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.064567:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.064591:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578415b0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1575:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae79 expref: 138 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.064609:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff9ed244f15800) 00010000:00010000:0.0:1786002562.064618:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.064637:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416770 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.064649:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416770 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.064658:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416770 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.064671:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416777 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.064678:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416777 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.064684:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416777 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.064738:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af57841677e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.064746:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af57841677e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.064752:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af57841677e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.064987:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2525, 64 off169792 00010000:00010000:0.0:1786002562.065057:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416785 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065066:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416785 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065074:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416785 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065081:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416785 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065086:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416785 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065092:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416785 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065115:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.065131:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af57841677e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065137:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af57841677e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065143:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af57841677e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065152:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.065156:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af57841677e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065162:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af57841677e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065170:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:0.0:1786002562.065173:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.065176:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af57841677e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065182:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af57841677e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1575:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065195:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416770 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065201:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416770 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065206:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416770 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065211:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416770 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065215:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.065217:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416770 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065227:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416770 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065233:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.065235:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.065238:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416770 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065243:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416770 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.065251:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005db9dac9 reply state 00000000f1fa30e2 transno 4294984053 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416777 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065260:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416777 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.065265:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xc8efdb94 (ffff9ed245e35300) 00010000:00010000:0.0:1786002562.065267:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.065270:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.065323:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+139:19370:x1872758530994432:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 819us (995us total) trans 4294984053 rc 0/0 00000100:00100000:0.0:1786002562.065330:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24103 00010000:00010000:3.0:1786002562.066233:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.066241:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416785 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.066248:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.066251:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416785 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.066257:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416785 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.066270:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1575:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:3.0:1786002562.066272:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.066275:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416785 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.066281:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416785 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1575:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.066294:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.066296:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.066297:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.072286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.072365:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530994688 00000100:00100000:0.0:1786002562.072374:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530994688 00000100:00100000:0.0:1786002562.072429:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24104 00000100:00100000:0.0:1786002562.072439:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+139:19370:x1872758530994688:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.072510:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.072547:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a800/0x7cee4af578415b30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1576:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae80 expref: 139 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.072571:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff9ed24559fa00) 00010000:00010000:0.0:1786002562.072580:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.072601:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841678c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.072614:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841678c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.072624:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841678c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.072638:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af578416793 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.072646:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af578416793 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.072653:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af578416793 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.072708:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af57841679a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.072717:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af57841679a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.072723:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af57841679a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.072962:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].24, 64 off9728 00010000:00010000:0.0:1786002562.073036:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784167a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073045:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784167a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073053:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784167a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073060:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784167a1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073066:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784167a1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073071:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784167a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073087:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.073102:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af57841679a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073108:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af57841679a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073114:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af57841679a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073120:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.073124:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af57841679a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073131:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af57841679a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073140:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff9ed245e35f00) 00010000:00010000:0.0:1786002562.073143:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.073146:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af57841679a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073152:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af57841679a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1576:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073165:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841678c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073172:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841678c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073177:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841678c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073183:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841678c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073188:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.073191:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841678c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073197:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841678c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073204:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.073206:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.073209:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841678c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073219:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841678c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.073228:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b026151a reply state 00000000162327fb transno 4294984054 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af578416793 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073238:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af578416793 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.073244:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x45da1294 (ffff9ed245e35900) 00010000:00010000:0.0:1786002562.073246:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.073249:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.073310:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+140:19370:x1872758530994688:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 872us (1032us total) trans 4294984054 rc 0/0 00000100:00100000:0.0:1786002562.073318:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24104 00010000:00010000:1.0:1786002562.073458:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.073464:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784167a1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.073471:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.073475:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784167a1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.073482:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784167a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.073502:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1576:0x0].0x0 (ffff9ed245e35f00) 00010000:00010000:1.0:1786002562.073505:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.073508:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784167a1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.073515:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784167a1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1576:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.073536:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.073538:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.073539:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.080502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002562.080622:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530994944 00000100:00100000:3.0:1786002562.080632:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530994944 00000100:00100000:3.0:1786002562.080688:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24105 00000100:00100000:3.0:1786002562.080699:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+140:19370:x1872758530994944:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002562.080753:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002562.080778:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578415b53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1577:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae87 expref: 140 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.080796:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff9ed244f15e00) 00010000:00010000:3.0:1786002562.080805:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002562.080825:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784167a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.080891:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784167a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.080902:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784167a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.080921:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af5784167af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.080928:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af5784167af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.080935:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af5784167af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.080988:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784167b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.080996:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784167b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081002:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784167b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002562.081217:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2526, 64 off169856 00010000:00010000:3.0:1786002562.081281:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784167bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081291:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784167bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081299:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784167bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081307:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784167bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081314:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784167bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081321:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784167bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081336:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002562.081351:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784167b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081357:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784167b6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081364:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784167b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081370:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002562.081374:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784167b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081382:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784167b6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081389:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff9ed24206a900) 00010000:00010000:3.0:1786002562.081392:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002562.081395:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784167b6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081401:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620400/0x7cee4af5784167b6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1577:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081417:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784167a8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081428:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784167a8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081434:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784167a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081440:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784167a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081445:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002562.081448:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784167a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081454:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784167a8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081461:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002562.081463:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002562.081466:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784167a8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081472:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620200/0x7cee4af5784167a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002562.081480:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062193087 reply state 00000000551ce600 transno 4294984055 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af5784167af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081503:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af5784167af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.081509:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd2f04d94 (ffff9ed24206a500) 00010000:00010000:3.0:1786002562.081512:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002562.081515:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002562.081680:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+141:19370:x1872758530994944:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 982us (1192us total) trans 4294984055 rc 0/0 00000100:00100000:3.0:1786002562.081688:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24105 00010000:00010000:1.0:1786002562.082237:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.082244:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784167bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.082250:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.082254:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784167bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.082260:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784167bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.082270:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1577:0x0].0x0 (ffff9ed24206a900) 00010000:00010000:1.0:1786002562.082273:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.082276:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784167bd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.082282:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35e00/0x7cee4af5784167bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1577:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.082295:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.082296:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.082298:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.090965:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002562.091097:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530995200 00000100:00100000:2.0:1786002562.091106:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530995200 00000100:00100000:2.0:1786002562.091167:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24106 00000100:00100000:2.0:1786002562.091177:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+141:19370:x1872758530995200:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002562.091233:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002562.091260:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dba00/0x7cee4af578415b76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1578:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae8e expref: 141 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091278:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff9ed244f15400) 00010000:00010000:2.0:1786002562.091288:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002562.091320:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167c4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091333:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091342:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167c4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091356:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af5784167cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091363:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af5784167cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091369:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af5784167cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091423:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784167d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091430:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784167d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091437:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784167d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002562.091674:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].25, 64 off9792 00010000:00010000:2.0:1786002562.091740:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091749:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091757:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091764:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167d9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091769:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167d9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091776:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091796:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002562.091813:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784167d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091824:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784167d2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091831:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784167d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091836:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.091840:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784167d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091890:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784167d2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091899:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff9ed37f5a4700) 00010000:00010000:2.0:1786002562.091902:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002562.091906:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784167d2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091912:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784167d2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1578:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091927:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167c4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091933:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167c4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091939:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167c4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091945:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091950:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.091953:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167c4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091958:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167c4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091966:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002562.091969:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002562.091971:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167c4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091977:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167c4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002562.091986:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005923323f reply state 00000000ec9fbb86 transno 4294984056 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af5784167cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.091996:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af5784167cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.092002:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7df9dc94 (ffff9ed37f5a4a00) 00010000:00010000:2.0:1786002562.092004:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002562.092006:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002562.092079:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+142:19370:x1872758530995200:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 902us (1120us total) trans 4294984056 rc 0/0 00000100:00100000:2.0:1786002562.092086:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24106 00010000:00010000:3.0:1786002562.092412:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.092419:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167d9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.092426:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.092429:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167d9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.092435:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.092445:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1578:0x0].0x0 (ffff9ed37f5a4700) 00010000:00010000:3.0:1786002562.092447:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.092450:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167d9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.092455:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167d9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1578:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.092467:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.092468:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.092470:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.100282:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002562.100356:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530995456 00000100:00100000:2.0:1786002562.100365:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530995456 00000100:00100000:2.0:1786002562.100424:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24107 00000100:00100000:2.0:1786002562.100433:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+142:19370:x1872758530995456:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002562.100504:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002562.100537:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a800/0x7cee4af578415b99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1579:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae95 expref: 142 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.100555:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff9ed38214d400) 00010000:00010000:2.0:1786002562.100565:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002562.100586:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784167e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.100598:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784167e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.100607:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784167e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.100620:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xda336479 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.100626:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.100632:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.100682:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af5784167ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.100689:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af5784167ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.100700:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af5784167ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002562.100964:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2527, 64 off169920 00000004:00080000:2.0:1786002562.100972:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 922282123528ns, next at 923282121319ns, rc = 0 00010000:00010000:2.0:1786002562.101045:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101054:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101061:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101067:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167f5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101074:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167f5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101081:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101095:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002562.101111:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af5784167ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101117:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af5784167ee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101122:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af5784167ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101128:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.101132:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af5784167ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101139:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af5784167ee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101146:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff9ed37f5a4200) 00010000:00010000:2.0:1786002562.101149:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002562.101152:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af5784167ee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101157:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af5784167ee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1579:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101170:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784167e0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101176:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784167e0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101181:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784167e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101186:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784167e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101191:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.101193:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784167e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101204:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784167e0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101211:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002562.101214:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002562.101217:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784167e0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101223:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784167e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002562.101232:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cb0e6ff reply state 0000000047c51e07 transno 4294984057 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101241:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.101247:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xda336479 (ffff9ed37f5a4d00) 00010000:00010000:2.0:1786002562.101249:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002562.101251:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002562.101312:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+143:19370:x1872758530995456:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 879us (1038us total) trans 4294984057 rc 0/0 00000100:00100000:2.0:1786002562.101319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24107 00010000:00010000:0.0:1786002562.101473:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002562.101480:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.101495:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002562.101498:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.101503:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.101512:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1579:0x0].0x0 (ffff9ed37f5a4200) 00010000:00010000:0.0:1786002562.101514:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002562.101517:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167f5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.101522:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af5784167f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1579:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.101542:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.101544:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.101545:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.107666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.107780:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530995712 00000100:00100000:0.0:1786002562.107790:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530995712 00000100:00100000:0.0:1786002562.107880:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24108 00000100:00100000:0.0:1786002562.107890:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+143:19370:x1872758530995712:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.107942:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.107967:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c200/0x7cee4af578415bbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ae9c expref: 143 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.107990:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff9ed24559f200) 00010000:00010000:0.0:1786002562.107999:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.108030:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784167fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108044:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784167fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108053:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784167fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108066:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af578416803 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108073:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af578416803 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108080:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af578416803 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108129:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841680a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108135:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841680a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108141:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841680a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.108327:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].26, 64 off9856 00010000:00010000:0.0:1786002562.108389:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416811 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108398:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416811 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108405:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416811 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108411:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416811 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108417:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416811 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108423:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416811 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108434:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.108448:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841680a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108454:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841680a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108460:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841680a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108480:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.108491:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841680a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108499:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841680a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108508:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff9ed245e35400) 00010000:00010000:0.0:1786002562.108511:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.108514:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841680a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.108521:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841680a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.108773:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.108779:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416811 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.108786:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.108790:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416811 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.108796:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416811 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.108806:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157a:0x0].0x0 (ffff9ed245e35400) 00010000:00010000:1.0:1786002562.108808:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.108811:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416811 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.108816:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416811 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.108838:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.108840:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.108842:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.109196:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784167fc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.109204:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784167fc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.109210:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784167fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.109220:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784167fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.109225:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.109228:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784167fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.109235:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784167fc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.109244:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.109246:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.109250:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784167fc lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.109255:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784167fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.109266:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070504f4c reply state 000000003f84c8e7 transno 4294984058 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af578416803 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.109276:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af578416803 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.109282:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x3abc7379 (ffff9ed245e35000) 00010000:00010000:0.0:1786002562.109285:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.109287:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.109361:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+144:19370:x1872758530995712:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1470us (1701us total) trans 4294984058 rc 0/0 00000100:00100000:0.0:1786002562.109369:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24108 00000100:00100000:3.0:1786002562.115182:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.115442:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530995968 00000100:00100000:0.0:1786002562.115450:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530995968 00000100:00100000:0.0:1786002562.115683:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24109 00000100:00100000:0.0:1786002562.115694:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+144:19370:x1872758530995968:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.115747:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.115772:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577bc00/0x7cee4af578415bdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aea3 expref: 144 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.115790:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff9ed366e56300) 00010000:00010000:0.0:1786002562.115799:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.115819:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416818 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.115841:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416818 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.115991:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416818 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116005:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841681f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x32204679 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116104:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841681f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116112:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841681f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116165:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af578416826 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116177:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af578416826 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116184:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af578416826 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.116378:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2528, 64 off169984 00010000:00010000:0.0:1786002562.116433:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841682d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116442:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841682d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116449:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841682d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116457:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841682d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116612:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841682d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116620:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841682d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116682:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.116702:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af578416826 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116708:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af578416826 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116719:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af578416826 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116725:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.116729:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af578416826 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116736:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af578416826 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116745:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff9ed245e35100) 00010000:00010000:0.0:1786002562.116748:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.116752:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af578416826 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116758:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af578416826 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116774:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416818 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116780:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416818 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116786:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416818 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116791:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416818 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116806:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.116809:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416818 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116815:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416818 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116822:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.116831:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.116834:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416818 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116840:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416818 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.116867:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c8484e7 reply state 000000007562539e transno 4294984059 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841681f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116877:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841681f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.116883:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x32204679 (ffff9ed245e35a00) 00010000:00010000:0.0:1786002562.116885:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.116888:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.116955:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+145:19370:x1872758530995968:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1261us (1778us total) trans 4294984059 rc 0/0 00000100:00100000:0.0:1786002562.116962:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24109 00010000:00010000:3.0:1786002562.120772:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.120785:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841682d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.120796:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.120799:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841682d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.120808:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841682d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.121243:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157b:0x0].0x0 (ffff9ed245e35100) 00010000:00010000:3.0:1786002562.121248:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.121253:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841682d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.121259:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841682d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.121278:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.121280:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.121282:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.121966:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002562.122044:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530996224 00000100:00100000:2.0:1786002562.122053:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530996224 00000100:00100000:2.0:1786002562.122105:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24110 00000100:00100000:2.0:1786002562.122115:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+145:19370:x1872758530996224:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002562.122165:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002562.122185:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a000/0x7cee4af578415c02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aeaa expref: 145 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122197:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff9ed24556e400) 00010000:00010000:2.0:1786002562.122205:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002562.122224:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416834 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122235:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416834 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122244:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416834 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122256:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841683b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122263:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841683b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122269:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841683b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122320:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af578416842 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122328:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af578416842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122335:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af578416842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002562.122564:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].27, 64 off9920 00000004:00080000:2.0:1786002562.122573:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 922303724729ns, next at 923303722155ns, rc = 0 00010000:00010000:2.0:1786002562.122635:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416849 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122645:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416849 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122653:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416849 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122661:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416849 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122668:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416849 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122674:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416849 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122699:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002562.122714:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af578416842 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122721:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af578416842 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122728:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af578416842 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122734:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.122737:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af578416842 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122749:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af578416842 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122757:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff9ed37f5a4200) 00010000:00010000:2.0:1786002562.122759:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002562.122762:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af578416842 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122769:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af578416842 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122784:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416834 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122790:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416834 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122796:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416834 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122801:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416834 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122805:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.122808:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416834 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122813:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416834 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122819:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002562.122821:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002562.122824:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416834 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122829:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416834 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002562.122837:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096a81fd3 reply state 000000003bc86523 transno 4294984060 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841683b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122869:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841683b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.122875:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x2f29d579 (ffff9ed37f5a4100) 00010000:00010000:2.0:1786002562.122878:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002562.122880:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002562.122934:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+146:19370:x1872758530996224:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 821us (971us total) trans 4294984060 rc 0/0 00000100:00100000:2.0:1786002562.122941:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24110 00010000:00010000:3.0:1786002562.123091:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.123096:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416849 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.123103:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.123106:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416849 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.123112:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416849 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.123125:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157c:0x0].0x0 (ffff9ed37f5a4200) 00010000:00010000:3.0:1786002562.123127:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.123130:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416849 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.123135:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416849 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.123147:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.123149:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.123151:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.129103:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.129206:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530996480 00000100:00100000:0.0:1786002562.129215:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530996480 00000100:00100000:0.0:1786002562.129275:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24111 00000100:00100000:0.0:1786002562.129285:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+146:19370:x1872758530996480:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.129341:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.129365:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c600/0x7cee4af578415c25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aeb1 expref: 146 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.129388:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff9ed24559fb00) 00010000:00010000:0.0:1786002562.129397:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.129416:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416850 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.129427:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416850 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.129435:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416850 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.129448:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578416857 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.129455:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578416857 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.129679:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578416857 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.129741:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841685e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.129749:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841685e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.129757:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841685e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.130021:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2529, 64 off170048 00010000:00010000:0.0:1786002562.130084:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416865 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130093:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416865 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130101:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416865 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130108:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416865 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130115:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416865 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130121:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416865 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130133:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.130149:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841685e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130156:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841685e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130163:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841685e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130170:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.130174:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841685e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130182:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841685e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130191:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff9ed245e35400) 00010000:00010000:0.0:1786002562.130194:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.130197:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841685e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130204:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841685e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130218:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416850 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130224:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416850 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130230:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416850 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130236:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416850 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130242:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.130244:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416850 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130250:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416850 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130257:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.130259:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.130262:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416850 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130268:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af578416850 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.130276:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045d86e6e reply state 00000000cff721d1 transno 4294984061 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578416857 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130286:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578416857 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.130292:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xcad70079 (ffff9ed245e35100) 00010000:00010000:0.0:1786002562.130294:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.130296:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.130355:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+147:19370:x1872758530996480:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1070us (1258us total) trans 4294984061 rc 0/0 00000100:00100000:0.0:1786002562.130362:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24111 00010000:00010000:1.0:1786002562.130653:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.130659:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416865 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.130666:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.130670:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416865 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.130677:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416865 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.130687:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157d:0x0].0x0 (ffff9ed245e35400) 00010000:00010000:1.0:1786002562.130689:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.130693:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416865 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.130699:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af578416865 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.130710:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.130712:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.130713:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.136448:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.136731:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530996736 00000100:00100000:0.0:1786002562.136739:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530996736 00000100:00100000:0.0:1786002562.136799:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24112 00000100:00100000:0.0:1786002562.136810:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+147:19370:x1872758530996736:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.136897:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.136922:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db000/0x7cee4af578415c48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aeb8 expref: 147 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.136940:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff9ed2456c9d00) 00010000:00010000:0.0:1786002562.136950:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.136968:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841686c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.136981:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841686c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.136991:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841686c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137003:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416873 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137192:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416873 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137201:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416873 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137254:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af57841687a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137262:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af57841687a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137269:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af57841687a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.137585:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].28, 64 off9984 00010000:00010000:0.0:1786002562.137647:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416881 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137656:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416881 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137667:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416881 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137674:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416881 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137680:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416881 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137687:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416881 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137745:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.137763:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af57841687a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137770:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af57841687a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137776:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af57841687a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137782:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.137786:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af57841687a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137794:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af57841687a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137803:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:0.0:1786002562.137806:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.137810:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af57841687a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137816:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af57841687a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137842:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841686c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137877:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841686c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137884:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841686c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137890:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841686c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137895:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.137898:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841686c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137905:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841686c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137912:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.137915:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.137918:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841686c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137924:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841686c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.137934:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d83d8f27 reply state 00000000416df0b6 transno 4294984062 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416873 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137944:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416873 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.137951:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x71408f79 (ffff9ed245e35f00) 00010000:00010000:0.0:1786002562.137953:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.137956:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.138124:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+148:19370:x1872758530996736:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1314us (1681us total) trans 4294984062 rc 0/0 00000100:00100000:0.0:1786002562.138132:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24112 00010000:00010000:3.0:1786002562.143337:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.143349:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416881 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.143361:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.143365:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416881 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.143374:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416881 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.143390:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157e:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:3.0:1786002562.143393:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.143398:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416881 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.143404:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af578416881 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.143428:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.143429:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.143431:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.143545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.143655:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530996992 00000100:00100000:0.0:1786002562.143665:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530996992 00000100:00100000:0.0:1786002562.143714:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24113 00000100:00100000:0.0:1786002562.143724:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+148:19370:x1872758530996992:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.143779:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.143796:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577a600/0x7cee4af578415c6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x157f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aebf expref: 148 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.143808:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff9ed24556ea00) 00010000:00010000:0.0:1786002562.143816:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.143872:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578416888 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.143883:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578416888 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.143891:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578416888 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.143908:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af57841688f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.143914:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af57841688f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.143920:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af57841688f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.143974:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416896 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.143982:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416896 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.143990:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416896 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.144193:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2530, 64 off170112 00010000:00010000:0.0:1786002562.144247:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af57841689d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144256:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af57841689d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144264:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af57841689d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144272:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af57841689d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144278:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af57841689d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144286:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af57841689d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144301:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.144317:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416896 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144323:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416896 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144330:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416896 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144335:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.144339:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416896 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144345:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416896 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144352:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff9ed245e35600) 00010000:00010000:0.0:1786002562.144355:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.144358:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416896 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144364:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416896 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x157f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144378:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578416888 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144388:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578416888 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144394:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578416888 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144400:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578416888 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144405:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.144407:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578416888 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144414:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578416888 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144421:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.144423:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.144426:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578416888 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144431:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578416888 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.144440:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d44b30f5 reply state 0000000094b121a5 transno 4294984063 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af57841688f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144449:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af57841688f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.144455:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa2c3e279 (ffff9ed245e35500) 00010000:00010000:0.0:1786002562.144457:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.144460:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.144541:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+149:19370:x1872758530996992:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 809us (990us total) trans 4294984063 rc 0/0 00000100:00100000:0.0:1786002562.144548:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24113 00010000:00010000:3.0:1786002562.144787:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.144793:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af57841689d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.144800:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.144803:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af57841689d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.144809:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af57841689d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.144818:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x157f:0x0].0x0 (ffff9ed245e35600) 00010000:00010000:3.0:1786002562.144829:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.144833:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af57841689d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.144839:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af57841689d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x157f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.144867:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.144869:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.144871:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.150819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.150979:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530997248 00000100:00100000:0.0:1786002562.150988:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530997248 00000100:00100000:0.0:1786002562.151055:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24114 00000100:00100000:0.0:1786002562.151065:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+149:19370:x1872758530997248:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.151116:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.151139:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d800/0x7cee4af578415c8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1580:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aec6 expref: 149 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151157:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff9ed24559ff00) 00010000:00010000:0.0:1786002562.151166:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.151185:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151197:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151207:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151220:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6a00/0x7cee4af5784168ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151226:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6a00/0x7cee4af5784168ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151237:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6a00/0x7cee4af5784168ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151291:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151299:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151306:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.151720:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].29, 64 off10048 00010000:00010000:0.0:1786002562.151785:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af5784168b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151794:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af5784168b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151802:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af5784168b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151809:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af5784168b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151816:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af5784168b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.151821:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af5784168b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152129:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.152148:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152154:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168b2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152160:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152166:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.152170:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152177:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168b2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152186:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff9ed245e35800) 00010000:00010000:0.0:1786002562.152189:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.152193:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168b2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152198:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168b2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1580:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152214:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168a4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152220:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168a4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152225:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152234:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152239:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.152242:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152249:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168a4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152256:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.152259:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.152262:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168a4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152267:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.152276:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b85ad81 reply state 0000000063a610b4 transno 4294984064 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6a00/0x7cee4af5784168ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152286:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6a00/0x7cee4af5784168ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.152292:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x77cd7179 (ffff9ed245e35e00) 00010000:00010000:0.0:1786002562.152294:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.152296:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.152364:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+150:19370:x1872758530997248:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1299us (1552us total) trans 4294984064 rc 0/0 00000100:00100000:0.0:1786002562.152372:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24114 00010000:00010000:1.0:1786002562.153135:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.153142:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af5784168b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.153149:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.153152:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af5784168b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.153163:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af5784168b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.153173:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1580:0x0].0x0 (ffff9ed245e35800) 00010000:00010000:1.0:1786002562.153176:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.153179:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af5784168b9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.153185:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af5784168b9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1580:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.153198:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.153200:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.153201:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.159783:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.159886:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530997504 00000100:00100000:0.0:1786002562.159896:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530997504 00000100:00100000:0.0:1786002562.159958:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24115 00000100:00100000:0.0:1786002562.159968:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+150:19370:x1872758530997504:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.160024:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.160048:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455daa00/0x7cee4af578415cb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1581:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aecd expref: 150 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160065:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff9ed2456c9400) 00010000:00010000:0.0:1786002562.160075:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.160098:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160110:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160118:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160132:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160139:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160146:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160201:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160212:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160218:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.160419:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2531, 64 off170176 00010000:00010000:0.0:1786002562.160476:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af5784168d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160497:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af5784168d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160506:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af5784168d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160513:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af5784168d5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160520:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af5784168d5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160525:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af5784168d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160780:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.160799:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160806:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ce lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.160816:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162102:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.162108:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162116:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ce lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162128:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:0.0:1786002562.162132:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.162135:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ce lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162141:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ce lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1581:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162159:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168c0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162165:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168c0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162171:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162176:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162180:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.162184:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162190:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168c0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162196:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.162198:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.162201:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168c0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162206:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.162214:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001480f020 reply state 000000003425e411 transno 4294984065 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162223:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.162229:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe58bac79 (ffff9ed245e35600) 00010000:00010000:0.0:1786002562.162232:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.162234:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.162298:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+151:19370:x1872758530997504:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 2329us (2521us total) trans 4294984065 rc 0/0 00000100:00100000:0.0:1786002562.162306:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24115 00010000:00010000:3.0:1786002562.162929:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.162936:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af5784168d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.162943:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.162947:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af5784168d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.162955:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af5784168d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.162965:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1581:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:3.0:1786002562.162967:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.162971:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af5784168d5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.162977:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af5784168d5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1581:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.162991:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.162993:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.162994:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.172725:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002562.172894:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530997760 00000100:00100000:2.0:1786002562.172903:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530997760 00000100:00100000:2.0:1786002562.172962:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24116 00000100:00100000:2.0:1786002562.172971:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+151:19370:x1872758530997760:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002562.173025:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002562.173050:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ba00/0x7cee4af578415cd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1582:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aed4 expref: 151 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173068:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff9ed24556ed00) 00010000:00010000:2.0:1786002562.173079:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002562.173101:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784168dc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173113:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784168dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173122:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784168dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173136:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784168e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173144:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784168e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173150:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784168e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173202:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784168ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173210:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784168ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173217:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784168ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002562.173421:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].30, 64 off10112 00010000:00010000:2.0:1786002562.173483:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784168f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173502:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784168f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173515:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784168f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173523:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784168f1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173621:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784168f1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173629:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784168f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173652:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002562.173669:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784168ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173675:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784168ea lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173682:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784168ea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173688:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.173692:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784168ea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173701:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784168ea lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173710:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff9ed37f5a4300) 00010000:00010000:2.0:1786002562.173713:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002562.173717:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784168ea lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173723:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af5784168ea lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1582:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173739:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784168dc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173746:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784168dc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173752:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784168dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173758:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784168dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173764:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.173766:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784168dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173772:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784168dc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173779:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002562.173781:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002562.173784:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784168dc lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173790:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784168dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002562.173798:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f0bebde reply state 00000000ff74709c transno 4294984066 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784168e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173808:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784168e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.173814:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8bf53b79 (ffff9ed37f5a4700) 00010000:00010000:2.0:1786002562.173816:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002562.173818:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002562.173902:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+152:19370:x1872758530997760:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 931us (1185us total) trans 4294984066 rc 0/0 00000100:00100000:2.0:1786002562.173909:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24116 00010000:00010000:0.0:1786002562.173966:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002562.173973:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784168f1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.173980:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002562.173984:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784168f1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.173991:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784168f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.174000:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1582:0x0].0x0 (ffff9ed37f5a4300) 00010000:00010000:0.0:1786002562.174003:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002562.174005:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784168f1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.174011:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784168f1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1582:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.174023:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.174026:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.174027:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.180367:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.180436:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530998016 00000100:00100000:0.0:1786002562.180445:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530998016 00000100:00100000:0.0:1786002562.180519:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24117 00000100:00100000:0.0:1786002562.180529:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+152:19370:x1872758530998016:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.180590:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.180614:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34e00/0x7cee4af578415cf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1583:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aedb expref: 152 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.180631:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff9ed351207600) 00010000:00010000:0.0:1786002562.180639:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.180657:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.180669:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.180678:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.180690:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.180697:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.180703:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.180755:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af578416906 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.180763:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af578416906 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.180770:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af578416906 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.181186:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2532, 64 off170240 00010000:00010000:0.0:1786002562.181244:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af57841690d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181254:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af57841690d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181263:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af57841690d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181270:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af57841690d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181278:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af57841690d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181284:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af57841690d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181296:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.181312:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af578416906 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181318:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af578416906 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181324:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af578416906 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181331:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.181335:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af578416906 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181342:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af578416906 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181349:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:0.0:1786002562.181351:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.181354:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af578416906 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181360:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af578416906 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1583:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181378:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168f8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181384:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168f8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181390:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181396:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181400:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.181403:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181409:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168f8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181416:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.181418:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.181420:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168f8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181427:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784168f8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.181436:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b568a36 reply state 00000000cb355e69 transno 4294984067 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181446:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.181452:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa6a2e1ce (ffff9ed245e35400) 00010000:00010000:0.0:1786002562.181454:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.181456:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002562.181641:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.181647:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af57841690d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.181653:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.181656:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af57841690d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.181662:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af57841690d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.181671:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1583:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:1.0:1786002562.181673:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.181676:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af57841690d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.181682:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af57841690d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1583:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.181695:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.181697:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.181698:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002562.182275:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+153:19370:x1872758530998016:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1000us (1168us total) trans 4294984067 rc 0/0 00000100:00100000:0.0:1786002562.182285:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24117 00000100:00100000:1.0:1786002562.189811:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.190000:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530998272 00000100:00100000:0.0:1786002562.190018:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530998272 00000100:00100000:0.0:1786002562.190078:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24118 00000100:00100000:0.0:1786002562.190088:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+153:19370:x1872758530998272:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.190140:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.190163:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455da400/0x7cee4af578415d1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1584:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aee2 expref: 153 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190180:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff9ed2456c9100) 00010000:00010000:0.0:1786002562.190189:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.190207:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416914 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190219:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416914 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190228:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416914 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190240:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af57841691b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190252:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af57841691b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190258:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af57841691b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190311:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416922 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190320:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416922 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190328:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416922 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.190747:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].31, 64 off10176 00010000:00010000:0.0:1786002562.190816:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af578416929 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190826:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af578416929 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190834:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af578416929 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190841:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af578416929 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190882:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af578416929 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190889:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af578416929 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190909:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.190927:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416922 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190933:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416922 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190939:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416922 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190946:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.190950:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416922 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190958:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416922 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190966:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:0.0:1786002562.190969:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.190973:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416922 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190978:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416922 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1584:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.190994:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416914 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.191001:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416914 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.191158:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416914 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.191163:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416914 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.191168:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.191170:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416914 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.191176:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416914 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.191185:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.191187:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.191190:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416914 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.191194:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af578416914 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.191205:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000171b9dc5 reply state 00000000801caa25 transno 4294984068 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af57841691b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.191215:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af57841691b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.191220:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x4d0c70ce (ffff9ed245e35800) 00010000:00010000:0.0:1786002562.191223:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.191225:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.191299:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+154:19370:x1872758530998272:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1211us (1494us total) trans 4294984068 rc 0/0 00000100:00100000:0.0:1786002562.191306:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24118 00010000:00010000:3.0:1786002562.191368:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.191374:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af578416929 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.191379:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.191383:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af578416929 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.191389:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af578416929 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.191397:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1584:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:3.0:1786002562.191400:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.191402:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af578416929 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.191408:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af578416929 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1584:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.191421:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.191423:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.191425:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.201673:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002562.201806:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530998528 00000100:00100000:2.0:1786002562.201815:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530998528 00000100:00100000:2.0:1786002562.201909:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24119 00000100:00100000:2.0:1786002562.201919:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+154:19370:x1872758530998528:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002562.201968:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002562.201991:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570de00/0x7cee4af578415d3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1585:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aee9 expref: 154 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202020:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff9ed24559f000) 00010000:00010000:2.0:1786002562.202031:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002562.202053:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416930 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202065:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416930 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202075:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416930 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202092:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af578416937 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202099:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af578416937 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202106:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af578416937 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202159:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af57841693e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202167:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af57841693e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202173:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af57841693e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002562.202364:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2533, 64 off170304 00010000:00010000:2.0:1786002562.202422:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416945 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202431:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416945 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202438:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416945 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202445:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416945 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202451:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416945 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202458:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416945 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202480:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002562.202507:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af57841693e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202514:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af57841693e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202521:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af57841693e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202528:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.202541:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af57841693e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202547:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af57841693e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202555:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff9ed37f5a4b00) 00010000:00010000:2.0:1786002562.202558:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002562.202561:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af57841693e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202565:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af57841693e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1585:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202579:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416930 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202589:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416930 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202594:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416930 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202599:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416930 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202603:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.202605:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416930 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202610:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416930 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202617:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002562.202619:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002562.202622:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416930 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202626:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416930 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002562.202633:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a79a430 reply state 00000000011e2eab transno 4294984069 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af578416937 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202641:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af578416937 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.202646:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe8b99bce (ffff9ed37f5a4600) 00010000:00010000:2.0:1786002562.202648:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002562.202651:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002562.202710:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+155:19370:x1872758530998528:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 791us (1044us total) trans 4294984069 rc 0/0 00000100:00100000:2.0:1786002562.202717:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24119 00010000:00010000:3.0:1786002562.202914:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.202921:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416945 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.202928:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.202931:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416945 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.202938:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416945 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.202947:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1585:0x0].0x0 (ffff9ed37f5a4b00) 00010000:00010000:3.0:1786002562.202950:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.202952:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416945 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.202958:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416945 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1585:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.202970:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.202973:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.202974:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.209438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.209657:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530998784 00000100:00100000:0.0:1786002562.209667:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530998784 00000100:00100000:0.0:1786002562.209728:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24120 00000100:00100000:0.0:1786002562.209738:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+155:19370:x1872758530998784:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.209792:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.209816:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2465b0000/0x7cee4af578415d60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1586:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aef0 expref: 155 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.209999:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff9ed24556e500) 00010000:00010000:0.0:1786002562.210086:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.210109:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af57841694c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210121:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af57841694c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210130:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af57841694c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210143:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416953 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210150:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210155:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210212:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af57841695a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210220:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af57841695a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210227:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af57841695a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.210434:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].32, 64 off10240 00010000:00010000:0.0:1786002562.210680:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af578416961 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210690:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af578416961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210699:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af578416961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210707:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af578416961 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210714:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af578416961 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210722:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af578416961 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210744:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.210761:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af57841695a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210772:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af57841695a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210779:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af57841695a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210785:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.210789:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af57841695a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210797:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af57841695a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210805:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:0.0:1786002562.210808:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.210812:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af57841695a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.210818:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af57841695a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1586:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.211005:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002562.211022:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af578416961 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.211028:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002562.211032:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af578416961 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.211038:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af578416961 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.211046:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1586:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:2.0:1786002562.211049:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002562.211051:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af578416961 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.211057:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af578416961 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1586:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.211067:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.211069:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.211071:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.211194:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af57841694c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.211201:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af57841694c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.211206:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af57841694c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.211212:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af57841694c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.211217:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.211220:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af57841694c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.211226:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af57841694c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.211233:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.211236:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.211238:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af57841694c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.211244:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af57841694c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.211252:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6c1174c reply state 000000006d584d65 transno 4294984070 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416953 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.211262:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416953 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.211268:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x91a3d2ce (ffff9ed245e35d00) 00010000:00010000:0.0:1786002562.211270:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.211272:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.211392:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+156:19370:x1872758530998784:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1653us (1959us total) trans 4294984070 rc 0/0 00000100:00100000:0.0:1786002562.211400:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24120 00000100:00100000:1.0:1786002562.217298:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.217364:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530999040 00000100:00100000:0.0:1786002562.217373:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530999040 00000100:00100000:0.0:1786002562.217430:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24121 00000100:00100000:0.0:1786002562.217441:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+156:19370:x1872758530999040:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.217758:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.217784:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570c000/0x7cee4af578415d83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1587:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aef7 expref: 156 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.217802:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff9ed24559f300) 00010000:00010000:0.0:1786002562.217811:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.217843:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6600/0x7cee4af578416968 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.217892:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6600/0x7cee4af578416968 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.217901:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6600/0x7cee4af578416968 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.217917:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6200/0x7cee4af57841696f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.217925:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6200/0x7cee4af57841696f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.217931:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6200/0x7cee4af57841696f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.217982:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6c00/0x7cee4af578416976 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.217989:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6c00/0x7cee4af578416976 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.217998:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6c00/0x7cee4af578416976 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.218202:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2534, 64 off170368 00010000:00010000:0.0:1786002562.218260:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af57841697d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218269:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af57841697d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218276:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af57841697d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218282:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af57841697d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218288:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af57841697d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218294:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af57841697d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218309:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.218326:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6c00/0x7cee4af578416976 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218331:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6c00/0x7cee4af578416976 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218337:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6c00/0x7cee4af578416976 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218346:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.218350:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6c00/0x7cee4af578416976 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218357:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6c00/0x7cee4af578416976 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218364:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff9ed3465ad600) 00010000:00010000:0.0:1786002562.218367:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.218370:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6c00/0x7cee4af578416976 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218375:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6c00/0x7cee4af578416976 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1587:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218389:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6600/0x7cee4af578416968 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218395:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6600/0x7cee4af578416968 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218400:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6600/0x7cee4af578416968 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218404:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6600/0x7cee4af578416968 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218408:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.218411:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6600/0x7cee4af578416968 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218419:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6600/0x7cee4af578416968 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218426:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.218428:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.218430:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6600/0x7cee4af578416968 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218436:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6600/0x7cee4af578416968 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.218444:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036610b9e reply state 000000004683abd8 transno 4294984071 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6200/0x7cee4af57841696f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218453:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6200/0x7cee4af57841696f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.218458:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa0d0fdce (ffff9ed3465ad300) 00010000:00010000:0.0:1786002562.218460:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002562.219351:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.219359:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af57841697d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.219367:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.219371:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af57841697d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.219379:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af57841697d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.219390:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1587:0x0].0x0 (ffff9ed3465ad600) 00010000:00010000:3.0:1786002562.219393:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.219396:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af57841697d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.219402:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7200/0x7cee4af57841697d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1587:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.219417:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.219419:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.219420:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002562.219777:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.220125:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+157:19370:x1872758530999040:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 2682us (2832us total) trans 4294984071 rc 0/0 00000100:00100000:0.0:1786002562.220133:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24121 00000100:00100000:1.0:1786002562.225309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.225389:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530999296 00000100:00100000:0.0:1786002562.225397:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530999296 00000100:00100000:0.0:1786002562.225621:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24122 00000100:00100000:0.0:1786002562.225631:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+157:19370:x1872758530999296:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.225681:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.225706:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d400/0x7cee4af578415da6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1588:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aefe expref: 157 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.225724:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff9ed366e57900) 00010000:00010000:0.0:1786002562.225734:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.225754:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af578416984 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.225766:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af578416984 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.225775:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af578416984 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.225788:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af57841698b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.225795:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af57841698b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.225802:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af57841698b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.225889:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af578416992 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.225897:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af578416992 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.225904:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af578416992 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.226155:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].33, 64 off10304 00010000:00010000:0.0:1786002562.226348:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af578416999 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.226357:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af578416999 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.226364:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af578416999 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.226371:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af578416999 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.226377:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af578416999 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.226383:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af578416999 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.226399:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.226414:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af578416992 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.226421:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af578416992 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.226427:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af578416992 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.226433:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.226437:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af578416992 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.226444:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af578416992 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.226453:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff9ed3465ade00) 00010000:00010000:0.0:1786002562.226456:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.226460:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af578416992 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.226660:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.226666:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af578416999 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.226673:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.226677:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af578416999 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.226683:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af578416999 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.226691:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1588:0x0].0x0 (ffff9ed3465ade00) 00010000:00010000:3.0:1786002562.226694:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.226697:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af578416999 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.226703:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7600/0x7cee4af578416999 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1588:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.226713:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.226715:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.226717:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.226987:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6800/0x7cee4af578416992 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1588:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.227063:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af578416984 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.227073:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af578416984 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.227078:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af578416984 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.227084:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af578416984 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.227089:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.227092:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af578416984 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.227097:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af578416984 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.227106:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.227108:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.227112:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af578416984 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.227121:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6e00/0x7cee4af578416984 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.227132:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff84e405 reply state 0000000022d1e857 transno 4294984072 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af57841698b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.227143:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af57841698b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.227149:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x95b00cce (ffff9ed3465adf00) 00010000:00010000:0.0:1786002562.227151:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.227154:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.227251:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+158:19370:x1872758530999296:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1621us (1950us total) trans 4294984072 rc 0/0 00000100:00100000:0.0:1786002562.227259:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24122 00000100:00100000:1.0:1786002562.232137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.232202:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530999552 00000100:00100000:0.0:1786002562.232211:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530999552 00000100:00100000:0.0:1786002562.232265:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24123 00000100:00100000:0.0:1786002562.232274:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+158:19370:x1872758530999552:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.232323:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.232345:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db800/0x7cee4af578415dc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1589:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af05 expref: 158 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.232361:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff9ed2456c9500) 00010000:00010000:0.0:1786002562.232371:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.232390:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784169a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.232405:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784169a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.232413:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784169a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.232426:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af5784169a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.232432:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af5784169a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.232439:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af5784169a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.232518:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af5784169ae lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.232526:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af5784169ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.232668:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af5784169ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.233008:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2535, 64 off170432 00010000:00010000:0.0:1786002562.233073:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af5784169b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233082:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af5784169b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233089:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af5784169b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233097:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af5784169b5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233103:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af5784169b5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233109:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af5784169b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233167:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.233187:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af5784169ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233193:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af5784169ae lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233199:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af5784169ae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233205:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.233209:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af5784169ae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233215:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af5784169ae lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233223:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff9ed3465ad800) 00010000:00010000:0.0:1786002562.233226:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.233229:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af5784169ae lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233238:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7800/0x7cee4af5784169ae lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1589:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233253:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784169a0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233258:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784169a0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233264:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784169a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233269:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784169a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233273:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.233276:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784169a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233280:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784169a0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233286:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.233288:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.233291:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784169a0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233296:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6400/0x7cee4af5784169a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.233304:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce3c19b5 reply state 00000000d6f7ee8b transno 4294984073 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af5784169a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233314:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af5784169a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.233320:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd0dd37ce (ffff9ed3465add00) 00010000:00010000:0.0:1786002562.233322:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.233324:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.233396:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+159:19370:x1872758530999552:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1122us (1266us total) trans 4294984073 rc 0/0 00000100:00100000:0.0:1786002562.233404:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24123 00010000:00010000:2.0:1786002562.239639:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002562.239651:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af5784169b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.239662:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002562.239667:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af5784169b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.239677:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af5784169b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.239694:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1589:0x0].0x0 (ffff9ed3465ad800) 00010000:00010000:2.0:1786002562.239697:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002562.239701:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af5784169b5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.239707:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af5784169b5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1589:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.239731:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.239733:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.239735:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.242261:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.242370:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758530999808 00000100:00100000:0.0:1786002562.242379:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758530999808 00000100:00100000:0.0:1786002562.242456:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24124 00000100:00100000:0.0:1786002562.242476:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+159:19370:x1872758530999808:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.242683:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.242709:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24570d200/0x7cee4af578415dec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af0c expref: 159 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.242727:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff9ed366e57f00) 00010000:00010000:0.0:1786002562.242738:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.242759:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af5784169bc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.242772:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af5784169bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.242782:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af5784169bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.242800:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784169c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.242808:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784169c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.242814:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784169c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.242970:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784169ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.242980:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784169ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.242987:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784169ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.243197:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].34, 64 off10368 00010000:00010000:0.0:1786002562.243259:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784169d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243268:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784169d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243276:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784169d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243283:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784169d1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243289:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784169d1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243295:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784169d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243343:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.243358:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784169ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243363:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784169ca lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243370:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784169ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243375:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.243378:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784169ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243385:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784169ca lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243392:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff9ed3465ad100) 00010000:00010000:0.0:1786002562.243396:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.243399:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784169ca lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243404:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784169ca lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243419:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af5784169bc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243429:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af5784169bc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243434:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af5784169bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243439:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af5784169bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243443:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.243445:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af5784169bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243450:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af5784169bc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243456:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.243458:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.243473:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af5784169bc lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243479:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af5784169bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.243495:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099c11d60 reply state 00000000db5b8653 transno 4294984074 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784169c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243505:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784169c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.243512:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x77c76ece (ffff9ed3465ad000) 00010000:00010000:0.0:1786002562.243515:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.243517:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.243798:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+160:19370:x1872758530999808:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1331us (1543us total) trans 4294984074 rc 0/0 00000100:00100000:0.0:1786002562.243806:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24124 00010000:00010000:3.0:1786002562.244086:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.244093:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784169d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.244100:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.244103:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784169d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.244110:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784169d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.244118:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158a:0x0].0x0 (ffff9ed3465ad100) 00010000:00010000:3.0:1786002562.244121:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.244124:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784169d1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.244129:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784169d1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.244142:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.244144:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.244145:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.253576:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.253688:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531000064 00000100:00100000:0.0:1786002562.253697:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531000064 00000100:00100000:0.0:1786002562.253757:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24125 00000100:00100000:0.0:1786002562.253767:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+160:19370:x1872758531000064:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.253819:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.253867:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed24577ac00/0x7cee4af578415e0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af13 expref: 160 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.253886:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff9ed366e57600) 00010000:00010000:0.0:1786002562.253896:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.253915:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784169d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.253928:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784169d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.253937:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784169d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.253951:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af5784169df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.253958:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af5784169df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.253970:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af5784169df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254031:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af5784169e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254039:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af5784169e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254046:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af5784169e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.254228:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2536, 64 off170496 00010000:00010000:0.0:1786002562.254289:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af5784169ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254298:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af5784169ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254306:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af5784169ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254313:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af5784169ed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254319:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af5784169ed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254325:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af5784169ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254346:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.254363:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af5784169e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254369:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af5784169e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254375:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af5784169e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254380:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.254384:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af5784169e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254392:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af5784169e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254400:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:0.0:1786002562.254404:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.254407:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af5784169e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254414:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af5784169e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254429:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784169d8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254436:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784169d8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254442:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784169d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254452:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784169d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254457:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.254460:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784169d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254466:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784169d8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254473:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.254475:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.254478:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784169d8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254492:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784169d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.254502:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013a2a4bb reply state 000000002a74e5d9 transno 4294984075 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af5784169df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254513:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af5784169df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.254519:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe585a9ce (ffff9ed3465ad600) 00010000:00010000:0.0:1786002562.254522:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.254524:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.254589:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+161:19370:x1872758531000064:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 823us (1021us total) trans 4294984075 rc 0/0 00000100:00100000:0.0:1786002562.254596:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24125 00010000:00010000:1.0:1786002562.254841:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.254871:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af5784169ed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.254878:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.254882:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af5784169ed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.254889:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af5784169ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.254898:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158b:0x0].0x0 (ffff9ed2456ef700) 00010000:00010000:1.0:1786002562.254900:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.254903:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af5784169ed lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.254908:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af5784169ed lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.254922:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.254924:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.254925:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.260518:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002562.260638:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531000320 00000100:00100000:2.0:1786002562.260648:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531000320 00000100:00100000:2.0:1786002562.260704:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24126 00000100:00100000:2.0:1786002562.260715:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+161:19370:x1872758531000320:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002562.260771:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002562.260796:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455dac00/0x7cee4af578415e32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af1a expref: 161 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.260813:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff9ed2456c9300) 00010000:00010000:2.0:1786002562.260834:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002562.260878:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784169f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.260891:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784169f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.260902:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784169f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.260916:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784169fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.260923:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784169fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.260930:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784169fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.260985:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416a02 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.260994:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416a02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261001:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416a02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002562.261216:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].35, 64 off10432 00010000:00010000:2.0:1786002562.261282:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416a09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261291:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416a09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261299:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416a09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261306:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416a09 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261313:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416a09 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261319:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416a09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261337:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002562.261355:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416a02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261361:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416a02 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261366:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416a02 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261371:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.261375:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416a02 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261381:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416a02 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261388:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff9ed37f5a4800) 00010000:00010000:2.0:1786002562.261391:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002562.261394:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416a02 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261399:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416a02 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261417:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784169f4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261422:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784169f4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261428:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784169f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261433:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784169f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261438:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.261441:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784169f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261447:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784169f4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261454:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002562.261456:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002562.261459:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784169f4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261478:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784169f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002562.261496:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055d3a1e5 reply state 0000000002428261 transno 4294984076 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784169fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261507:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784169fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.261513:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x4de4b8ce (ffff9ed37f5a4e00) 00010000:00010000:2.0:1786002562.261515:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002562.261518:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002562.261674:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+162:19370:x1872758531000320:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 959us (1162us total) trans 4294984076 rc 0/0 00000100:00100000:2.0:1786002562.261681:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24126 00010000:00010000:1.0:1786002562.261982:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.261989:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416a09 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.261995:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.261999:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416a09 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.262015:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416a09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.262025:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158c:0x0].0x0 (ffff9ed37f5a4800) 00010000:00010000:1.0:1786002562.262028:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.262031:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416a09 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.262036:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416a09 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.262049:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.262051:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.262053:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.267924:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.268083:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531000576 00000100:00100000:0.0:1786002562.268091:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531000576 00000100:00100000:0.0:1786002562.268142:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24127 00000100:00100000:0.0:1786002562.268150:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+162:19370:x1872758531000576:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.268200:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.268222:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2423b4000/0x7cee4af578415e55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af21 expref: 162 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268238:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff9ed351207e00) 00010000:00010000:0.0:1786002562.268247:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.268266:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a10 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268279:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a10 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268288:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a10 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268302:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578416a17 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268309:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578416a17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268316:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578416a17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268370:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268381:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268387:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.268598:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2537, 64 off170560 00010000:00010000:0.0:1786002562.268656:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416a25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268665:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268673:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268680:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416a25 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268687:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416a25 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268693:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416a25 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268714:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.268732:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268738:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a1e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268748:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a1e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268754:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.268758:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a1e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268765:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a1e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268773:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff9ed3465ad800) 00010000:00010000:0.0:1786002562.268776:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.268779:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a1e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268785:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a1e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268800:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a10 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268807:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a10 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268814:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a10 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268820:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a10 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268835:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.268839:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a10 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268870:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a10 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268879:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.268881:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.268884:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a10 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268891:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.268900:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f2fd0e6 reply state 00000000336ab3b6 transno 4294984077 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578416a17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268911:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578416a17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.268917:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5501ae7b (ffff9ed2456ef700) 00010000:00010000:0.0:1786002562.268919:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.268922:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.268978:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+163:19370:x1872758531000576:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 827us (1062us total) trans 4294984077 rc 0/0 00000100:00100000:0.0:1786002562.268986:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24127 00010000:00010000:3.0:1786002562.269761:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.269768:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416a25 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.269775:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.269779:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416a25 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.269787:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416a25 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.269798:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158d:0x0].0x0 (ffff9ed3465ad800) 00010000:00010000:3.0:1786002562.269800:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.269803:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416a25 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.269809:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416a25 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.269834:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.269835:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.269837:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.275163:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002562.275238:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531000832 00000100:00100000:3.0:1786002562.275247:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531000832 00000100:00100000:3.0:1786002562.275300:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24128 00000100:00100000:3.0:1786002562.275309:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+163:19370:x1872758531000832:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002562.275358:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002562.275380:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed2455db600/0x7cee4af578415e78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af28 expref: 163 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.275396:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff9ed2456c9700) 00010000:00010000:3.0:1786002562.275406:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002562.275424:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a2c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.275435:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.275445:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.275457:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578416a33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.275476:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578416a33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.275490:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578416a33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.275972:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a3a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.275983:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.275990:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002562.276211:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].36, 64 off10496 00010000:00010000:3.0:1786002562.276269:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578416a41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276277:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578416a41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276285:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578416a41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276291:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578416a41 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276297:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578416a41 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276303:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578416a41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276326:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002562.276342:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276347:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a3a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276353:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a3a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276359:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002562.276363:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a3a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276369:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a3a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276376:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:3.0:1786002562.276379:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002562.276382:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a3a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276388:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a3a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276402:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a2c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276408:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a2c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276414:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a2c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276418:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a2c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276422:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002562.276425:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a2c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276430:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a2c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276436:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002562.276438:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002562.276441:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a2c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276446:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a2c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002562.276453:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f61b7149 reply state 00000000125601f3 transno 4294984078 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578416a33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.276709:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002562.276716:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578416a41 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.276723:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002562.276726:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578416a41 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.276733:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578416a41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.276742:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158e:0x0].0x0 (ffff9ed24206a800) 00010000:00010000:2.0:1786002562.276744:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002562.276747:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578416a41 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.276752:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34200/0x7cee4af578416a41 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.276766:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.276768:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.276769:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.276988:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578416a33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.276995:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb3d7b (ffff9ed24206a900) 00010000:00010000:3.0:1786002562.276997:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002562.277000:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002562.277776:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+164:19370:x1872758531000832:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 2464us (2617us total) trans 4294984078 rc 0/0 00000100:00100000:1.0:1786002562.277789:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24128 00000100:00100000:1.0:1786002562.283320:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002562.285459:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531001088 00000100:00100000:3.0:1786002562.285527:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531001088 00000100:00100000:3.0:1786002562.286342:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24129 00000100:00100000:3.0:1786002562.286352:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+164:19370:x1872758531001088:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002562.286410:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002562.286434:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a228200/0x7cee4af578415e9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x158f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af2f expref: 164 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.286451:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff9ed2456c9800) 00010000:00010000:3.0:1786002562.286472:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002562.286501:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.286514:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.286524:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.286549:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x170e687b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.286557:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.286564:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.286619:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416a56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.286626:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416a56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.286633:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416a56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002562.286843:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2538, 64 off170624 00010000:00010000:3.0:1786002562.287233:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578416a5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287243:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578416a5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287250:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578416a5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287258:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578416a5d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287264:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578416a5d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287270:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578416a5d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287292:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002562.287311:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416a56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287318:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416a56 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287324:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416a56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287330:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002562.287334:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416a56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287341:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416a56 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287350:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:3.0:1786002562.287352:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002562.287356:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416a56 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287361:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416a56 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x158f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287376:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a48 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287383:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a48 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287388:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a48 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287397:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a48 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287402:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002562.287404:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a48 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287410:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a48 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287416:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002562.287418:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002562.287421:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a48 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287426:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416a48 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002562.287434:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ece5ba4 reply state 0000000070c49691 transno 4294984079 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287443:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.287449:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x170e687b (ffff9ed245fed400) 00010000:00010000:3.0:1786002562.287451:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002562.287453:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002562.287599:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002562.287606:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578416a5d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.287613:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002562.287616:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578416a5d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.287622:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578416a5d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.287631:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x158f:0x0].0x0 (ffff9ed245fed900) 00010000:00010000:2.0:1786002562.287633:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002562.287636:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578416a5d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.287642:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34400/0x7cee4af578416a5d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x158f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.287654:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.287656:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.287657:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.287760:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+165:19370:x1872758531001088:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1407us (4445us total) trans 4294984079 rc 0/0 00000100:00100000:3.0:1786002562.287768:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24129 00000100:00100000:2.0:1786002562.295570:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.295695:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531001344 00000100:00100000:0.0:1786002562.295704:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531001344 00000100:00100000:0.0:1786002562.295760:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24130 00000100:00100000:0.0:1786002562.295770:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+165:19370:x1872758531001344:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.295834:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.295884:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578415ebe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1590:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af36 expref: 165 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.295902:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff9ed366e57400) 00010000:00010000:0.0:1786002562.295912:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.295933:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a64 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.295945:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a64 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.295954:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a64 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.295968:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.295976:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.295982:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296044:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416a72 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296052:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416a72 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296058:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416a72 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.296248:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].37, 64 off10560 00010000:00010000:0.0:1786002562.296307:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416a79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296316:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416a79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296324:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416a79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296331:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416a79 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296337:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416a79 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296343:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416a79 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296359:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.296376:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416a72 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296382:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416a72 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296388:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416a72 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296394:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.296398:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416a72 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296405:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416a72 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296413:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff9ed3465ade00) 00010000:00010000:0.0:1786002562.296415:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.296418:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416a72 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296424:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416a72 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1590:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296439:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a64 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296444:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a64 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296450:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a64 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296454:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a64 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296459:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.296461:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a64 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296466:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a64 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296472:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.296474:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.296477:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a64 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296482:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416a64 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.296501:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b8c2bcc reply state 00000000d7312927 transno 4294984080 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296510:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.296516:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x95f89f7b (ffff9ed3465ad100) 00010000:00010000:0.0:1786002562.296518:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.296521:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.296715:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+166:19370:x1872758531001344:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 944us (1152us total) trans 4294984080 rc 0/0 00000100:00100000:0.0:1786002562.296722:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24130 00010000:00010000:3.0:1786002562.297083:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.297089:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416a79 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.297096:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.297099:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416a79 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.297106:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416a79 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.297114:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1590:0x0].0x0 (ffff9ed3465ade00) 00010000:00010000:3.0:1786002562.297117:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.297119:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416a79 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.297125:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416a79 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1590:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.297137:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.297138:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.297140:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.304344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002562.304744:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531001600 00000100:00100000:1.0:1786002562.304754:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531001600 00000100:00100000:1.0:1786002562.304813:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24131 00000100:00100000:1.0:1786002562.304830:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+166:19370:x1872758531001600:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002562.304913:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002562.304936:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578415ee1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1591:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af3d expref: 166 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.304953:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff9ed366e57000) 00010000:00010000:1.0:1786002562.304963:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002562.304982:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416a80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.304995:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416a80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.305004:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416a80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.305172:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416a87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.305180:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416a87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.305188:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416a87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.305242:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416a8e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.305250:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416a8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.305257:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416a8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002562.305440:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2539, 64 off170688 00010000:00010000:1.0:1786002562.305789:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416a95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.305799:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416a95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.305807:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416a95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.305813:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416a95 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.305820:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416a95 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307790:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416a95 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307814:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.307842:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416a8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307873:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416a8e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307880:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416a8e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307885:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.307889:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416a8e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307897:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416a8e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307906:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff9ed366c05f00) 00010000:00010000:1.0:1786002562.307909:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.307913:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416a8e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307918:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416a8e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1591:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307936:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416a80 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307942:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416a80 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307948:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416a80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307953:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416a80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307958:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.307960:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416a80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307966:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416a80 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307973:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.307975:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.307979:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416a80 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.307984:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416a80 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.307993:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000673a7d6c reply state 000000008545d5f7 transno 4294984081 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416a87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.308003:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416a87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.308020:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd905ca7b (ffff9ed366c05600) 00010000:00010000:1.0:1786002562.308022:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.308025:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002562.308096:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+167:19370:x1872758531001600:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 3272us (3780us total) trans 4294984081 rc 0/0 00000100:00100000:1.0:1786002562.308104:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24131 00010000:00010000:2.0:1786002562.308398:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002562.308405:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416a95 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.308412:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002562.308416:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416a95 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.308423:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416a95 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.308438:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1591:0x0].0x0 (ffff9ed366c05f00) 00010000:00010000:2.0:1786002562.308440:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002562.308443:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416a95 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.308449:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416a95 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1591:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.308480:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.308482:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.308491:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.313336:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002562.313406:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531001856 00000100:00100000:1.0:1786002562.313414:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531001856 00000100:00100000:1.0:1786002562.313477:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24132 00000100:00100000:1.0:1786002562.313495:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+167:19370:x1872758531001856:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002562.313558:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002562.313583:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578415f04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1592:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af44 expref: 167 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.313601:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1592:0x0].0x0 (ffff9ed2434df400) 00010000:00010000:1.0:1786002562.313610:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002562.313631:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416a9c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.313643:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416a9c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.313653:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416a9c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.313667:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416aa3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.313674:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.313681:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.313734:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416aaa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.313742:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416aaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.313752:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416aaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002562.313989:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].38, 64 off10624 00010000:00010000:1.0:1786002562.314061:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416ab1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314070:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314077:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314084:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416ab1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314090:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416ab1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314095:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416ab1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314113:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.314127:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416aaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314133:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416aaa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314138:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416aaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314148:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.314151:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416aaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314158:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416aaa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314167:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1592:0x0].0x0 (ffff9ed366c05d00) 00010000:00010000:1.0:1786002562.314169:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.314172:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416aaa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314178:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416aaa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1592:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314192:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416a9c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314198:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416a9c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314204:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416a9c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314210:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416a9c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314215:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.314218:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416a9c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314228:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416a9c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314235:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.314237:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.314240:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416a9c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314246:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416a9c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.314255:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000038f34c3 reply state 00000000861b4389 transno 4294984082 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314264:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416aa3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.314270:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xee04d97b (ffff9ed366c05800) 00010000:00010000:1.0:1786002562.314272:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.314275:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002562.314361:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+168:19370:x1872758531001856:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 875us (1032us total) trans 4294984082 rc 0/0 00000100:00100000:1.0:1786002562.314368:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24132 00010000:00010000:3.0:1786002562.314628:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.314634:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416ab1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.314640:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.314644:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416ab1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.314651:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416ab1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.314660:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1592:0x0].0x0 (ffff9ed366c05d00) 00010000:00010000:3.0:1786002562.314662:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.314665:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416ab1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.314670:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416ab1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1592:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.314684:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.314686:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.314688:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.320609:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002562.320768:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531002112 00000100:00100000:2.0:1786002562.320777:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531002112 00000100:00100000:2.0:1786002562.320890:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24133 00000100:00100000:2.0:1786002562.320900:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+168:19370:x1872758531002112:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002562.320955:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002562.320978:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578415f27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1593:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af4b expref: 168 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.320994:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1593:0x0].0x0 (ffff9ed2434df700) 00010000:00010000:2.0:1786002562.321003:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002562.321036:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416ab8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.321048:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416ab8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.321057:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416ab8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.321097:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416abf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.321115:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416abf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.321122:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416abf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.321225:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416ac6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.321249:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.321257:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002562.322194:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2540, 64 off170752 00010000:00010000:2.0:1786002562.322262:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578416acd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322273:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578416acd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322281:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578416acd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322288:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578416acd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322295:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578416acd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322301:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578416acd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322323:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002562.322340:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322347:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416ac6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322354:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416ac6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322360:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.322365:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416ac6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322372:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416ac6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322380:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1593:0x0].0x0 (ffff9ed37f5a4b00) 00010000:00010000:2.0:1786002562.322383:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002562.322387:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416ac6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322393:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c400/0x7cee4af578416ac6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1593:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322408:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416ab8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322420:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416ab8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322426:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416ab8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322432:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416ab8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322437:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.322439:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416ab8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322444:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416ab8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322451:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002562.322453:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002562.322455:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416ab8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322461:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af578416ab8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002562.322479:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da5ce0f5 reply state 000000005777580f transno 4294984083 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416abf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322499:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416abf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.322505:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xdfb2047b (ffff9ed37f5a4800) 00010000:00010000:2.0:1786002562.322508:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002562.322511:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002562.322731:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.322738:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578416acd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.322745:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed3429ea000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.322748:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578416acd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.322755:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578416acd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.322764:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1593:0x0].0x0 (ffff9ed37f5a4b00) 00010000:00010000:3.0:1786002562.322767:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.322770:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578416acd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.322776:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429ea000/0x7cee4af578416acd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1593:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.322793:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.322795:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.322797:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.323040:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+169:19370:x1872758531002112:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 2139us (2435us total) trans 4294984083 rc 0/0 00000100:00100000:2.0:1786002562.323048:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24133 00000100:00100000:2.0:1786002562.329967:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002562.330089:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531002368 00000100:00100000:1.0:1786002562.330098:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531002368 00000100:00100000:1.0:1786002562.330194:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24134 00000100:00100000:1.0:1786002562.330205:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+169:19370:x1872758531002368:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002562.330257:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002562.330281:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578415f4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1594:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af52 expref: 169 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.330298:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1594:0x0].0x0 (ffff9ed2434dfd00) 00010000:00010000:1.0:1786002562.330307:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002562.330326:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416ad4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.330339:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.330348:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.330360:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416adb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.330367:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416adb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.330373:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416adb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.330424:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416ae2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.330432:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416ae2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.330439:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416ae2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002562.331096:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].39, 64 off10688 00010000:00010000:1.0:1786002562.331196:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416ae9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331222:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331231:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331238:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416ae9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331244:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416ae9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331266:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416ae9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331350:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.331379:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416ae2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331386:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416ae2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331392:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416ae2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331407:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.331411:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416ae2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331418:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416ae2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331427:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1594:0x0].0x0 (ffff9ed366c05c00) 00010000:00010000:1.0:1786002562.331429:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.331433:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416ae2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331451:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416ae2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1594:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331498:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416ad4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331505:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416ad4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331527:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416ad4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331605:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416ad4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331610:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.331613:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416ad4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331618:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416ad4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331627:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.331629:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.331632:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416ad4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331641:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416ad4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.331651:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd47bf1e reply state 000000003613e408 transno 4294984084 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416adb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331659:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416adb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.331665:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x869c3b7b (ffff9ed366c05400) 00010000:00010000:1.0:1786002562.331666:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.331668:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002562.331824:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+170:19370:x1872758531002368:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1618us (1996us total) trans 4294984084 rc 0/0 00000100:00100000:1.0:1786002562.331832:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24134 00000100:00100000:3.0:1786002562.336438:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.336674:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531002624 00000100:00100000:0.0:1786002562.336683:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531002624 00000100:00100000:0.0:1786002562.336743:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24135 00000100:00100000:0.0:1786002562.336754:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+170:19370:x1872758531002624:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.336809:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.336867:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed3429eb600/0x7cee4af578415f6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1595:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af59 expref: 170 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.336886:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1595:0x0].0x0 (ffff9ed366c05200) 00010000:00010000:0.0:1786002562.336896:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.336917:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416af0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.336929:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416af0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.336938:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416af0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.336951:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416af7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.336958:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416af7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.336965:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416af7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337165:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416afe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337174:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416afe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337181:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416afe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.337381:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2541, 64 off170816 00010000:00010000:0.0:1786002562.337444:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416b05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337453:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416b05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.337581:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002562.337588:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416ae9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.337597:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002562.337601:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416ae9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.337609:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416ae9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.337619:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1594:0x0].0x0 (ffff9ed366c05c00) 00010000:00010000:2.0:1786002562.337622:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002562.337626:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416ae9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.337633:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416ae9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1594:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.337646:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.337647:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.337649:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.337763:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416b05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337770:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416b05 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337776:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416b05 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337783:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416b05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337806:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.337920:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416afe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337929:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416afe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337935:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416afe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337941:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.337945:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416afe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337952:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416afe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337961:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1595:0x0].0x0 (ffff9ed3465ad800) 00010000:00010000:0.0:1786002562.337963:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.337967:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416afe lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337973:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416afe lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1595:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337989:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416af0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.337995:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416af0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.338001:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416af0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.338067:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416af0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.338074:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.338078:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416af0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.338084:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416af0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.338094:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.338096:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.338100:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416af0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.338107:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416af0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.338116:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cccba404 reply state 000000004fece396 transno 4294984085 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416af7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.338127:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416af7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.338134:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x9bba767b (ffff9ed3465ade00) 00010000:00010000:0.0:1786002562.338136:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.338138:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002562.338251:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002562.338257:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416b05 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.338268:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002562.338272:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416b05 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.338279:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416b05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.338288:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1595:0x0].0x0 (ffff9ed3465ad800) 00010000:00010000:2.0:1786002562.338290:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002562.338292:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416b05 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.338298:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416b05 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1595:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.338310:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.338312:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.338314:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002562.338345:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+171:19370:x1872758531002624:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1591us (1914us total) trans 4294984085 rc 0/0 00000100:00100000:0.0:1786002562.338354:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24135 00000100:00100000:2.0:1786002562.343119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.343192:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531002880 00000100:00100000:0.0:1786002562.343201:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531002880 00000100:00100000:0.0:1786002562.343282:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24136 00000100:00100000:0.0:1786002562.343292:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+171:19370:x1872758531002880:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.343342:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.343366:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af578415f90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1596:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af60 expref: 171 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343383:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1596:0x0].0x0 (ffff9ed366c05100) 00010000:00010000:0.0:1786002562.343395:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.343416:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416b0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343429:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416b0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343438:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416b0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343457:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717e00/0x7cee4af578416b13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343477:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717e00/0x7cee4af578416b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343491:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717e00/0x7cee4af578416b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343553:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b1a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343561:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343568:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.343762:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].40, 64 off10752 00010000:00010000:0.0:1786002562.343819:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416b21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343840:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416b21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343882:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416b21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343890:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416b21 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343897:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416b21 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343904:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416b21 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343917:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.343933:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343939:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b1a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343947:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343953:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.343957:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343964:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b1a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343972:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1596:0x0].0x0 (ffff9ed36e785a00) 00010000:00010000:0.0:1786002562.343975:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.343978:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b1a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.343984:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b1a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1596:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.344000:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416b0c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.344020:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416b0c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.344026:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416b0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.344033:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416b0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.344038:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.344040:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416b0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.344046:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416b0c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.344052:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.344054:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.344056:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416b0c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.344062:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416b0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.344071:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008ff67a2 reply state 000000005948c241 transno 4294984086 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717e00/0x7cee4af578416b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.344080:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717e00/0x7cee4af578416b13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.344085:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8b9857b (ffff9ed36e785800) 00010000:00010000:0.0:1786002562.344088:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.344090:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.344147:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+172:19370:x1872758531002880:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 856us (1035us total) trans 4294984086 rc 0/0 00000100:00100000:0.0:1786002562.344155:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24136 00010000:00010000:3.0:1786002562.344208:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.344215:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416b21 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.344221:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.344224:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416b21 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.344231:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416b21 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.344240:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1596:0x0].0x0 (ffff9ed36e785a00) 00010000:00010000:3.0:1786002562.344243:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.344246:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416b21 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.344251:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416b21 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1596:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.344263:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.344265:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.344267:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.348352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002562.349186:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531003136 00000100:00100000:1.0:1786002562.349196:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531003136 00000100:00100000:1.0:1786002562.349254:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24137 00000100:00100000:1.0:1786002562.349263:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+172:19370:x1872758531003136:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002562.349317:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002562.349340:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578415fb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1597:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af67 expref: 172 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349355:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1597:0x0].0x0 (ffff9ed2456ef600) 00010000:00010000:1.0:1786002562.349365:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002562.349384:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b28 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349401:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349411:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b28 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349425:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416b2f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349431:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416b2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349438:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416b2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349511:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416b36 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349519:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416b36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349525:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416b36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002562.349895:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2542, 64 off170880 00010000:00010000:1.0:1786002562.349956:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416b3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349965:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416b3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349973:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416b3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349981:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416b3d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349987:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416b3d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.349993:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416b3d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350113:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.350133:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.350138:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416b3d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350146:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.350151:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416b3d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350159:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416b3d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350169:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1597:0x0].0x0 (ffff9ed366c05c00) 00010000:00010000:1.0:1786002562.350172:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.350175:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416b3d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350182:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416b3d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1597:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350191:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.350193:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.350195:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.350206:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416b36 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350213:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416b36 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350219:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416b36 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350224:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.350228:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416b36 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350234:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416b36 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350240:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1597:0x0].0x0 (ffff9ed366c05c00) 00010000:00010000:1.0:1786002562.350242:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.350245:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416b36 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350250:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416b36 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1597:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350267:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b28 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350274:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b28 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350280:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b28 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350290:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b28 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350296:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.350299:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b28 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350305:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b28 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350312:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.350315:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.350317:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b28 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350323:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b28 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.350333:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004f2e99a reply state 00000000a6a76179 transno 4294984087 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416b2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350343:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416b2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.350350:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb4d1abd0 (ffff9ed366c05200) 00010000:00010000:1.0:1786002562.350352:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.350355:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002562.350416:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+173:19370:x1872758531003136:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1152us (2070us total) trans 4294984087 rc 0/0 00000100:00100000:1.0:1786002562.350423:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24137 00000100:00100000:2.0:1786002562.355752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002562.356078:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531003392 00000100:00100000:3.0:1786002562.356087:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531003392 00000100:00100000:3.0:1786002562.356172:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24138 00000100:00100000:3.0:1786002562.356182:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+173:19370:x1872758531003392:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002562.356235:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002562.356259:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578415fd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1598:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af6e expref: 173 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.356276:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1598:0x0].0x0 (ffff9ed2434dfb00) 00010000:00010000:3.0:1786002562.356285:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002562.356305:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416b44 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.356318:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416b44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.356327:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416b44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.356340:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416b4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.356348:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416b4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.356355:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416b4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.356403:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578416b52 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.356410:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578416b52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.356421:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578416b52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002562.357150:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].41, 64 off10816 00010000:00010000:2.0:1786002562.357233:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357245:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357253:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357260:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b59 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357266:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b59 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357273:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b59 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357293:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002562.357310:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578416b52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357315:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578416b52 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357321:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578416b52 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357327:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.357330:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578416b52 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357337:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578416b52 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357345:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1598:0x0].0x0 (ffff9ed245fedb00) 00010000:00010000:2.0:1786002562.357348:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002562.357351:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578416b52 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357356:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34600/0x7cee4af578416b52 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1598:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357375:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416b44 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357381:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416b44 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357387:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416b44 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357392:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416b44 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357397:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.357399:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416b44 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357404:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416b44 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357410:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002562.357412:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002562.357415:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416b44 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357420:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416b44 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002562.357427:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c63a064 reply state 00000000e2731580 transno 4294984088 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416b4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357435:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416b4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.357441:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7db3ad0 (ffff9ed245fedf00) 00010000:00010000:2.0:1786002562.357443:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002562.357446:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002562.357628:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+174:19370:x1872758531003392:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1349us (1786us total) trans 4294984088 rc 0/0 00000100:00100000:2.0:1786002562.357636:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24138 00010000:00010000:3.0:1786002562.357683:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.357688:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b59 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.357694:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.357697:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b59 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.357703:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b59 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.357711:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1598:0x0].0x0 (ffff9ed245fedb00) 00010000:00010000:3.0:1786002562.357713:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.357716:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b59 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.357723:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b59 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1598:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.357735:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.357736:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.357738:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.363333:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002562.363406:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531003648 00000100:00100000:3.0:1786002562.363415:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531003648 00000100:00100000:3.0:1786002562.363478:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24139 00000100:00100000:3.0:1786002562.363495:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+174:19370:x1872758531003648:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002562.363556:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002562.363581:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578415ff9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1599:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af75 expref: 174 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.363599:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1599:0x0].0x0 (ffff9ed2456ef500) 00010000:00010000:3.0:1786002562.363609:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002562.363629:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416b60 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.363640:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416b60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.363650:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416b60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.363662:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578416b67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.363669:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578416b67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.363676:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578416b67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.363725:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416b6e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.363733:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416b6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.363740:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416b6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002562.363982:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2543, 64 off170944 00010000:00010000:1.0:1786002562.364271:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364280:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364287:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364294:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b75 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364300:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b75 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364307:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364328:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.364346:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416b6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364352:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416b6e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364358:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416b6e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364365:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.364369:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416b6e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364380:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416b6e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364388:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1599:0x0].0x0 (ffff9ed245fed800) 00010000:00010000:1.0:1786002562.364390:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.364393:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416b6e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364398:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416b6e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1599:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364411:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416b60 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364417:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416b60 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364421:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416b60 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364426:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416b60 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364431:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.364433:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416b60 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364439:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416b60 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364445:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.364448:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.364450:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416b60 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364455:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416b60 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.364463:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000981bdec5 reply state 00000000daf5ada3 transno 4294984089 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578416b67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364494:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578416b67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.364501:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x798865d0 (ffff9ed245fedb00) 00010000:00010000:1.0:1786002562.364503:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.364506:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002562.364585:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+175:19370:x1872758531003648:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1097us (1258us total) trans 4294984089 rc 0/0 00000100:00100000:1.0:1786002562.364592:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24139 00010000:00010000:3.0:1786002562.365326:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.365333:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b75 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.365341:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.365345:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b75 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.365353:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.365363:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1599:0x0].0x0 (ffff9ed245fed800) 00010000:00010000:3.0:1786002562.365366:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.365369:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b75 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.365376:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416b75 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1599:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.365390:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.365391:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.365393:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002562.370603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002562.370677:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531003904 00000100:00100000:2.0:1786002562.370687:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531003904 00000100:00100000:2.0:1786002562.370741:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24140 00000100:00100000:2.0:1786002562.370750:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+175:19370:x1872758531003904:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:2.0:1786002562.370801:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002562.370834:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841601c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af7c expref: 175 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.370884:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff9ed366c05300) 00010000:00010000:2.0:1786002562.370896:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002562.370918:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578416b7c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.370930:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578416b7c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.370939:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578416b7c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.370953:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416b83 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.370964:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416b83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.370970:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416b83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371030:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b8a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371038:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b8a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371044:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b8a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002562.371236:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].42, 64 off10880 00010000:00010000:2.0:1786002562.371298:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416b91 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371306:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416b91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371313:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416b91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371320:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416b91 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371326:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416b91 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371333:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416b91 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371354:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002562.371371:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b8a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371377:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b8a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371383:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b8a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371389:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.371393:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b8a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371399:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b8a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371406:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff9ed37f5a4200) 00010000:00010000:2.0:1786002562.371409:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002562.371412:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b8a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371417:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af578416b8a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371431:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578416b7c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371436:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578416b7c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371445:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578416b7c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371450:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578416b7c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371454:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002562.371456:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578416b7c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371461:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578416b7c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371467:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:2.0:1786002562.371469:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002562.371472:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578416b7c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371477:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578416b7c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002562.371496:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004018a90a reply state 00000000dfba159c transno 4294984090 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416b83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371506:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416b83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.371512:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa0729cd0 (ffff9ed37f5a4300) 00010000:00010000:2.0:1786002562.371515:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002562.371517:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002562.371577:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+176:19370:x1872758531003904:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 827us (981us total) trans 4294984090 rc 0/0 00000100:00100000:2.0:1786002562.371585:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24140 00010000:00010000:3.0:1786002562.372187:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.372193:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416b91 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.372200:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.372203:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416b91 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.372210:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416b91 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.372221:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159a:0x0].0x0 (ffff9ed37f5a4200) 00010000:00010000:3.0:1786002562.372223:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.372226:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416b91 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.372232:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af578416b91 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.372247:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.372248:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.372250:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.377614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.377737:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531004160 00000100:00100000:0.0:1786002562.377746:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531004160 00000100:00100000:0.0:1786002562.377805:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24141 00000100:00100000:0.0:1786002562.377815:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+176:19370:x1872758531004160:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.377904:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.377929:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af57841603f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af83 expref: 176 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.377947:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159b:0x0].0x0 (ffff9ed366c05b00) 00010000:00010000:0.0:1786002562.377957:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.377976:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.377988:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.377996:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378020:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416b9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378027:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416b9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378038:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416b9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378090:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416ba6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378098:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416ba6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378105:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416ba6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.378301:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2544, 64 off171008 00010000:00010000:0.0:1786002562.378359:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717800/0x7cee4af578416bad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378369:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717800/0x7cee4af578416bad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378376:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717800/0x7cee4af578416bad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378383:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717800/0x7cee4af578416bad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378390:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717800/0x7cee4af578416bad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378396:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717800/0x7cee4af578416bad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378412:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.378429:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416ba6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378436:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416ba6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378442:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416ba6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378447:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.378451:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416ba6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378457:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416ba6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.378567:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.378574:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717800/0x7cee4af578416bad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.378580:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.378583:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717800/0x7cee4af578416bad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.378589:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717800/0x7cee4af578416bad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.378598:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159b:0x0].0x0 (ffff9ed36e785b00) 00010000:00010000:3.0:1786002562.378601:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.378604:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717800/0x7cee4af578416bad lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.378610:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717800/0x7cee4af578416bad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.378622:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.378624:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.378626:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.378798:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159b:0x0].0x0 (ffff9ed36e785b00) 00010000:00010000:0.0:1786002562.378800:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.378804:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416ba6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.378809:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416ba6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.380328:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b98 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.380343:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b98 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.380350:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.380360:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.380366:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.380370:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.380377:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b98 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.380389:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.380392:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.380395:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b98 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.380401:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416b98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.380415:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e29ac953 reply state 0000000061b47eff transno 4294984091 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416b9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.380426:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416b9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.380432:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe37fc7d0 (ffff9ed36e785c00) 00010000:00010000:0.0:1786002562.380434:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.380438:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.380982:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+177:19370:x1872758531004160:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 3164us (3371us total) trans 4294984091 rc 0/0 00000100:00100000:0.0:1786002562.380992:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24141 00000100:00100000:3.0:1786002562.385179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002562.385508:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531004416 00000100:00100000:1.0:1786002562.385517:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531004416 00000100:00100000:1.0:1786002562.385586:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24142 00000100:00100000:1.0:1786002562.385596:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+177:19370:x1872758531004416:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002562.385647:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002562.385671:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416062 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af8a expref: 177 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.385688:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff9ed2434df000) 00010000:00010000:1.0:1786002562.385697:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002562.385718:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416bb4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.385731:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.385740:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.385753:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416bbb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.385760:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416bbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.385767:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416bbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.385814:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578416bc2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.385820:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578416bc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.385839:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578416bc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002562.386069:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].43, 64 off10944 00010000:00010000:1.0:1786002562.386126:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416bc9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386134:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386145:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386152:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416bc9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386158:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416bc9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386164:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416bc9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386181:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.386196:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578416bc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386202:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578416bc2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386208:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578416bc2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386214:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.386218:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578416bc2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386225:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578416bc2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386232:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff9ed366c05d00) 00010000:00010000:1.0:1786002562.386235:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.386238:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578416bc2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386243:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46c00/0x7cee4af578416bc2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386256:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416bb4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386262:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416bb4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386268:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416bb4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386273:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416bb4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386277:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.386279:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416bb4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386284:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416bb4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386290:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.386292:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.386295:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416bb4 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386300:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47a00/0x7cee4af578416bb4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.386307:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000510d3fa9 reply state 0000000045f24296 transno 4294984092 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416bbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386317:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416bbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.386323:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x507ed6d0 (ffff9ed366c05c00) 00010000:00010000:1.0:1786002562.386325:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.386327:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002562.386518:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002562.386533:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416bc9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.386540:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002562.386543:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416bc9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.386550:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416bc9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.386559:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159c:0x0].0x0 (ffff9ed366c05d00) 00010000:00010000:0.0:1786002562.386562:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002562.386565:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416bc9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.386570:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46e00/0x7cee4af578416bc9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.386584:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.386586:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.386588:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.387191:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+178:19370:x1872758531004416:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1593us (2016us total) trans 4294984092 rc 0/0 00000100:00100000:1.0:1786002562.387200:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24142 00000100:00100000:0.0:1786002562.391359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002562.391429:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531004672 00000100:00100000:1.0:1786002562.391439:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531004672 00000100:00100000:1.0:1786002562.391665:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24143 00000100:00100000:1.0:1786002562.391676:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+178:19370:x1872758531004672:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002562.391724:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002562.391745:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620000/0x7cee4af578416085 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af91 expref: 178 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.391764:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159d:0x0].0x0 (ffff9ed24556e700) 00010000:00010000:1.0:1786002562.391774:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002562.391795:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578416bd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.391807:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578416bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.391817:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578416bd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.391877:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416bd7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.391885:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.391891:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.391941:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416bde lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.391949:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416bde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.391955:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416bde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002562.392155:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2545, 64 off171072 00010000:00010000:1.0:1786002562.392218:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416be5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392227:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416be5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392235:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416be5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392242:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416be5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392247:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416be5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392254:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416be5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392271:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.392287:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416bde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392294:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416bde lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392300:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416bde lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392307:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed382166c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.392310:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416bde lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392318:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416bde lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392326:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159d:0x0].0x0 (ffff9ed366c05900) 00010000:00010000:1.0:1786002562.392329:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.392332:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416bde lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392339:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578416bde lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392355:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578416bd0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392366:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578416bd0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392372:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578416bd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392378:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578416bd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392383:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.392386:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578416bd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392392:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578416bd0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392399:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.392401:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.392403:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578416bd0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392409:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47200/0x7cee4af578416bd0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.392417:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009aa974a0 reply state 00000000e22a0452 transno 4294984093 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392427:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416bd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.392433:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xea2c01d0 (ffff9ed366c05f00) 00010000:00010000:1.0:1786002562.392436:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.392439:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002562.392891:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+179:19370:x1872758531004672:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1214us (1536us total) trans 4294984093 rc 0/0 00000100:00100000:1.0:1786002562.392900:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24143 00010000:00010000:3.0:1786002562.393092:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.393099:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416be5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.393106:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.393109:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416be5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.393115:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416be5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.393124:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159d:0x0].0x0 (ffff9ed366c05900) 00010000:00010000:3.0:1786002562.393127:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.393130:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416be5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.393135:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771000/0x7cee4af578416be5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.393150:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.393151:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.393153:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.397119:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.397632:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531004928 00000100:00100000:0.0:1786002562.397642:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531004928 00000100:00100000:0.0:1786002562.397702:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24144 00000100:00100000:0.0:1786002562.397711:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+179:19370:x1872758531004928:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.397763:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.397786:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771c00/0x7cee4af5784160a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af98 expref: 179 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.397809:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159e:0x0].0x0 (ffff9ed366c05a00) 00010000:00010000:0.0:1786002562.397820:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.397869:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416bec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.397881:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416bec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.397890:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416bec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.397904:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416bf3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.397911:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.397917:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.397972:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416bfa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.397979:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416bfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.397985:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416bfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.398325:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].44, 64 off11008 00010000:00010000:0.0:1786002562.398394:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416c01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398403:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416c01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398411:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416c01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398418:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416c01 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398424:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416c01 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398429:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416c01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398446:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.398652:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002562.398658:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416c01 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398665:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002562.398669:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416c01 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398677:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416c01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398686:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159e:0x0].0x0 (ffff9ed36e785700) 00010000:00010000:0.0:1786002562.398689:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002562.398692:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416c01 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398698:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416c01 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398708:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.398710:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.398711:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.398723:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416bfa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398729:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416bfa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398736:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416bfa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398741:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.398745:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416bfa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398751:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416bfa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398757:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159e:0x0].0x0 (ffff9ed36e785700) 00010000:00010000:0.0:1786002562.398759:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.398762:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416bfa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398767:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416bfa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398786:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416bec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398793:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416bec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398798:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416bec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398804:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416bec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398809:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.398811:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416bec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.398817:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416bec lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.399149:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.399152:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.399155:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416bec lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.399161:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416bec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.399172:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000895a5e40 reply state 00000000987e628d transno 4294984094 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.399181:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416bf3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.399187:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe91638d0 (ffff9ed36e785400) 00010000:00010000:0.0:1786002562.399190:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.399192:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.399265:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+180:19370:x1872758531004928:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1553us (2151us total) trans 4294984094 rc 0/0 00000100:00100000:0.0:1786002562.399273:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24144 00000100:00100000:3.0:1786002562.403336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002562.403398:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531005184 00000100:00100000:1.0:1786002562.403406:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531005184 00000100:00100000:1.0:1786002562.403481:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24145 00000100:00100000:1.0:1786002562.403507:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+180:19370:x1872758531005184:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002562.403567:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002562.403590:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770800/0x7cee4af5784160cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x159f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3af9f expref: 180 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.403606:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159f:0x0].0x0 (ffff9ed366c05700) 00010000:00010000:1.0:1786002562.403614:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002562.403633:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416c08 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.403645:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416c08 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.403653:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416c08 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.403666:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af578416c0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.403672:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af578416c0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.403682:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af578416c0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.403730:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c16 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.403737:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.403745:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002562.403976:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2546, 64 off171136 00010000:00010000:1.0:1786002562.404040:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578416c1d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404049:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578416c1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404057:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578416c1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404065:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578416c1d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404072:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578416c1d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404079:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578416c1d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404095:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.404111:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404118:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c16 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404125:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c16 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404131:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.404135:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c16 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404143:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c16 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404151:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159f:0x0].0x0 (ffff9ed366c05b00) 00010000:00010000:1.0:1786002562.404154:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.404157:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c16 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404164:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c16 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x159f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404177:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416c08 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404183:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416c08 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404189:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416c08 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404200:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416c08 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404206:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.404209:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416c08 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404215:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416c08 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404221:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.404224:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.404226:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416c08 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404232:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771600/0x7cee4af578416c08 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.404241:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006992b0d2 reply state 0000000092304fab transno 4294984095 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af578416c0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404251:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af578416c0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.404257:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xfe3473d0 (ffff9ed366c05d00) 00010000:00010000:1.0:1786002562.404260:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.404262:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002562.404443:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002562.404449:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578416c1d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.404456:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002562.404460:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578416c1d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.404467:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578416c1d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.404477:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x159f:0x0].0x0 (ffff9ed366c05b00) 00010000:00010000:0.0:1786002562.404479:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002562.404492:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578416c1d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.404499:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998c00/0x7cee4af578416c1d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x159f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.404511:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.404513:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.404515:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.404982:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+181:19370:x1872758531005184:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1475us (1650us total) trans 4294984095 rc 0/0 00000100:00100000:1.0:1786002562.404990:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24145 00000100:00100000:3.0:1786002562.411088:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002562.411158:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531005440 00000100:00100000:1.0:1786002562.411167:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531005440 00000100:00100000:1.0:1786002562.411221:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24146 00000100:00100000:1.0:1786002562.411231:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+181:19370:x1872758531005440:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002562.411283:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002562.411306:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621400/0x7cee4af5784160ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afa6 expref: 181 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411323:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a0:0x0].0x0 (ffff9ed24556eb00) 00010000:00010000:1.0:1786002562.411332:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002562.411351:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c24 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411364:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c24 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411373:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c24 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411386:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578416c2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411393:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578416c2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411400:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578416c2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411452:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c32 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411480:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411497:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002562.411701:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].45, 64 off11072 00010000:00010000:1.0:1786002562.411758:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578416c39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411768:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578416c39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411776:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578416c39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411784:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578416c39 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411791:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578416c39 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411797:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578416c39 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411830:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.411870:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411877:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c32 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411888:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c32 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411894:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.411898:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c32 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411905:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c32 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411914:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a0:0x0].0x0 (ffff9ed366c05100) 00010000:00010000:1.0:1786002562.411916:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.411920:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c32 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411925:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c32 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411941:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c24 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411947:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c24 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411952:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c24 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411958:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c24 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411963:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.411966:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c24 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411972:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c24 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411980:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.411982:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.411985:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c24 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.411992:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c24 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.412001:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000071e12 reply state 00000000688103f1 transno 4294984096 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578416c2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.412011:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578416c2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.412018:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x133382d0 (ffff9ed366c05300) 00010000:00010000:1.0:1786002562.412020:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.412023:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002562.412080:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+182:19370:x1872758531005440:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 850us (1000us total) trans 4294984096 rc 0/0 00000100:00100000:1.0:1786002562.412087:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24146 00010000:00010000:3.0:1786002562.412961:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.412968:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578416c39 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.412976:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.412980:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578416c39 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.412988:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578416c39 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.412999:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a0:0x0].0x0 (ffff9ed366c05100) 00010000:00010000:3.0:1786002562.413002:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.413005:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578416c39 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.413012:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998000/0x7cee4af578416c39 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.413026:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.413028:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.413030:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.418695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002562.418760:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531005696 00000100:00100000:3.0:1786002562.418770:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531005696 00000100:00100000:3.0:1786002562.418822:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24147 00000100:00100000:3.0:1786002562.418839:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+182:19370:x1872758531005696:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002562.418929:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002562.418953:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771400/0x7cee4af578416111 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afad expref: 182 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.418971:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a1:0x0].0x0 (ffff9ed366c05e00) 00010000:00010000:3.0:1786002562.418980:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002562.419001:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c40 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419024:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419035:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419049:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578416c47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419056:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578416c47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419062:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578416c47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419117:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c4e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419125:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419131:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002562.419329:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2547, 64 off171200 00010000:00010000:3.0:1786002562.419391:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416c55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419399:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416c55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419406:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416c55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419413:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416c55 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419420:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416c55 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419426:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416c55 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419442:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002562.419458:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419464:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c4e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419469:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c4e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419475:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002562.419479:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c4e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419499:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c4e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419507:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a1:0x0].0x0 (ffff9ed245fed100) 00010000:00010000:3.0:1786002562.419510:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002562.419513:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c4e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.419518:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c4e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.419620:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002562.419627:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416c55 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.419633:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002562.419637:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416c55 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.419644:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416c55 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.419654:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a1:0x0].0x0 (ffff9ed245fed100) 00010000:00010000:0.0:1786002562.419656:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786002562.419659:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416c55 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.419665:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35400/0x7cee4af578416c55 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.419676:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.419678:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.419680:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.420099:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c40 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.420107:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c40 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.420114:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c40 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.420119:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c40 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.420124:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002562.420127:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c40 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.420133:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c40 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.420141:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002562.420143:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002562.420145:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c40 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.420151:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c40 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002562.420160:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f1076eb reply state 0000000067a0533c transno 4294984097 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578416c47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.420169:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578416c47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.420175:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xeedd9295 (ffff9ed245fed800) 00010000:00010000:3.0:1786002562.420177:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002562.420179:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002562.420280:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+183:19370:x1872758531005696:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1441us (1592us total) trans 4294984097 rc 0/0 00000100:00100000:3.0:1786002562.420287:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24147 00000100:00100000:2.0:1786002562.426190:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002562.426293:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531005952 00000100:00100000:1.0:1786002562.426302:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531005952 00000100:00100000:1.0:1786002562.426398:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24148 00000100:00100000:1.0:1786002562.426408:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+183:19370:x1872758531005952:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002562.426474:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002562.426506:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771800/0x7cee4af578416134 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afb4 expref: 183 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.426523:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a2:0x0].0x0 (ffff9ed366c05000) 00010000:00010000:1.0:1786002562.426635:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002562.426657:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c5c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.426671:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.426681:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c5c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.426695:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c63 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.426702:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.426709:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.426759:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.426766:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.426772:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002562.427211:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].46, 64 off11136 00010000:00010000:1.0:1786002562.427270:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578416c71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427281:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578416c71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427289:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578416c71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427297:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578416c71 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427304:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578416c71 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427311:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578416c71 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427335:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.427351:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427357:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c6a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427363:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427369:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.427373:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427381:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c6a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427389:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a2:0x0].0x0 (ffff9ed366c05e00) 00010000:00010000:1.0:1786002562.427391:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.427395:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c6a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427401:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416c6a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427416:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c5c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427422:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c5c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427427:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c5c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427433:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427438:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.427441:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c5c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427447:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c5c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427454:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.427457:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.427797:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c5c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427805:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416c5c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.427816:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa0d9a38 reply state 00000000e1d1ef64 transno 4294984098 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427950:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.427957:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6be72195 (ffff9ed366c05700) 00010000:00010000:1.0:1786002562.427959:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.427962:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002562.428140:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.428147:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578416c71 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.428153:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.428157:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578416c71 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.428164:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578416c71 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.428173:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a2:0x0].0x0 (ffff9ed366c05e00) 00010000:00010000:3.0:1786002562.428175:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.428179:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578416c71 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.428185:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999a00/0x7cee4af578416c71 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.428199:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.428202:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.428203:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002562.428236:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+184:19370:x1872758531005952:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1827us (2055us total) trans 4294984098 rc 0/0 00000100:00100000:1.0:1786002562.428244:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24148 00000100:00100000:0.0:1786002562.433444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002562.433606:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531006208 00000100:00100000:1.0:1786002562.433615:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531006208 00000100:00100000:1.0:1786002562.433675:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24149 00000100:00100000:1.0:1786002562.433686:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+184:19370:x1872758531006208:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002562.433740:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002562.433775:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46a00/0x7cee4af578416157 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afbb expref: 184 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.433792:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a3:0x0].0x0 (ffff9ed2456ef900) 00010000:00010000:1.0:1786002562.433801:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002562.433829:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416c78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.433840:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416c78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.433874:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416c78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.433888:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416c7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.433895:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416c7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.433901:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416c7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.433948:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416c86 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.433954:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416c86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.433961:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416c86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002562.434176:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2548, 64 off171264 00010000:00010000:1.0:1786002562.434241:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578416c8d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434249:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578416c8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434260:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578416c8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434265:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578416c8d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434271:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578416c8d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434276:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578416c8d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434292:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.434309:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416c86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434315:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416c86 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434320:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416c86 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434325:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.434329:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416c86 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434335:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416c86 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434343:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a3:0x0].0x0 (ffff9ed366c05100) 00010000:00010000:1.0:1786002562.434345:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.434348:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416c86 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434354:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416c86 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434370:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416c78 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434377:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416c78 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434383:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416c78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434390:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416c78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434395:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.434398:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416c78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434404:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416c78 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434411:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.434414:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.434417:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416c78 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434424:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416c78 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.434433:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df4513e1 reply state 0000000074c99a9b transno 4294984099 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416c7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434442:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416c7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.434448:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6d724c95 (ffff9ed366c05b00) 00010000:00010000:1.0:1786002562.434451:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.434453:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002562.434759:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+185:19370:x1872758531006208:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 844us (1092us total) trans 4294984099 rc 0/0 00000100:00100000:1.0:1786002562.434769:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24149 00010000:00010000:3.0:1786002562.437021:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.437032:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578416c8d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.437043:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.437046:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578416c8d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.437055:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578416c8d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.437070:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a3:0x0].0x0 (ffff9ed366c05100) 00010000:00010000:3.0:1786002562.437072:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.437076:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578416c8d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.437082:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998400/0x7cee4af578416c8d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.437098:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.437100:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.437102:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.440378:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002562.440443:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531006464 00000100:00100000:3.0:1786002562.440452:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531006464 00000100:00100000:3.0:1786002562.440538:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24150 00000100:00100000:3.0:1786002562.440548:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+185:19370:x1872758531006464:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:3.0:1786002562.440602:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002562.440624:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46400/0x7cee4af57841617a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afc2 expref: 185 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.440641:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a4:0x0].0x0 (ffff9ed2456efe00) 00010000:00010000:3.0:1786002562.440650:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002562.440669:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c94 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.440681:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c94 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.440688:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c94 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.440701:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.440708:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.440713:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.440763:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416ca2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.440770:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416ca2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.440777:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416ca2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786002562.441020:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].47, 64 off11200 00010000:00010000:3.0:1786002562.441082:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416ca9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441091:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441103:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441109:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416ca9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441116:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416ca9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441123:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416ca9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441143:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786002562.441159:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416ca2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441166:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416ca2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441173:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416ca2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441179:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002562.441183:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416ca2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441190:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416ca2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441198:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a4:0x0].0x0 (ffff9ed245fedd00) 00010000:00010000:3.0:1786002562.441201:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1786002562.441205:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416ca2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441212:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35000/0x7cee4af578416ca2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441227:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c94 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441233:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c94 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441239:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c94 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441245:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c94 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441250:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002562.441253:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c94 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441260:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c94 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441267:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:3.0:1786002562.441269:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002562.441272:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c94 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441278:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34a00/0x7cee4af578416c94 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002562.441286:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3e1dc44 reply state 000000007b31a32d transno 4294984100 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441298:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.441304:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6a5c8395 (ffff9ed245fede00) 00010000:00010000:3.0:1786002562.441307:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002562.441309:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002562.441370:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+186:19370:x1872758531006464:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 822us (999us total) trans 4294984100 rc 0/0 00000100:00100000:3.0:1786002562.441377:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24150 00010000:00010000:1.0:1786002562.441502:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.441509:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416ca9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.441516:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.441520:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416ca9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.441535:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416ca9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.441545:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a4:0x0].0x0 (ffff9ed245fedd00) 00010000:00010000:1.0:1786002562.441547:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.441550:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416ca9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.441556:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34c00/0x7cee4af578416ca9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.441569:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.441571:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.441573:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002562.448033:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002562.448115:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531006720 00000100:00100000:1.0:1786002562.448123:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531006720 00000100:00100000:1.0:1786002562.448169:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24151 00000100:00100000:1.0:1786002562.448178:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+186:19370:x1872758531006720:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002562.448225:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002562.448258:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620c00/0x7cee4af57841619d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afc9 expref: 186 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448275:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a5:0x0].0x0 (ffff9ed24206ad00) 00010000:00010000:1.0:1786002562.448284:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002562.448303:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416cb0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448314:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416cb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448323:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416cb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448335:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416cb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448341:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448347:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448397:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416cbe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448406:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416cbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448412:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416cbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002562.448721:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2549, 64 off171328 00010000:00010000:1.0:1786002562.448786:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416cc5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448796:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448804:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448811:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416cc5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448819:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416cc5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448825:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448875:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.448892:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416cbe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448899:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416cbe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448910:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416cbe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448917:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.448921:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416cbe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448928:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416cbe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448936:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a5:0x0].0x0 (ffff9ed366c05900) 00010000:00010000:1.0:1786002562.448939:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.448942:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416cbe lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448947:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416cbe lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448962:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416cb0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448968:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416cb0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448974:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416cb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448980:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416cb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448985:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.448988:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416cb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.448995:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416cb0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.449003:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.449005:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.449008:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416cb0 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.449014:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416cb0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.449024:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068069cc9 reply state 00000000b0b8ad6c transno 4294984101 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.449034:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416cb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.449041:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x609ae95 (ffff9ed366c05000) 00010000:00010000:1.0:1786002562.449044:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.449046:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002562.449102:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+187:19370:x1872758531006720:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 925us (1078us total) trans 4294984101 rc 0/0 00000100:00100000:1.0:1786002562.449109:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24151 00010000:00010000:3.0:1786002562.449777:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.449784:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416cc5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.449792:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.449796:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416cc5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.449803:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.449812:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a5:0x0].0x0 (ffff9ed366c05900) 00010000:00010000:3.0:1786002562.449814:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.449817:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416cc5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.449833:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999000/0x7cee4af578416cc5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.449871:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.449874:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.449876:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.455052:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.455132:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531006976 00000100:00100000:0.0:1786002562.455142:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531006976 00000100:00100000:0.0:1786002562.455194:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24152 00000100:00100000:0.0:1786002562.455203:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+187:19370:x1872758531006976:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.455256:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.455279:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47800/0x7cee4af5784161c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afd0 expref: 187 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.455296:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a6:0x0].0x0 (ffff9ed2456ef200) 00010000:00010000:0.0:1786002562.455306:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.455325:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ccc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.455339:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ccc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.455348:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ccc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.455363:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416cd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.455371:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.455377:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.455433:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cda lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.455440:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cda lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.455446:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cda lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.455800:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].48, 64 off11264 00010000:00010000:0.0:1786002562.456047:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416ce1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456057:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456064:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456072:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416ce1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456079:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416ce1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456084:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456131:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.456148:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cda lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456153:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cda lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456160:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cda lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456166:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.456170:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cda lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456177:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cda lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456185:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a6:0x0].0x0 (ffff9ed36e785b00) 00010000:00010000:0.0:1786002562.456188:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.456192:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cda lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456202:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cda lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456218:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ccc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456224:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ccc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456230:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ccc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456236:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ccc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456241:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.456244:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ccc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456249:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ccc lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456256:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.456258:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.456261:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ccc lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456267:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ccc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.456277:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b74b28d2 reply state 00000000c471663f transno 4294984102 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456287:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416cd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.456292:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x9d08bd95 (ffff9ed36e785700) 00010000:00010000:0.0:1786002562.456295:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.456297:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.456352:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+188:19370:x1872758531006976:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1149us (1307us total) trans 4294984102 rc 0/0 00000100:00100000:0.0:1786002562.456359:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24152 00010000:00010000:3.0:1786002562.457799:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.457808:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416ce1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.457816:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.457820:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416ce1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.457836:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.458050:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a6:0x0].0x0 (ffff9ed36e785b00) 00010000:00010000:3.0:1786002562.458054:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.458058:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416ce1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.458065:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416ce1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.458728:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.458731:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.458733:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.465823:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.465941:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531007232 00000100:00100000:0.0:1786002562.465950:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531007232 00000100:00100000:0.0:1786002562.466000:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24153 00000100:00100000:0.0:1786002562.466021:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+188:19370:x1872758531007232:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.466076:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.466100:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47e00/0x7cee4af5784161e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afd7 expref: 188 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466118:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a7:0x0].0x0 (ffff9ed2456efd00) 00010000:00010000:0.0:1786002562.466127:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.466147:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ce8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466160:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ce8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466174:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ce8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466187:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466194:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466201:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466249:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416cf6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466256:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416cf6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466263:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416cf6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.466453:0:14496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2550, 64 off171392 00010000:00010000:0.0:1786002562.466542:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416cfd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466551:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416cfd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466558:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416cfd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466565:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416cfd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466572:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416cfd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466579:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416cfd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466603:0:14496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.466619:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416cf6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466626:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416cf6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466632:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416cf6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466638:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.466643:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416cf6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466650:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416cf6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466658:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a7:0x0].0x0 (ffff9ed36e785300) 00010000:00010000:0.0:1786002562.466661:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.466664:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416cf6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466670:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416cf6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466690:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ce8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466696:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ce8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466703:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ce8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466709:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ce8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466714:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.466717:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ce8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466723:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ce8 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466730:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.466732:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.466735:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ce8 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466741:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416ce8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.466750:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000637e30bc reply state 000000002ec8af45 transno 4294984103 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466760:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.466767:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x3615e895 (ffff9ed36e785900) 00010000:00010000:0.0:1786002562.466770:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.466772:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.466833:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+189:19370:x1872758531007232:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 824us (1017us total) trans 4294984103 rc 0/0 00000100:00100000:0.0:1786002562.466841:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24153 00010000:00010000:2.0:1786002562.467091:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002562.467098:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416cfd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.467105:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002562.467108:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416cfd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.467116:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416cfd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.467126:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a7:0x0].0x0 (ffff9ed36e785300) 00010000:00010000:2.0:1786002562.467128:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002562.467132:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416cfd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.467138:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af578416cfd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.467150:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.467152:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.467154:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.473165:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.473239:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531007488 00000100:00100000:0.0:1786002562.473247:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531007488 00000100:00100000:0.0:1786002562.473300:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24154 00000100:00100000:0.0:1786002562.473310:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+189:19370:x1872758531007488:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.473362:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.473386:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2de00/0x7cee4af578416206 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afde expref: 189 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473404:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9ed2434df900) 00010000:00010000:0.0:1786002562.473413:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.473433:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d04 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473446:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473456:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473480:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416d0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473500:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416d0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473506:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416d0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473567:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d12 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473575:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473581:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.473765:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].49, 64 off11328 00010000:00010000:0.0:1786002562.473834:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416d19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473843:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416d19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473889:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416d19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473896:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416d19 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473902:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416d19 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473908:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416d19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473927:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.473944:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473950:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d12 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473956:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d12 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473962:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.473966:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d12 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473974:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d12 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473981:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9ed36e785200) 00010000:00010000:0.0:1786002562.473984:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.473987:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d12 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.473992:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d12 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.474006:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d04 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.474011:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d04 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.474021:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.474026:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d04 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.474030:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.474032:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d04 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.474037:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d04 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.474043:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.474045:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.474048:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d04 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.474053:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.474061:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021696b87 reply state 000000002ec446f9 transno 4294984104 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416d0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.474070:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416d0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.474075:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb3001f95 (ffff9ed36e785500) 00010000:00010000:0.0:1786002562.474077:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.474079:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.474136:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+190:19370:x1872758531007488:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 826us (979us total) trans 4294984104 rc 0/0 00000100:00100000:0.0:1786002562.474143:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24154 00010000:00010000:1.0:1786002562.476775:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002562.476785:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416d19 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.476795:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002562.476799:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416d19 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.476807:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416d19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.476820:0:14667:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a8:0x0].0x0 (ffff9ed36e785200) 00010000:00010000:1.0:1786002562.476823:0:14667:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1786002562.476826:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416d19 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.476833:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578416d19 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.476861:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.476863:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002562.476865:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002562.483767:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002562.483873:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531007744 00000100:00100000:0.0:1786002562.483882:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531007744 00000100:00100000:0.0:1786002562.483930:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24155 00000100:00100000:0.0:1786002562.483940:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+190:19370:x1872758531007744:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:0.0:1786002562.483990:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002562.484025:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771e00/0x7cee4af578416229 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15a9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afe5 expref: 190 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484043:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a9:0x0].0x0 (ffff9ed343228100) 00010000:00010000:0.0:1786002562.484054:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002562.484075:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484088:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484097:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484110:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484117:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484124:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484176:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416d2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15a9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484184:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416d2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484191:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416d2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002562.484370:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2551, 64 off171456 00010000:00010000:0.0:1786002562.484426:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416d35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484435:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416d35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484442:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416d35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15a9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484449:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416d35 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484455:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416d35 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15a9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484461:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416d35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484477:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002562.484506:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416d2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15a9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484518:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416d2e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15a9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484525:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416d2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.484643:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002562.484650:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416d35 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.484657:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002562.484661:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416d35 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15a9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.484670:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416d35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15a9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.484679:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a9:0x0].0x0 (ffff9ed36e785f00) 00010000:00010000:2.0:1786002562.484683:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786002562.484686:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416d35 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15a9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.484692:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578416d35 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15a9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002562.484702:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.484704:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002562.484705:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002562.484945:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.484950:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416d2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484956:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416d2e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484965:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15a9:0x0].0x0 (ffff9ed36e785f00) 00010000:00010000:0.0:1786002562.484968:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002562.484971:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416d2e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484977:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578416d2e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.484997:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d20 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.485093:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d20 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.485101:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.485108:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.485113:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002562.485116:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.485122:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d20 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.485130:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:0.0:1786002562.485133:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002562.485136:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d20 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.485141:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717600/0x7cee4af578416d20 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002562.485151:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ab00bb2 reply state 00000000cc7bac6b transno 4294984105 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.485160:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002562.485166:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x35965a95 (ffff9ed36e785e00) 00010000:00010000:0.0:1786002562.485168:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002562.485170:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002562.485263:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+191:19370:x1872758531007744:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1322us (1502us total) trans 4294984105 rc 0/0 00000100:00100000:0.0:1786002562.485270:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24155 00000100:00100000:2.0:1786002562.492003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002562.492094:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531008000 00000100:00100000:1.0:1786002562.492104:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531008000 00000100:00100000:1.0:1786002562.492164:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24156 00000100:00100000:1.0:1786002562.492174:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+191:19370:x1872758531008000:12345-192.168.203.49@tcp:36:unlinkmany.0 00010000:00010000:1.0:1786002562.492231:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002562.492256:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621a00/0x7cee4af57841624c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15aa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3afec expref: 191 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.492273:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15aa:0x0].0x0 (ffff9ed24206aa00) 00010000:00010000:1.0:1786002562.492283:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002562.492302:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416d3c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.492314:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416d3c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.492323:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416d3c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.492335:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416d43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1546:0x0].0x74956995 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.492341:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416d43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.492347:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416d43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.492399:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578416d4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15aa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.492406:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578416d4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15aa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.492411:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578416d4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15aa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786002562.492774:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].50, 64 off11392 00010000:00010000:1.0:1786002562.493113:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578416d51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493123:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578416d51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15aa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493130:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578416d51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15aa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493137:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578416d51 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15aa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493144:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578416d51 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15aa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493149:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578416d51 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15aa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493171:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786002562.493187:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578416d4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15aa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493193:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578416d4a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15aa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493198:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578416d4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15aa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493204:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.493208:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578416d4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15aa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493214:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578416d4a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15aa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493222:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15aa:0x0].0x0 (ffff9ed366c05900) 00010000:00010000:1.0:1786002562.493225:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786002562.493228:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578416d4a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15aa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493234:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998800/0x7cee4af578416d4a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15aa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493252:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416d3c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493258:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416d3c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493264:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416d3c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493269:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416d3c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493274:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002562.493277:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416d3c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493282:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416d3c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493290:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002562.493292:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002562.493295:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416d3c lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493301:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999c00/0x7cee4af578416d3c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1546:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002562.493310:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b163218 reply state 000000004895707e transno 4294984106 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416d43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493320:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416d43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002562.493326:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x74956995 (ffff9ed366c05a00) 00010000:00010000:1.0:1786002562.493328:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002562.493331:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002562.493390:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+192:19370:x1872758531008000:12345-192.168.203.49@tcp:36:unlinkmany.0 Request processed in 1217us (1395us total) trans 4294984106 rc 0/0 00000100:00100000:1.0:1786002562.493397:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24156 00010000:00010000:3.0:1786002562.493649:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002562.493655:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578416d51 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15aa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.493662:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002562.493665:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578416d51 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15aa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.493672:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578416d51 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15aa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.493681:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15aa:0x0].0x0 (ffff9ed366c05900) 00010000:00010000:3.0:1786002562.493684:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002562.493687:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578416d51 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15aa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.493692:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999200/0x7cee4af578416d51 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15aa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002562.493707:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.493708:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002562.493710:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786002562.927342:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969902 is committed 00000001:00080000:0.0:1786002562.928700:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969899 is committed 00010000:00010000:3.0:1786002563.050085:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786002563.343376:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984106 is committed 00000004:00080000:2.0:1786002563.343440:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 92 committed 00010000:00010000:0.0:1786002563.343549:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841636b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343562:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841636b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343568:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841636b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343575:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.343579:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841636b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343586:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841636b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343600:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x40eea295 (ffff9ed2456efc00) 00010000:00010000:0.0:1786002563.343603:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.343607:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841636b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343612:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46800/0x7cee4af57841636b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x40eea295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343636:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af578416387 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343643:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af578416387 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343649:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af578416387 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343655:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.343658:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af578416387 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343663:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af578416387 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.343666:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561011072:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.343670:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xea16437d (ffff9ed2456eff00) 00010000:00010000:0.0:1786002563.343672:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.343675:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af578416387 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343680:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af578416387 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xea16437d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343692:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620600/0x7cee4af5784163a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343697:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620600/0x7cee4af5784163a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343702:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620600/0x7cee4af5784163a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343706:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.343708:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620600/0x7cee4af5784163a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343713:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620600/0x7cee4af5784163a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343719:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x9897527d (ffff9ed24206a200) 00000100:00100000:3.0:1786002563.343722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786002563.343722:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.343725:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620600/0x7cee4af5784163a3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343730:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620600/0x7cee4af5784163a3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x9897527d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343742:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784163bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343748:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784163bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343752:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784163bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343757:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.343760:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784163bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.343765:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561011584:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.343766:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784163bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343773:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe423257d (ffff9ed2456ef000) 00010000:00010000:0.0:1786002563.343776:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.343779:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784163bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.343783:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786002563.343785:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784163bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe423257d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343797:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af5784163db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.343801:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786002563.343806:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561010944:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.343808:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af5784163db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343813:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af5784163db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343818:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.343821:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af5784163db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343827:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af5784163db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343834:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x970cb47d (ffff9ed343228600) 00010000:00010000:0.0:1786002563.343836:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.343839:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af5784163db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.343842:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786002563.343864:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770200/0x7cee4af5784163db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x970cb47d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.343873:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561011456:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.343881:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343887:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.343891:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786002563.343893:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343898:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.343901:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343907:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.343914:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561011072 00010000:00010000:0.0:1786002563.343914:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5239df7d (ffff9ed24206a100) 00010000:00010000:0.0:1786002563.343916:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002563.343919:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561011072 00010000:00010000:0.0:1786002563.343919:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343923:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621200/0x7cee4af5784163f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5239df7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343937:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578416413 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343943:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578416413 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343948:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578416413 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343952:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.343955:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578416413 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.343959:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561011584 00000100:00100000:3.0:1786002563.343961:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561011584 00010000:00010000:0.0:1786002563.343961:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578416413 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343968:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa5436e7d (ffff9ed2456ef100) 00010000:00010000:0.0:1786002563.343971:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002563.343973:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561010944 00010000:00010000:0.0:1786002563.343974:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578416413 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.343975:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561010944 00010000:00010000:0.0:1786002563.343980:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578416413 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa5436e7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.343987:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561011456 00000100:00100000:3.0:1786002563.343989:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561011456 00010000:00010000:0.0:1786002563.343992:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af57841642f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.343999:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af57841642f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.344004:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5246 00010000:00010000:0.0:1786002563.344004:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af57841642f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344009:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770c00 already unused, calling callback (ffffffffc18af4f0) 00000100:00100000:3.0:1786002563.344012:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3647:x1872758561011072:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.344012:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af57841642f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344018:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af57841642f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344024:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xead1417d (ffff9ed343228200) 00010000:00010000:0.0:1786002563.344025:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.344028:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af57841642f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344032:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770c00/0x7cee4af57841642f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xead1417d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1786002563.344035:0:14678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2513 count 1 00010000:00010000:0.0:1786002563.344044:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af57841644b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344054:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af57841644b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344059:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af57841644b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002563.344061:0:14678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002563.344065:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002563.344068:0:14678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c57f9b4/0x7cee4af578416d58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344068:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af57841644b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344074:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af57841644b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344081:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d1:0x0].0x0 since=923s v=(0 0) 00010000:00010000:0.0:1786002563.344081:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7d30507d (ffff9ed24206ae00) 00010000:00010000:0.0:1786002563.344083:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002563.344086:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002563.344086:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af57841644b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344091:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620e00/0x7cee4af57841644b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7d30507d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344092:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c57f9b4/0x7cee4af578416d58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344103:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af578416467 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344104:0:14678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c57f9b4/0x7cee4af578416d58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344109:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af578416467 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344112:0:14678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c57f9b4/0x7cee4af578416d58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344115:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af578416467 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344120:0:14678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c57f9b4/0x7cee4af578416d58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344120:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.344123:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af578416467 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344128:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af578416467 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344133:0:14678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002563.344135:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa468b7d (ffff9ed2456ef300) 00010000:00010000:0.0:1786002563.344137:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.344139:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af578416467 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344144:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af578416467 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa468b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344154:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d800/0x7cee4af578416483 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344171:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d800/0x7cee4af578416483 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344177:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d800/0x7cee4af578416483 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344181:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.344183:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d800/0x7cee4af578416483 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344188:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d800/0x7cee4af578416483 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344195:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xdf501a7d (ffff9ed37f5a4000) 00010000:00010000:0.0:1786002563.344197:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.344200:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d800/0x7cee4af578416483 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344205:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d800/0x7cee4af578416483 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xdf501a7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344219:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841649f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344225:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841649f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344230:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841649f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344235:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.344237:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841649f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344243:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841649f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.344251:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3647:x1872758561011072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 239us (527us total) trans 4294969903 rc 0/0 00010000:00010000:0.0:1786002563.344251:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8b6840d2 (ffff9ed2456ef400) 00010000:00010000:0.0:1786002563.344253:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.344256:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841649f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.344258:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5246 00010000:00010000:0.0:1786002563.344261:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841649f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8b6840d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.344272:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5247 00010000:00010000:0.0:1786002563.344274:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784164bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.344278:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3647:x1872758561011584:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.344284:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784164bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1786002563.344290:0:14678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2517 count 1 00010000:00010000:0.0:1786002563.344290:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784164bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344295:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.344298:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784164bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002563.344302:0:14678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002563.344303:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784164bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344306:0:14678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e676e01/0x7cee4af578416d5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344310:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa0674fd2 (ffff9ed343228d00) 00010000:00010000:0.0:1786002563.344313:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002563.344315:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d5:0x0].0x0 since=923s v=(0 0) 00010000:00010000:0.0:1786002563.344315:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784164bb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344318:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002563.344321:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770400/0x7cee4af5784164bb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa0674fd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344322:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e676e01/0x7cee4af578416d5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344331:0:14678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e676e01/0x7cee4af578416d5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344334:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784164d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344339:0:14678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e676e01/0x7cee4af578416d5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344340:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784164d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344347:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784164d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344348:0:14678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e676e01/0x7cee4af578416d5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344353:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.344356:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784164d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344360:0:14678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1786002563.344361:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784164d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344368:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x65f522d2 (ffff9ed24206ab00) 00010000:00010000:0.0:1786002563.344370:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.344373:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784164d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344378:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621800/0x7cee4af5784164d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x65f522d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344392:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344399:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344404:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344409:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771200 already unused, calling callback (ffffffffc18af4f0) 00000100:00100000:3.0:1786002563.344412:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3647:x1872758561011584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 134us (628us total) trans 4294969904 rc 0/0 00010000:00010000:0.0:1786002563.344412:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.344418:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5247 00010000:00010000:0.0:1786002563.344419:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344426:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x38feb1d2 (ffff9ed343228a00) 00000100:00100000:3.0:1786002563.344428:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5248 00010000:00010000:0.0:1786002563.344428:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.344431:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164f3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.344433:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3647:x1872758561010944:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.344437:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771200/0x7cee4af5784164f3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x38feb1d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1786002563.344443:0:14678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2512 count 1 00010000:00010000:0.0:1786002563.344451:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841650f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002563.344455:0:14678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.344459:0:14678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000258bdc76/0x7cee4af578416d66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344467:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d0:0x0].0x0 since=923s v=(0 0) 00010000:00010000:0.0:1786002563.344469:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841650f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344470:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.344474:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000258bdc76/0x7cee4af578416d66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344484:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841650f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344490:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002563.344493:0:14678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000258bdc76/0x7cee4af578416d66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344493:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841650f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344500:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841650f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344501:0:14678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000258bdc76/0x7cee4af578416d66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344508:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7c0bdcd2 (ffff9ed343228f00) 00010000:00010000:3.0:1786002563.344509:0:14678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000258bdc76/0x7cee4af578416d66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344510:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.344512:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841650f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344518:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770000/0x7cee4af57841650f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7c0bdcd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344522:0:14678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1786002563.344532:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841652b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344542:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841652b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344548:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841652b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344552:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.344555:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841652b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344561:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841652b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344568:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x27156bd2 (ffff9ed2456efb00) 00010000:00010000:0.0:1786002563.344570:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002563.344572:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3647:x1872758561010944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 139us (735us total) trans 4294969905 rc 0/0 00010000:00010000:0.0:1786002563.344573:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841652b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.344578:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5248 00010000:00010000:0.0:1786002563.344579:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af57841652b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x27156bd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.344588:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5249 00010000:00010000:0.0:1786002563.344593:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416547 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.344594:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3647:x1872758561011456:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.344599:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416547 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1786002563.344604:0:14678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2516 count 1 00010000:00010000:0.0:1786002563.344605:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416547 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344609:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.344613:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416547 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002563.344615:0:14678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.344620:0:14678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057d78c7e/0x7cee4af578416d6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344620:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416547 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344628:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d4:0x0].0x0 since=923s v=(0 0) 00010000:00010000:0.0:1786002563.344628:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xfd213ed2 (ffff9ed24206af00) 00010000:00010000:0.0:1786002563.344630:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002563.344631:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002563.344633:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416547 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344635:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057d78c7e/0x7cee4af578416d6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344639:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621000/0x7cee4af578416547 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xfd213ed2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344644:0:14678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057d78c7e/0x7cee4af578416d6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344651:0:14678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057d78c7e/0x7cee4af578416d6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344657:0:14678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057d78c7e/0x7cee4af578416d6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344661:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416563 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344666:0:14678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1786002563.344667:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416563 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344672:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416563 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344677:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.344680:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416563 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344686:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416563 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344694:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x81a24dd2 (ffff9ed2456ef800) 00010000:00010000:0.0:1786002563.344696:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.344699:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416563 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344704:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578416563 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x81a24dd2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.344714:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3647:x1872758561011456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 120us (821us total) trans 4294969906 rc 0/0 00010000:00010000:0.0:1786002563.344717:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841657f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.344720:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5249 00010000:00010000:0.0:1786002563.344723:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841657f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344729:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841657f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344733:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.344737:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841657f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344742:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841657f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344749:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1786002563.344749:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6cc088d2 (ffff9ed2456efa00) 00010000:00010000:0.0:1786002563.344752:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002563.344755:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c57f9b4/0x7cee4af578416d58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344755:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841657f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344761:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af57841657f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6cc088d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344762:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.344766:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c57f9b4/0x7cee4af578416d58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344773:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841659b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344779:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c57f9b4/0x7cee4af578416d58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344783:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841659b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344789:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841659b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344791:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c57f9b4/0x7cee4af578416d58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344793:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.344796:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841659b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344798:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c57f9b4/0x7cee4af578416d58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344802:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841659b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344808:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe9ca17d2 (ffff9ed24206a300) 00010000:00010000:3.0:1786002563.344810:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786002563.344810:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.344813:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841659b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344814:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e676e01/0x7cee4af578416d5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344820:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002563.344820:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621c00/0x7cee4af57841659b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe9ca17d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344824:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e676e01/0x7cee4af578416d5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344830:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e676e01/0x7cee4af578416d5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344832:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784165b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344838:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784165b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344839:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e676e01/0x7cee4af578416d5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344864:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784165b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344867:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e676e01/0x7cee4af578416d5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344869:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.344873:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784165b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344879:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784165b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344883:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786002563.344885:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa846083f (ffff9ed343228c00) 00010000:00010000:3.0:1786002563.344887:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000258bdc76/0x7cee4af578416d66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344888:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.344891:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784165b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344893:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.344896:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000258bdc76/0x7cee4af578416d66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344897:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770600/0x7cee4af5784165b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa846083f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344903:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000258bdc76/0x7cee4af578416d66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344910:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784165d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344911:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000258bdc76/0x7cee4af578416d66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344916:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784165d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344918:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000258bdc76/0x7cee4af578416d66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344922:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784165d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344927:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002563.344928:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002563.344930:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784165d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344931:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057d78c7e/0x7cee4af578416d6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344937:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784165d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344938:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.344941:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057d78c7e/0x7cee4af578416d6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344943:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb56f173f (ffff9ed37f5a4400) 00010000:00010000:0.0:1786002563.344945:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.344948:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784165d3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344954:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057d78c7e/0x7cee4af578416d6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344954:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c600/0x7cee4af5784165d3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb56f173f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344962:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057d78c7e/0x7cee4af578416d6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344966:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344969:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057d78c7e/0x7cee4af578416d6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344971:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344977:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344979:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002563.344980:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002563.344982:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002563.344983:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.344985:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.344987:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002563.344991:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.344997:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5432ea3f (ffff9ed24206a600) 00010000:00010000:0.0:1786002563.344999:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345001:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165ef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345005:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620a00/0x7cee4af5784165ef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5432ea3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.345011:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969902 gen 2 00000004:00080000:3.0:1786002563.345025:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f536680, transno 4294969902 00010000:00010000:0.0:1786002563.345027:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af57841660b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345036:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af57841660b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.345037:0:3647:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed243dd6680 x1872758561010944/t4294969905(4294969905) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786002579 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1786002563.345043:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af57841660b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002563.345048:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed243dd6680/2, rc 0, transno 4294969905 00010000:00010000:0.0:1786002563.345048:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345050:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af57841660b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.345053:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561010944:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.345056:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af57841660b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002563.345062:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc53b80/2, rc 0, transno 4294969906 00010000:00010000:0.0:1786002563.345063:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7f3c793f (ffff9ed343228700) 00010000:00010000:0.0:1786002563.345065:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002563.345066:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561011456:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.345068:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af57841660b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002563.345073:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc51f80/2, rc 0, transno 4294969903 00010000:00010000:0.0:1786002563.345074:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770e00/0x7cee4af57841660b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7f3c793f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.345076:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561011072:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002563.345083:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc52300/2, rc 0, transno 4294969904 00000100:00100000:3.0:1786002563.345086:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561011584:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.345088:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af578416627 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345094:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af578416627 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345099:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af578416627 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345103:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345106:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af578416627 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345111:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af578416627 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345118:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x98e9a43f (ffff9ed37f5a4c00) 00010000:00010000:0.0:1786002563.345120:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345123:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af578416627 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345128:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af578416627 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x98e9a43f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345140:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416643 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345147:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416643 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345152:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416643 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345156:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245770a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345159:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416643 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345166:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416643 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345173:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x43f3333f (ffff9ed343228500) 00010000:00010000:0.0:1786002563.345176:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345179:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416643 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.345184:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561012096:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.345184:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245770a00/0x7cee4af578416643 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x43f3333f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345197:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af57841665f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345204:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af57841665f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.345209:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786002563.345210:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af57841665f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345215:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345218:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af57841665f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345223:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af57841665f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.345227:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1786002563.345230:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5ae1063f (ffff9ed24206ac00) 00000100:00100000:3.0:1786002563.345231:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561011968:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.345233:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345236:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af57841665f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345241:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621600/0x7cee4af57841665f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5ae1063f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.345248:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786002563.345265:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841667b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345274:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841667b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345280:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841667b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345285:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245620800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345287:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841667b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345293:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841667b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345299:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6fe0153f (ffff9ed24206a400) 00010000:00010000:0.0:1786002563.345302:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345305:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841667b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345310:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245620800/0x7cee4af57841667b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6fe0153f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345324:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416697 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345329:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416697 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345334:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416697 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345338:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345341:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416697 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345345:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416697 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345351:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa91e503f (ffff9ed343228e00) 00010000:00010000:0.0:1786002563.345352:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345355:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416697 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345359:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47600/0x7cee4af578416697 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa91e503f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345369:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d600/0x7cee4af5784166b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345374:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d600/0x7cee4af5784166b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345379:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d600/0x7cee4af5784166b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345382:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345385:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d600/0x7cee4af5784166b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345389:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d600/0x7cee4af5784166b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345394:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xfc27df3f (ffff9ed37f5a4500) 00010000:00010000:0.0:1786002563.345396:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345398:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d600/0x7cee4af5784166b3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345403:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d600/0x7cee4af5784166b3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xfc27df3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345412:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784166cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345416:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784166cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345421:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784166cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345426:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345429:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784166cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345435:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784166cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345441:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6a358594 (ffff9ed245e35700) 00010000:00010000:0.0:1786002563.345443:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345445:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784166cf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345451:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784166cf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6a358594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345461:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af5784166eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345471:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af5784166eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345487:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af5784166eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345492:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345495:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af5784166eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345500:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af5784166eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345506:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x3f3f1494 (ffff9ed245e35200) 00010000:00010000:0.0:1786002563.345508:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345511:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af5784166eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345517:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af5784166eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x3f3f1494 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345543:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416707 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345549:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416707 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345555:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416707 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345560:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345564:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416707 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345570:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416707 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345578:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x584c3f94 (ffff9ed37f5a4f00) 00010000:00010000:0.0:1786002563.345580:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345583:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416707 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345589:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2dc00/0x7cee4af578416707 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x584c3f94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345602:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578416723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345608:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578416723 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345614:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578416723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345618:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345620:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578416723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345625:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578416723 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345630:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x55367694 (ffff9ed245e35c00) 00010000:00010000:0.0:1786002563.345631:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345634:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578416723 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345639:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578416723 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x55367694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345648:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841673f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345652:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841673f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345657:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841673f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345661:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345663:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841673f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345667:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841673f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345672:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xf0e3a194 (ffff9ed245e35b00) 00010000:00010000:0.0:1786002563.345674:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345676:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841673f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345680:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841673f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xf0e3a194 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345689:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af57841675b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345697:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af57841675b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345701:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af57841675b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345705:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345707:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af57841675b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345711:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af57841675b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345716:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x2fe2b094 (ffff9ed37f5a4900) 00010000:00010000:0.0:1786002563.345718:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345720:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af57841675b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345724:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af57841675b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x2fe2b094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345732:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416777 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345736:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416777 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345740:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416777 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345744:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345747:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416777 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345752:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416777 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345757:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xc8efdb94 (ffff9ed245e35300) 00010000:00010000:0.0:1786002563.345758:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345760:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416777 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345764:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af578416777 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xc8efdb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345772:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af578416793 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345777:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af578416793 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345781:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af578416793 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345785:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345787:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af578416793 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345791:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af578416793 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345796:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x45da1294 (ffff9ed245e35900) 00010000:00010000:0.0:1786002563.345797:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345801:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af578416793 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345805:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af578416793 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x45da1294 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345813:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af5784167af lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345818:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af5784167af lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345822:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af5784167af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345826:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345828:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af5784167af lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345832:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af5784167af lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345837:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd2f04d94 (ffff9ed24206a500) 00010000:00010000:0.0:1786002563.345839:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345841:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af5784167af lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345861:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245621e00/0x7cee4af5784167af lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd2f04d94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345887:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af5784167cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345895:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af5784167cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345900:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af5784167cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345904:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345906:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af5784167cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345911:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af5784167cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345916:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7df9dc94 (ffff9ed37f5a4a00) 00010000:00010000:0.0:1786002563.345917:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345920:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af5784167cb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345925:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c000/0x7cee4af5784167cb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7df9dc94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345935:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345941:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345947:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345952:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345955:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345962:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345968:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xda336479 (ffff9ed37f5a4d00) 00010000:00010000:0.0:1786002563.345970:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.345972:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167e7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345976:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784167e7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xda336479 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345984:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af578416803 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345989:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af578416803 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345993:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af578416803 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.345997:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.345999:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af578416803 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346004:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af578416803 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346009:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x3abc7379 (ffff9ed245e35000) 00010000:00010000:0.0:1786002563.346011:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.346013:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af578416803 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346019:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83c00/0x7cee4af578416803 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x3abc7379 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346028:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841681f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346034:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841681f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346040:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841681f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346044:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.346047:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841681f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346053:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841681f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346059:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x32204679 (ffff9ed245e35a00) 00010000:00010000:0.0:1786002563.346061:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.346063:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841681f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346069:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841681f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x32204679 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346079:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841683b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346089:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841683b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346096:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841683b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346101:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2cc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.346103:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841683b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346109:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841683b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346115:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x2f29d579 (ffff9ed37f5a4100) 00010000:00010000:0.0:1786002563.346118:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.346120:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841683b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346126:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2cc00/0x7cee4af57841683b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x2f29d579 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346136:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578416857 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346142:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578416857 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346148:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578416857 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346152:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.346155:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578416857 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346160:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578416857 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346166:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xcad70079 (ffff9ed245e35100) 00010000:00010000:0.0:1786002563.346167:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.346169:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578416857 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346174:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578416857 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xcad70079 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346183:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416873 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346187:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416873 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346191:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416873 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346195:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.346197:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416873 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346201:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416873 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346206:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x71408f79 (ffff9ed245e35f00) 00010000:00010000:0.0:1786002563.346208:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.346210:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416873 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346215:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af578416873 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x71408f79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346222:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af57841688f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346227:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af57841688f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346231:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af57841688f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346235:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.346237:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af57841688f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346241:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af57841688f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346246:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa2c3e279 (ffff9ed245e35500) 00010000:00010000:0.0:1786002563.346247:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.346249:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af57841688f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346253:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af57841688f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa2c3e279 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346263:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6a00/0x7cee4af5784168ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346270:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6a00/0x7cee4af5784168ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346274:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6a00/0x7cee4af5784168ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346278:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.346281:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6a00/0x7cee4af5784168ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346285:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6a00/0x7cee4af5784168ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346290:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x77cd7179 (ffff9ed245e35e00) 00010000:00010000:0.0:1786002563.346292:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.346294:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6a00/0x7cee4af5784168ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346298:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6a00/0x7cee4af5784168ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x77cd7179 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346306:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346311:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346315:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346318:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.346321:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346326:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346331:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe58bac79 (ffff9ed245e35600) 00010000:00010000:0.0:1786002563.346332:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.346334:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346339:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7a00/0x7cee4af5784168c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe58bac79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346348:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784168e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346353:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784168e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346357:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784168e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346361:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.346363:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784168e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346367:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784168e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346372:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8bf53b79 (ffff9ed37f5a4700) 00010000:00010000:0.0:1786002563.346374:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.346377:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784168e3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346381:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ca00/0x7cee4af5784168e3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8bf53b79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346390:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346394:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346399:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346402:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.346405:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346409:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346414:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa6a2e1ce (ffff9ed245e35400) 00010000:00010000:0.0:1786002563.346416:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.346417:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346422:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7000/0x7cee4af5784168ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa6a2e1ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346432:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af57841691b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346440:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af57841691b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346445:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af57841691b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346448:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.346450:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af57841691b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346455:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af57841691b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346460:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x4d0c70ce (ffff9ed245e35800) 00010000:00010000:0.0:1786002563.346461:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.346463:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af57841691b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346467:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7400/0x7cee4af57841691b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x4d0c70ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.346475:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af578416937 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002563.346663:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561010816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786002563.346699:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002563.346730:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561011328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786002563.346746:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002563.346757:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561011840:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786002563.346770:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002563.346782:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1786002563.346787:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561011200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786002563.346801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002563.346810:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561011712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786002563.346823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002563.346832:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561012224:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786002563.346865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002563.347916:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561012096 00000100:00100000:1.0:1786002563.347925:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561012096 00000100:00100000:1.0:1786002563.347958:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561011968 00000100:00100000:1.0:1786002563.347961:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561011968 00000100:00100000:1.0:1786002563.347969:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561010816 00000100:00100000:1.0:1786002563.347971:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561010816 00000100:00100000:1.0:1786002563.347978:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561011328 00000100:00100000:1.0:1786002563.347981:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561011328 00000100:00100000:1.0:1786002563.347991:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561011840 00000100:00100000:1.0:1786002563.347992:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561011840 00000100:00100000:1.0:1786002563.348000:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561011200 00000100:00100000:1.0:1786002563.348001:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561011200 00000100:00100000:1.0:1786002563.348008:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561011712 00000100:00100000:1.0:1786002563.348010:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561011712 00000100:00100000:1.0:1786002563.348017:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561012224 00000100:00100000:1.0:1786002563.348019:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561012224 00000100:00100000:1.0:1786002563.348030:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5250 00000100:00100000:1.0:1786002563.348036:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3647:x1872758561012096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002563.348057:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2521 count 1 00002000:00010000:1.0:1786002563.348082:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002563.348088:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c94fe4e/0x7cee4af578416d74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348100:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d9:0x0].0x0 since=923s v=(0 0) 00010000:00010000:1.0:1786002563.348103:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002563.348108:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c94fe4e/0x7cee4af578416d74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348119:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c94fe4e/0x7cee4af578416d74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348127:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c94fe4e/0x7cee4af578416d74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348133:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c94fe4e/0x7cee4af578416d74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348150:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786002563.348273:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3647:x1872758561012096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 237us (3063us total) trans 4294969907 rc 0/0 00000100:00100000:1.0:1786002563.348279:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5250 00000100:00100000:1.0:1786002563.348300:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5251 00000100:00100000:1.0:1786002563.348305:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3647:x1872758561011968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002563.348314:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2520 count 1 00002000:00010000:1.0:1786002563.348326:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002563.348330:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f0304cf/0x7cee4af578416d7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348337:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d8:0x0].0x0 since=923s v=(0 0) 00010000:00010000:1.0:1786002563.348339:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002563.348343:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f0304cf/0x7cee4af578416d7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348351:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f0304cf/0x7cee4af578416d7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348357:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f0304cf/0x7cee4af578416d7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348363:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f0304cf/0x7cee4af578416d7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348375:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1786002563.348422:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3647:x1872758561011968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 117us (3173us total) trans 4294969908 rc 0/0 00000100:00100000:1.0:1786002563.348427:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5251 00000100:00100000:1.0:1786002563.348440:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5252 00000100:00100000:1.0:1786002563.348445:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3645:x1872758561010816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002563.348555:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2511 count 1 00002000:00010000:1.0:1786002563.348570:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002563.348575:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dace9d1/0x7cee4af578416d82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348582:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cf:0x0].0x0 since=923s v=(0 0) 00010000:00010000:1.0:1786002563.348584:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002563.348588:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dace9d1/0x7cee4af578416d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348595:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dace9d1/0x7cee4af578416d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348601:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dace9d1/0x7cee4af578416d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348607:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dace9d1/0x7cee4af578416d82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348618:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1786002563.348674:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3645:x1872758561010816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 229us (1974us total) trans 4294969909 rc 0/0 00000100:00100000:1.0:1786002563.348680:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5252 00000100:00100000:1.0:1786002563.348705:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5253 00000100:00100000:1.0:1786002563.348711:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3645:x1872758561011328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002563.348721:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2515 count 1 00002000:00010000:1.0:1786002563.348732:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002563.348736:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d96a6d48/0x7cee4af578416d89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348743:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d3:0x0].0x0 since=923s v=(0 0) 00010000:00010000:1.0:1786002563.348745:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002563.348749:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d96a6d48/0x7cee4af578416d89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348756:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d96a6d48/0x7cee4af578416d89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348762:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d96a6d48/0x7cee4af578416d89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348768:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d96a6d48/0x7cee4af578416d89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348778:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1786002563.348825:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3645:x1872758561011328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 114us (2077us total) trans 4294969910 rc 0/0 00000100:00100000:1.0:1786002563.348831:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5253 00000100:00100000:1.0:1786002563.348842:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5254 00000100:00100000:1.0:1786002563.348868:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3645:x1872758561011840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002563.348879:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2519 count 1 00002000:00010000:1.0:1786002563.348892:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002563.348897:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c942e5c/0x7cee4af578416d90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348905:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d7:0x0].0x0 since=923s v=(0 0) 00010000:00010000:1.0:1786002563.348908:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002563.348912:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c942e5c/0x7cee4af578416d90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348920:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c942e5c/0x7cee4af578416d90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348928:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c942e5c/0x7cee4af578416d90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348935:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c942e5c/0x7cee4af578416d90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.348947:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1786002563.348961:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5255 00000100:00100000:3.0:1786002563.348970:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3645:x1872758561011200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002563.348983:0:14676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2514 count 1 00002000:00010000:3.0:1786002563.348996:0:14676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.349002:0:14676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084a2081/0x7cee4af578416d97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002563.349002:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3645:x1872758561011840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 154us (2230us total) trans 4294969911 rc 0/0 00000100:00100000:1.0:1786002563.349008:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5254 00010000:00010000:3.0:1786002563.349011:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d2:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.349013:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.349017:0:14676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000084a2081/0x7cee4af578416d97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002563.349019:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5256 00000100:00100000:1.0:1786002563.349024:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3645:x1872758561011712:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1786002563.349027:0:14676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000084a2081/0x7cee4af578416d97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349034:0:14676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084a2081/0x7cee4af578416d97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1786002563.349034:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2518 count 1 00010000:00010000:3.0:1786002563.349041:0:14676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000084a2081/0x7cee4af578416d97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002563.349045:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002563.349050:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8eb75a8/0x7cee4af578416d9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349055:0:14676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1786002563.349057:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d6:0x0].0x0 since=923s v=(0 0) 00010000:00010000:1.0:1786002563.349060:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002563.349063:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8eb75a8/0x7cee4af578416d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.349072:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8eb75a8/0x7cee4af578416d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.349079:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8eb75a8/0x7cee4af578416d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.349087:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8eb75a8/0x7cee4af578416d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.349099:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:3.0:1786002563.349112:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3645:x1872758561011200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 144us (2310us total) trans 4294969912 rc 0/0 00000100:00100000:3.0:1786002563.349118:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5255 00000100:00100000:3.0:1786002563.349130:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5257 00000100:00100000:3.0:1786002563.349136:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3645:x1872758561012224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002563.349147:0:14676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2522 count 1 00000100:00100000:1.0:1786002563.349150:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3645:x1872758561011712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 126us (2326us total) trans 4294969913 rc 0/0 00002000:00010000:3.0:1786002563.349159:0:14676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.349164:0:14676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ec4776/0x7cee4af578416da5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349172:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9da:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.349175:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.349178:0:14676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ec4776/0x7cee4af578416da5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349187:0:14676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5ec4776/0x7cee4af578416da5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349195:0:14676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ec4776/0x7cee4af578416da5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349203:0:14676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ec4776/0x7cee4af578416da5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002563.349214:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5256 00010000:00010000:3.0:1786002563.349216:0:14676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000004:00080000:1.0:1786002563.349262:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc52d80/2, rc 0, transno 4294969912 00000100:00100000:3.0:1786002563.349270:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3645:x1872758561012224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 134us (2423us total) trans 4294969914 rc 0/0 00000100:00100000:1.0:1786002563.349274:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561011200:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002563.349276:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5257 00000004:00080000:1.0:1786002563.349285:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc51180/2, rc 0, transno 4294969913 00000100:00100000:1.0:1786002563.349289:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561011712:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1786002563.349296:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2467f0380/2, rc 0, transno 4294969914 00010000:00010000:3.0:1786002563.349299:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00000100:00100000:1.0:1786002563.349299:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561012224:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1786002563.349305:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c94fe4e/0x7cee4af578416d74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002563.349308:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed243dd5880/2, rc 0, transno 4294969909 00000100:00100000:1.0:1786002563.349311:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561010816:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1786002563.349313:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.349317:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c94fe4e/0x7cee4af578416d74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002563.349317:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc51500/2, rc 0, transno 4294969910 00000100:00100000:1.0:1786002563.349320:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561011328:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1786002563.349327:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c94fe4e/0x7cee4af578416d74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002563.349327:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc50000/2, rc 0, transno 4294969911 00000100:00100000:1.0:1786002563.349330:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561011840:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1786002563.349342:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c94fe4e/0x7cee4af578416d74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349350:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c94fe4e/0x7cee4af578416d74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349366:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1786002563.349369:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f0304cf/0x7cee4af578416d7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349380:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.349383:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f0304cf/0x7cee4af578416d7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349390:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f0304cf/0x7cee4af578416d7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349400:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f0304cf/0x7cee4af578416d7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349406:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f0304cf/0x7cee4af578416d7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349418:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786002563.349420:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dace9d1/0x7cee4af578416d82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349426:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.349429:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dace9d1/0x7cee4af578416d82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349436:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dace9d1/0x7cee4af578416d82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349443:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dace9d1/0x7cee4af578416d82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349449:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dace9d1/0x7cee4af578416d82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349458:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786002563.349461:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d96a6d48/0x7cee4af578416d89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349467:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.349470:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d96a6d48/0x7cee4af578416d89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349487:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d96a6d48/0x7cee4af578416d89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349497:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d96a6d48/0x7cee4af578416d89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349505:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d96a6d48/0x7cee4af578416d89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349517:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786002563.349520:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c942e5c/0x7cee4af578416d90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349526:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.349529:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c942e5c/0x7cee4af578416d90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349537:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c942e5c/0x7cee4af578416d90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349546:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c942e5c/0x7cee4af578416d90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349546:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af578416937 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349553:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af578416937 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349554:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c942e5c/0x7cee4af578416d90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349558:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.349563:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af578416937 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349565:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786002563.349568:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000084a2081/0x7cee4af578416d97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349569:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af578416937 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349575:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.349577:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000084a2081/0x7cee4af578416d97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349580:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe8b99bce (ffff9ed37f5a4600) 00010000:00010000:0.0:1786002563.349583:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002563.349585:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000084a2081/0x7cee4af578416d97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349586:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af578416937 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349593:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2ce00/0x7cee4af578416937 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe8b99bce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349594:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000084a2081/0x7cee4af578416d97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349600:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084a2081/0x7cee4af578416d97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349611:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786002563.349611:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416953 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349614:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8eb75a8/0x7cee4af578416d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349617:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416953 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349620:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002563.349623:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416953 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349624:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8eb75a8/0x7cee4af578416d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349629:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002563.349631:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8eb75a8/0x7cee4af578416d9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349632:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416953 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349638:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416953 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349639:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8eb75a8/0x7cee4af578416d9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349645:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x91a3d2ce (ffff9ed245e35d00) 00010000:00010000:3.0:1786002563.349646:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8eb75a8/0x7cee4af578416d9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349647:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.349650:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416953 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349656:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002563.349656:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7e00/0x7cee4af578416953 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x91a3d2ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349659:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5ec4776/0x7cee4af578416da5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349664:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.349667:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ec4776/0x7cee4af578416da5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349669:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6200/0x7cee4af57841696f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349676:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6200/0x7cee4af57841696f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349681:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ec4776/0x7cee4af578416da5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349682:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6200/0x7cee4af57841696f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349688:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002563.349690:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5ec4776/0x7cee4af578416da5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349690:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6200/0x7cee4af57841696f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349696:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6200/0x7cee4af57841696f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349697:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5ec4776/0x7cee4af578416da5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349703:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa0d0fdce (ffff9ed3465ad300) 00010000:00010000:0.0:1786002563.349705:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002563.349706:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002563.349708:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002563.349708:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6200/0x7cee4af57841696f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349709:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002563.349714:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6200/0x7cee4af57841696f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa0d0fdce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.349718:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002563.349725:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af57841698b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349734:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af57841698b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349738:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af57841698b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349743:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.349745:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af57841698b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349751:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af57841698b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349758:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x95b00cce (ffff9ed3465adf00) 00010000:00010000:0.0:1786002563.349760:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.349763:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af57841698b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349768:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca7c00/0x7cee4af57841698b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x95b00cce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349780:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af5784169a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349787:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af5784169a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349793:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af5784169a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349799:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.349802:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af5784169a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.349808:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561012736:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1786002563.349808:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af5784169a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349815:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd0dd37ce (ffff9ed3465add00) 00010000:00010000:0.0:1786002563.349817:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.349819:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af5784169a7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349825:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ca6000/0x7cee4af5784169a7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd0dd37ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349837:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784169c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349843:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784169c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349866:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784169c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349871:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.349875:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784169c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349881:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784169c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349889:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x77c76ece (ffff9ed3465ad000) 00010000:00010000:0.0:1786002563.349891:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.349895:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784169c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349900:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784169c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x77c76ece bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349913:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af5784169df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349919:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af5784169df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349924:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af5784169df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349929:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82c00 already unused, calling callback (ffffffffc18af4f0) 00000004:00080000:2.0:1786002563.349930:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 89 committed 00010000:00010000:0.0:1786002563.349931:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af5784169df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349937:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af5784169df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349944:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe585a9ce (ffff9ed3465ad600) 00010000:00010000:0.0:1786002563.349946:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.349949:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af5784169df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349954:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af5784169df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe585a9ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349964:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784169fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349973:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784169fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349978:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784169fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349982:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.349984:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784169fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.349990:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784169fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.349996:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002563.349996:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x4de4b8ce (ffff9ed37f5a4e00) 00010000:00010000:0.0:1786002563.349999:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.350001:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784169fb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350006:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d200/0x7cee4af5784169fb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x4de4b8ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350018:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578416a17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350025:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578416a17 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350031:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578416a17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350036:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.350039:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578416a17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350044:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578416a17 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350051:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x5501ae7b (ffff9ed2456ef700) 00010000:00010000:0.0:1786002563.350053:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.350056:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578416a17 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350062:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578416a17 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x5501ae7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350075:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578416a33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350081:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578416a33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350086:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578416a33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350091:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.350093:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578416a33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350099:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578416a33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350106:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb3d7b (ffff9ed24206a900) 00010000:00010000:0.0:1786002563.350109:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.350112:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578416a33 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350117:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35c00/0x7cee4af578416a33 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb3d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350130:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350137:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a4f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350143:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350148:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.350150:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350156:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a4f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350522:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x170e687b (ffff9ed245fed400) 00010000:00010000:0.0:1786002563.350524:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.350527:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a4f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350532:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35200/0x7cee4af578416a4f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x170e687b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350546:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350555:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350560:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350565:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.350568:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350574:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350580:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x95f89f7b (ffff9ed3465ad100) 00010000:00010000:0.0:1786002563.350581:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.350583:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a6b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350588:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578416a6b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x95f89f7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350601:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416a87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350606:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416a87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350611:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416a87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350614:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.350617:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416a87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350622:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416a87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350627:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xd905ca7b (ffff9ed366c05600) 00010000:00010000:0.0:1786002563.350629:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.350631:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416a87 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350635:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47c00/0x7cee4af578416a87 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xd905ca7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350644:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416aa3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350648:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416aa3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350653:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416aa3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350656:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.350658:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416aa3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350663:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416aa3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350668:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xee04d97b (ffff9ed366c05800) 00010000:00010000:0.0:1786002563.350670:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.350672:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416aa3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350677:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46600/0x7cee4af578416aa3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xee04d97b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350686:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416abf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350691:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416abf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350695:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416abf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350699:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.350701:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416abf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350706:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416abf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350711:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xdfb2047b (ffff9ed37f5a4800) 00010000:00010000:0.0:1786002563.350712:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.350714:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416abf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350718:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d000/0x7cee4af578416abf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xdfb2047b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350727:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416adb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350735:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416adb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350740:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416adb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350743:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.350746:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416adb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350750:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416adb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350755:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x869c3b7b (ffff9ed366c05400) 00010000:00010000:0.0:1786002563.350756:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.350758:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416adb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350762:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47000/0x7cee4af578416adb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x869c3b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350771:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416af7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350775:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416af7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350779:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416af7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350783:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.350785:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416af7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350790:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416af7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350796:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x9bba767b (ffff9ed3465ade00) 00010000:00010000:0.0:1786002563.350798:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.350800:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416af7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350804:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578416af7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x9bba767b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350813:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717e00/0x7cee4af578416b13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350818:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717e00/0x7cee4af578416b13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350823:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717e00/0x7cee4af578416b13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350827:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.350830:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717e00/0x7cee4af578416b13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350834:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717e00/0x7cee4af578416b13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350840:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x8b9857b (ffff9ed36e785800) 00010000:00010000:0.0:1786002563.350842:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.350861:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717e00/0x7cee4af578416b13 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350867:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717e00/0x7cee4af578416b13 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x8b9857b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350881:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416b2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350887:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416b2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350893:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416b2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350898:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.350901:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416b2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350907:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416b2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350914:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb4d1abd0 (ffff9ed366c05200) 00010000:00010000:0.0:1786002563.350916:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.350919:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416b2f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.350920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786002563.350924:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46200/0x7cee4af578416b2f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb4d1abd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350937:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416b4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350947:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416b4b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350952:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416b4b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.350957:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.350960:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416b4b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002563.351006:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561013248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786002563.351015:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561012352:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002563.351030:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786002563.351597:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416b4b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351610:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x7db3ad0 (ffff9ed245fedf00) 00010000:00010000:0.0:1786002563.351613:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.351616:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416b4b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351623:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35800/0x7cee4af578416b4b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x7db3ad0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351657:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578416b67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351664:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578416b67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351670:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578416b67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351675:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.351678:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578416b67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351684:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578416b67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351691:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x798865d0 (ffff9ed245fedb00) 00010000:00010000:0.0:1786002563.351693:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.351695:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578416b67 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351701:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34000/0x7cee4af578416b67 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x798865d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351711:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416b83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351717:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416b83 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351723:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416b83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351726:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.351729:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416b83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351733:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416b83 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351739:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xa0729cd0 (ffff9ed37f5a4300) 00010000:00010000:0.0:1786002563.351740:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.351743:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416b83 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351748:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3800/0x7cee4af578416b83 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xa0729cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351757:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416b9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351761:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416b9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351766:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416b9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351770:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.351772:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416b9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351777:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416b9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351782:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe37fc7d0 (ffff9ed36e785c00) 00010000:00010000:0.0:1786002563.351783:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.351785:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416b9f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351789:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716600/0x7cee4af578416b9f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe37fc7d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351798:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416bbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351805:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416bbb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351810:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416bbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351814:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c46000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.351816:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416bbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351820:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416bbb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351825:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x507ed6d0 (ffff9ed366c05c00) 00010000:00010000:0.0:1786002563.351827:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.351829:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416bbb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.351833:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c46000/0x7cee4af578416bbb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x507ed6d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353238:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416bd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353248:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416bd7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353253:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416bd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353257:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245c47400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.353261:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416bd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353266:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416bd7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353275:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xea2c01d0 (ffff9ed366c05f00) 00010000:00010000:0.0:1786002563.353277:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.353280:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416bd7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353284:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c47400/0x7cee4af578416bd7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xea2c01d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353309:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416bf3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353315:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416bf3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353319:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416bf3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353323:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.353325:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416bf3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353329:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416bf3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353334:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xe91638d0 (ffff9ed36e785400) 00010000:00010000:0.0:1786002563.353336:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.353339:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416bf3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353344:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af578416bf3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xe91638d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353367:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af578416c0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353372:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af578416c0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353377:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af578416c0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353380:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245771a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.353383:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af578416c0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353387:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af578416c0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353392:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xfe3473d0 (ffff9ed366c05d00) 00010000:00010000:0.0:1786002563.353393:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.353395:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af578416c0f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353399:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245771a00/0x7cee4af578416c0f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xfe3473d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353423:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578416c2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353433:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578416c2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353440:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578416c2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353445:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.353448:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578416c2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353579:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578416c2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353590:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x133382d0 (ffff9ed366c05300) 00010000:00010000:0.0:1786002563.353592:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.353595:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578416c2b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353601:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999600/0x7cee4af578416c2b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x133382d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353616:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578416c47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353623:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578416c47 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353629:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578416c47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353634:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.353637:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578416c47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353643:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578416c47 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353649:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xeedd9295 (ffff9ed245fed800) 00010000:00010000:0.0:1786002563.353651:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.353654:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578416c47 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353659:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35a00/0x7cee4af578416c47 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xeedd9295 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353669:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353676:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c63 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353682:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353687:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.353691:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353697:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c63 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353703:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6be72195 (ffff9ed366c05700) 00010000:00010000:0.0:1786002563.353705:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.353708:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c63 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353714:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998a00/0x7cee4af578416c63 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6be72195 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353724:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416c7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353730:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416c7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353736:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416c7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353741:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.353744:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416c7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353750:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416c7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353756:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6d724c95 (ffff9ed366c05b00) 00010000:00010000:0.0:1786002563.353758:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.353761:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416c7f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353766:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244999400/0x7cee4af578416c7f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6d724c95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353776:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353786:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353793:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353798:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.353800:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353806:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353813:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x6a5c8395 (ffff9ed245fede00) 00010000:00010000:0.0:1786002563.353815:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.353817:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c9b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353822:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f35600/0x7cee4af578416c9b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x6a5c8395 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353832:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416cb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353913:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416cb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353920:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416cb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353925:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.353928:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416cb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353933:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416cb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353941:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x609ae95 (ffff9ed366c05000) 00010000:00010000:0.0:1786002563.353943:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.353946:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416cb7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353950:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998200/0x7cee4af578416cb7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x609ae95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353966:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416cd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353972:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416cd3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353977:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416cd3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353982:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.353985:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416cd3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353991:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416cd3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.353998:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x9d08bd95 (ffff9ed36e785700) 00010000:00010000:0.0:1786002563.354000:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.354003:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416cd3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354009:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717400/0x7cee4af578416cd3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x9d08bd95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354020:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354025:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354032:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354037:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.354040:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354045:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354052:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x3615e895 (ffff9ed36e785900) 00010000:00010000:0.0:1786002563.354053:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.354056:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354062:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716800/0x7cee4af578416cef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x3615e895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354075:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416d0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354085:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416d0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354091:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416d0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354095:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.354731:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416d0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354742:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416d0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354752:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0xb3001f95 (ffff9ed36e785500) 00010000:00010000:0.0:1786002563.354754:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.354757:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416d0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354763:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716400/0x7cee4af578416d0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0xb3001f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354778:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354784:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354790:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354796:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.354799:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354806:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354812:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x35965a95 (ffff9ed36e785e00) 00010000:00010000:0.0:1786002563.354814:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.354816:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d27 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354821:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578416d27 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x35965a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354831:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416d43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.354836:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416d43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.355226:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416d43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.355232:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002563.355236:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416d43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.355242:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416d43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.355250:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x74956995 (ffff9ed366c05a00) 00010000:00010000:0.0:1786002563.355253:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002563.355256:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416d43 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.355263:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244998e00/0x7cee4af578416d43 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1546:0x0].0x74956995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786002563.355285:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002563.355400:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561013760:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002563.355449:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.357934:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561012736 00000100:00100000:2.0:1786002563.357945:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561012736 00000100:00100000:2.0:1786002563.358000:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561013248 00000100:00100000:2.0:1786002563.358003:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561013248 00000100:00100000:2.0:1786002563.358032:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5258 00000100:00100000:2.0:1786002563.358041:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3644:x1872758561012736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786002563.358066:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2526 count 1 00002000:00010000:2.0:1786002563.358093:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.358099:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af578416dac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358113:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9de:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.358118:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.358124:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af578416dac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358136:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af578416dac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358144:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af578416dac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358151:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af578416dac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358166:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786002563.358307:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3644:x1872758561012736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 267us (7387us total) trans 4294969915 rc 0/0 00000100:00100000:2.0:1786002563.358314:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5258 00000100:00100000:2.0:1786002563.358329:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5259 00000100:00100000:2.0:1786002563.358335:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561013248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.358345:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2511 count 1 00002000:00010000:2.0:1786002563.358359:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.358364:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416db3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358372:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cf:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.358375:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.358379:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416db3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358387:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416db3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358395:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416db3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358401:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416db3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358413:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786002563.358491:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3644:x1872758561013248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 144us (7447us total) trans 4294969900 rc 0/0 00000100:00100000:2.0:1786002563.358497:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5259 00000100:00080000:2.0:1786002563.358522:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786002563.358530:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002563.358536:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af578416dac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358543:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002563.358547:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af578416dac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358556:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af578416dac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358570:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af578416dac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358576:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af578416dac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358591:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002563.358595:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416db3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358600:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002563.358603:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416db3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358609:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416db3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358622:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416db3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358629:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416db3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.358639:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002563.358640:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002563.358641:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002563.358647:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002563.360632:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561012480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786002563.360678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.360723:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561012992:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786002563.360742:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.360757:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561013504:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.360776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002563.360789:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561012480 00000100:00100000:2.0:1786002563.360791:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561014016:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002563.360795:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561012480 00000100:00100000:2.0:1786002563.360807:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.360863:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1786002563.360869:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561012608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786002563.360889:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.365674:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561013120:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.365722:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786002563.368436:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f0e00/2, rc 0, transno 4294969915 00000100:00100000:3.0:1786002563.368451:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561012736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002563.368472:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969899 gen 2 00000004:00080000:3.0:1786002563.368499:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454c3b80, transno 4294969899 00000100:00100000:3.0:1786002563.368510:0:3644:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed244be5180 x1872758561013248/t4294969900(4294969900) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786002579 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1786002563.368519:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be5180/2, rc 0, transno 4294969900 00000100:00100000:3.0:1786002563.368523:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561013248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002563.368659:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561012992 00000100:00100000:3.0:1786002563.368664:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561012992 00000100:00100000:3.0:1786002563.368698:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561013504 00000100:00100000:3.0:1786002563.368701:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561013504 00000100:00100000:3.0:1786002563.368713:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561014016 00000100:00100000:3.0:1786002563.368716:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561014016 00000100:00100000:3.0:1786002563.368727:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561012608 00000100:00100000:3.0:1786002563.368729:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561012608 00000100:00100000:3.0:1786002563.368737:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561013760 00000100:00100000:3.0:1786002563.368740:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561013760 00000100:00100000:3.0:1786002563.368753:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5260 00000100:00100000:3.0:1786002563.368760:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3646:x1872758561012480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002563.368785:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2524 count 1 00002000:00010000:3.0:1786002563.369926:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.369937:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ce922fa/0x7cee4af578416dba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.369952:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dc:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.369956:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.369962:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ce922fa/0x7cee4af578416dba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.369976:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ce922fa/0x7cee4af578416dba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.369986:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ce922fa/0x7cee4af578416dba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.369994:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ce922fa/0x7cee4af578416dba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370017:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786002563.370137:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3646:x1872758561012480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1375us (9456us total) trans 4294969916 rc 0/0 00000100:00100000:3.0:1786002563.370143:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5260 00000100:00100000:3.0:1786002563.370165:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5261 00000100:00100000:3.0:1786002563.370172:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3646:x1872758561012992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002563.370187:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2528 count 1 00002000:00010000:3.0:1786002563.370202:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.370207:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d70d5aff/0x7cee4af578416dc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370215:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e0:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.370218:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.370221:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d70d5aff/0x7cee4af578416dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370230:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d70d5aff/0x7cee4af578416dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370238:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d70d5aff/0x7cee4af578416dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370286:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d70d5aff/0x7cee4af578416dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370301:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1786002563.370357:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3646:x1872758561012992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 186us (9614us total) trans 4294969917 rc 0/0 00000100:00100000:3.0:1786002563.370364:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5261 00000100:00100000:3.0:1786002563.370377:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5262 00000100:00100000:3.0:1786002563.370383:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3646:x1872758561013504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786002563.370395:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2513 count 1 00002000:00010000:3.0:1786002563.370410:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.370415:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cd73965/0x7cee4af578416dc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370424:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d1:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.370427:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.370431:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cd73965/0x7cee4af578416dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370441:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cd73965/0x7cee4af578416dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370449:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cd73965/0x7cee4af578416dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370460:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cd73965/0x7cee4af578416dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370473:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1786002563.370550:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3646:x1872758561013504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 165us (9771us total) trans 4294969901 rc 0/0 00000100:00100000:3.0:1786002563.370556:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5262 00000100:00100000:3.0:1786002563.370567:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5263 00000100:00100000:3.0:1786002563.370573:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3646:x1872758561014016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786002563.370582:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2517 count 1 00002000:00010000:3.0:1786002563.370594:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.370599:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000853986cf/0x7cee4af578416dcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370606:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d5:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.370609:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.370613:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000853986cf/0x7cee4af578416dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370621:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000853986cf/0x7cee4af578416dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370628:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000853986cf/0x7cee4af578416dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370639:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000853986cf/0x7cee4af578416dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370646:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1786002563.370697:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3646:x1872758561014016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 124us (9888us total) trans 4294969902 rc 0/0 00000100:00100000:3.0:1786002563.370703:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5263 00000100:00100000:3.0:1786002563.370712:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5264 00000100:00100000:3.0:1786002563.370718:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3646:x1872758561012608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002563.370727:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2525 count 1 00002000:00010000:3.0:1786002563.370738:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.370742:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0fdb88/0x7cee4af578416dd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370749:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dd:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.370752:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.370756:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0fdb88/0x7cee4af578416dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370764:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce0fdb88/0x7cee4af578416dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370771:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0fdb88/0x7cee4af578416dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370783:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0fdb88/0x7cee4af578416dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370791:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1786002563.370920:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3646:x1872758561012608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 202us (10029us total) trans 4294969918 rc 0/0 00000100:00100000:3.0:1786002563.370927:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5264 00000100:00100000:3.0:1786002563.370938:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5265 00000100:00100000:3.0:1786002563.370944:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3644:x1872758561013760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786002563.370953:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2515 count 1 00002000:00010000:3.0:1786002563.370966:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.370971:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416ddd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370978:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d3:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.370981:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.370985:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416ddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.370993:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416ddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371000:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416ddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371011:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416ddd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371019:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1786002563.371074:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3644:x1872758561013760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 130us (15624us total) trans 4294969903 rc 0/0 00000100:00100000:3.0:1786002563.371079:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5265 00000100:00100000:3.0:1786002563.371106:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002563.371136:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561012864:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002563.371164:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561012352 00000100:00100000:3.0:1786002563.371168:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561012352 00000100:00100000:3.0:1786002563.371191:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5266 00000100:00100000:3.0:1786002563.371197:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3645:x1872758561012352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002563.371207:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2523 count 1 00002000:00010000:3.0:1786002563.371219:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.371224:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416de4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371232:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9db:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.371235:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.371238:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416de4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371247:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416de4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371258:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416de4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371265:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416de4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371272:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:3.0:1786002563.371328:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3645:x1872758561012352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 131us (221us total) trans 4294969919 rc 0/0 00000100:00100000:3.0:1786002563.371334:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5266 00010000:00010000:3.0:1786002563.371465:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1786002563.371471:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ce922fa/0x7cee4af578416dba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371495:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.371499:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ce922fa/0x7cee4af578416dba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371509:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ce922fa/0x7cee4af578416dba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371527:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ce922fa/0x7cee4af578416dba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371534:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ce922fa/0x7cee4af578416dba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371554:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786002563.371558:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d70d5aff/0x7cee4af578416dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371564:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.371567:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d70d5aff/0x7cee4af578416dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371574:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d70d5aff/0x7cee4af578416dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371582:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d70d5aff/0x7cee4af578416dc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371589:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d70d5aff/0x7cee4af578416dc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371598:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786002563.371601:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cd73965/0x7cee4af578416dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371607:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.371610:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cd73965/0x7cee4af578416dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371621:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cd73965/0x7cee4af578416dc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371628:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cd73965/0x7cee4af578416dc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371634:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cd73965/0x7cee4af578416dc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371644:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786002563.371647:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000853986cf/0x7cee4af578416dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371652:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed3429eb600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.371655:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000853986cf/0x7cee4af578416dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371662:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000853986cf/0x7cee4af578416dcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371670:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000853986cf/0x7cee4af578416dcf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371675:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000853986cf/0x7cee4af578416dcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371689:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786002563.371692:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce0fdb88/0x7cee4af578416dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371698:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed3429ea000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.371700:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0fdb88/0x7cee4af578416dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371707:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0fdb88/0x7cee4af578416dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371714:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce0fdb88/0x7cee4af578416dd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371720:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce0fdb88/0x7cee4af578416dd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371728:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786002563.371731:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416ddd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371737:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.371740:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416ddd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371750:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416ddd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371757:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416ddd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371763:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416ddd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371776:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002563.371780:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416de4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371786:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.371789:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416de4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371796:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416de4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371804:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416de4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371811:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416de4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.371825:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002563.371826:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002563.371828:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002563.372910:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561014144:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1786002563.373916:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002563.373938:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561014272:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1786002563.374966:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969914 is committed 00010000:00010000:2.0:1786002563.375077:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002563.375091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.375119:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561013376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.375147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.375159:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561013888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.375179:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1786002563.375221:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f3480/2, rc 0, transno 4294969919 00000100:00100000:2.0:1786002563.375232:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561012352:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1786002563.375235:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.375250:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561013120 00000100:00100000:2.0:1786002563.375255:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561013120 00000004:00080000:0.0:1786002563.375261:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be5880/2, rc 0, transno 4294969903 00000100:00100000:0.0:1786002563.375269:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561013760:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.375285:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561012864 00000100:00100000:0.0:1786002563.375285:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561013376 00000100:00100000:2.0:1786002563.375288:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561012864 00000100:00100000:0.0:1786002563.375288:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561013376 00000100:00100000:2.0:1786002563.375303:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561013888 00000100:00100000:2.0:1786002563.375305:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561013888 00000100:00100000:0.0:1786002563.378045:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561014272 00000100:00100000:0.0:1786002563.378054:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561014272 00000100:00100000:0.0:1786002563.378233:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5267 00000100:00100000:0.0:1786002563.378243:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3646:x1872758561013120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786002563.378267:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2510 count 1 00002000:00010000:0.0:1786002563.378293:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002563.378300:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c067461d/0x7cee4af578416deb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378314:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ce:0x0].0x0 since=923s v=(0 0) 00010000:00010000:0.0:1786002563.378318:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002563.378323:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c067461d/0x7cee4af578416deb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378339:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c067461d/0x7cee4af578416deb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378347:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c067461d/0x7cee4af578416deb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378353:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c067461d/0x7cee4af578416deb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378367:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786002563.378557:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3646:x1872758561013120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 316us (12833us total) trans 4294969904 rc 0/0 00000100:00100000:0.0:1786002563.378566:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5267 00000100:00100000:0.0:1786002563.378581:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5268 00000100:00100000:0.0:1786002563.378587:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3645:x1872758561012864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1786002563.378598:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2527 count 1 00002000:00010000:0.0:1786002563.378612:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002563.378616:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a4aa8da/0x7cee4af578416df2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378623:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9df:0x0].0x0 since=923s v=(0 0) 00010000:00010000:0.0:1786002563.378626:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002563.378630:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a4aa8da/0x7cee4af578416df2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378642:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a4aa8da/0x7cee4af578416df2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378649:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a4aa8da/0x7cee4af578416df2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378655:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a4aa8da/0x7cee4af578416df2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378666:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1786002563.378730:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3645:x1872758561012864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 142us (3639us total) trans 4294969920 rc 0/0 00000100:00100000:0.0:1786002563.378734:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5268 00000100:00100000:0.0:1786002563.378754:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5269 00000100:00100000:0.0:1786002563.378758:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3645:x1872758561013376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786002563.378767:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2512 count 1 00002000:00010000:0.0:1786002563.378778:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002563.378782:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d3020e2/0x7cee4af578416df9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378788:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d0:0x0].0x0 since=923s v=(0 0) 00010000:00010000:0.0:1786002563.378791:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002563.378794:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d3020e2/0x7cee4af578416df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378806:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d3020e2/0x7cee4af578416df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378813:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d3020e2/0x7cee4af578416df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378896:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d3020e2/0x7cee4af578416df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.378911:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1786002563.378934:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5270 00000100:00100000:2.0:1786002563.378943:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3645:x1872758561013888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.378955:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2516 count 1 00000100:00100000:0.0:1786002563.378966:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3645:x1872758561013376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 207us (3819us total) trans 4294969905 rc 0/0 00002000:00010000:2.0:1786002563.378969:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1786002563.378972:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5269 00010000:00010000:2.0:1786002563.378974:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416e00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.378982:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d4:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.378985:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1786002563.378985:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5271 00010000:00010000:2.0:1786002563.378989:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002563.378991:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3644:x1872758561014272:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1786002563.378999:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1786002563.379000:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2529 count 1 00010000:00010000:2.0:1786002563.379012:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002563.379012:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002563.379016:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b05529/0x7cee4af578416e07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379020:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.379023:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e1:0x0].0x0 since=923s v=(0 0) 00010000:00010000:0.0:1786002563.379026:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.379028:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1786002563.379030:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b05529/0x7cee4af578416e07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.379043:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077b05529/0x7cee4af578416e07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.379051:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b05529/0x7cee4af578416e07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.379058:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077b05529/0x7cee4af578416e07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.379065:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1786002563.379088:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3645:x1872758561013888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 147us (3907us total) trans 4294969906 rc 0/0 00000100:00100000:2.0:1786002563.379094:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5270 00000100:00100000:0.0:1786002563.379118:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3644:x1872758561014272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 127us (3883us total) trans 4294969921 rc 0/0 00000100:00100000:0.0:1786002563.379123:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5271 00000100:00100000:2.0:1786002563.379152:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1786002563.379200:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc52680/2, rc 0, transno 4294969908 00000100:00100000:2.0:1786002563.379210:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561011968:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1786002563.379222:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc50a80/2, rc 0, transno 4294969907 00000100:00100000:2.0:1786002563.379225:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561012096:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786002563.379234:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002563.379242:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561014528:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786002563.379266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.379290:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561014144 00000100:00100000:2.0:1786002563.379294:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561014144 00000100:00100000:2.0:1786002563.379310:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561014528 00000100:00100000:2.0:1786002563.379312:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561014528 00000100:00100000:2.0:1786002563.379326:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5272 00000100:00100000:2.0:1786002563.379331:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3647:x1872758561014144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.379341:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2518 count 1 00002000:00010000:2.0:1786002563.379354:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.379358:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416e0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379366:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d6:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.379369:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.379372:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379381:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379388:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379395:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379401:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1786002563.379420:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5273 00000100:00100000:2.0:1786002563.379426:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3647:x1872758561014528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786002563.379436:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2530 count 1 00002000:00010000:2.0:1786002563.379448:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.379452:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd7dcdf/0x7cee4af578416e15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379460:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e2:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.379463:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.379467:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd7dcdf/0x7cee4af578416e15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379475:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd7dcdf/0x7cee4af578416e15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379490:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd7dcdf/0x7cee4af578416e15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379498:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd7dcdf/0x7cee4af578416e15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379507:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1786002563.379568:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3647:x1872758561014528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 142us (301us total) trans 4294969922 rc 0/0 00000100:00100000:2.0:1786002563.379574:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5273 00000100:00100000:2.0:1786002563.379610:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561014656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786002563.379630:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.379647:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969914 gen 2 00000004:00080000:2.0:1786002563.379651:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc51f80, transno 4294969903 00000004:00080000:2.0:1786002563.379655:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc52300, transno 4294969904 00000004:00080000:2.0:1786002563.379658:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed243dd6680, transno 4294969905 00000004:00080000:2.0:1786002563.379660:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc53b80, transno 4294969906 00000004:00080000:2.0:1786002563.379662:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc50a80, transno 4294969907 00000004:00080000:2.0:1786002563.379664:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc52680, transno 4294969908 00000004:00080000:2.0:1786002563.379666:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed243dd5880, transno 4294969909 00000004:00080000:2.0:1786002563.379668:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc51500, transno 4294969910 00000004:00080000:2.0:1786002563.379671:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc50000, transno 4294969911 00000004:00080000:2.0:1786002563.379673:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc52d80, transno 4294969912 00000004:00080000:2.0:1786002563.379675:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc51180, transno 4294969913 00000004:00080000:2.0:1786002563.379677:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2467f0380, transno 4294969914 00000100:00100000:2.0:1786002563.379682:0:3647:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed2455f0e00 x1872758561012736/t4294969915(4294969915) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786002579 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1786002563.379690:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f536d80/2, rc 0, transno 4294969922 00000100:00100000:2.0:1786002563.379693:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561014528:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786002563.379706:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561014656 00000100:00100000:2.0:1786002563.379708:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561014656 00000100:00100000:2.0:1786002563.379721:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5274 00000100:00100000:2.0:1786002563.379726:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3647:x1872758561014656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786002563.379736:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2531 count 1 00002000:00010000:2.0:1786002563.379748:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.379753:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf17d64b/0x7cee4af578416e1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379760:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e3:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.379763:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.379767:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf17d64b/0x7cee4af578416e1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379775:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf17d64b/0x7cee4af578416e1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379783:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf17d64b/0x7cee4af578416e1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379791:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf17d64b/0x7cee4af578416e1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.379798:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:1.0:1786002563.380916:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1786002563.380924:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c067461d/0x7cee4af578416deb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.380933:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.380938:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c067461d/0x7cee4af578416deb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.380948:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c067461d/0x7cee4af578416deb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.380964:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c067461d/0x7cee4af578416deb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.380970:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c067461d/0x7cee4af578416deb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.380986:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1786002563.380989:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a4aa8da/0x7cee4af578416df2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.380995:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.380998:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a4aa8da/0x7cee4af578416df2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381003:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a4aa8da/0x7cee4af578416df2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381010:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a4aa8da/0x7cee4af578416df2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381015:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a4aa8da/0x7cee4af578416df2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381025:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1786002563.381028:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d3020e2/0x7cee4af578416df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381034:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.381037:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d3020e2/0x7cee4af578416df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381044:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d3020e2/0x7cee4af578416df9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381052:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d3020e2/0x7cee4af578416df9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381059:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d3020e2/0x7cee4af578416df9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381067:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1786002563.381070:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381075:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.381077:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381088:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416e00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381095:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416e00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381100:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416e00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381108:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1786002563.381111:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077b05529/0x7cee4af578416e07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381115:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.381118:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b05529/0x7cee4af578416e07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381123:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b05529/0x7cee4af578416e07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381130:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077b05529/0x7cee4af578416e07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381136:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077b05529/0x7cee4af578416e07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381684:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786002563.381689:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381696:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.381700:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381709:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416e0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381720:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416e0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381727:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416e0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381738:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002563.381741:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd7dcdf/0x7cee4af578416e15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381747:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.381751:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd7dcdf/0x7cee4af578416e15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381764:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd7dcdf/0x7cee4af578416e15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381773:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd7dcdf/0x7cee4af578416e15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381779:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd7dcdf/0x7cee4af578416e15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381789:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002563.381792:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf17d64b/0x7cee4af578416e1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381798:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.381801:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf17d64b/0x7cee4af578416e1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.381809:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf17d64b/0x7cee4af578416e1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.382231:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf17d64b/0x7cee4af578416e1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.382238:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf17d64b/0x7cee4af578416e1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.382261:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002563.382263:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002563.382265:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002563.382278:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002563.382282:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002563.382355:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3647:x1872758561014144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3021us (3199us total) trans 4294969907 rc 0/0 00000100:00100000:0.0:1786002563.382363:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5272 00000001:00080000:0.0:1786002563.382421:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969906 is committed 00000004:00080000:1.0:1786002563.382577:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f0700/2, rc 0, transno 4294969907 00000100:00100000:1.0:1786002563.382595:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561014144:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.382943:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3647:x1872758561014656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3213us (3309us total) trans 4294969923 rc 0/0 00000100:00100000:2.0:1786002563.382951:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5274 00000004:00080000:2.0:1786002563.383058:0:8758:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 27 changes, 10 in progress, 7 in flight, 12 done 00000004:00080000:2.0:1786002563.383098:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f535500/2, rc 0, transno 4294969923 00000100:00100000:2.0:1786002563.383106:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561014656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786002563.383129:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002563.383136:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561015040:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786002563.383163:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.383202:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561015040 00000100:00100000:2.0:1786002563.383207:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561015040 00000100:00100000:2.0:1786002563.383237:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5275 00000100:00100000:2.0:1786002563.383245:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3647:x1872758561015040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786002563.383262:0:14676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2534 count 1 00000100:00100000:0.0:1786002563.383270:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561015168:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1786002563.383284:0:14676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.383290:0:14676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c69e1a9/0x7cee4af578416e23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002563.383292:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786002563.383301:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e6:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.383305:0:14676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.383310:0:14676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c69e1a9/0x7cee4af578416e23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002563.383317:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561015168 00000100:00100000:0.0:1786002563.383320:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561015168 00010000:00010000:2.0:1786002563.383322:0:14676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c69e1a9/0x7cee4af578416e23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.383331:0:14676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c69e1a9/0x7cee4af578416e23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002563.383338:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5276 00010000:00010000:2.0:1786002563.383339:0:14676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c69e1a9/0x7cee4af578416e23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002563.383344:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1872758561015168:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1786002563.383353:0:14676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1786002563.383355:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2520 count 1 00002000:00010000:0.0:1786002563.383368:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002563.383372:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000090fdf56/0x7cee4af578416e2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.383380:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d8:0x0].0x0 since=923s v=(0 0) 00010000:00010000:0.0:1786002563.383383:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002563.383387:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000090fdf56/0x7cee4af578416e2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.383396:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000090fdf56/0x7cee4af578416e2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.383403:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000090fdf56/0x7cee4af578416e2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.383410:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000090fdf56/0x7cee4af578416e2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.383421:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786002563.383427:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3647:x1872758561015040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 183us (263us total) trans 4294969924 rc 0/0 00000100:00100000:2.0:1786002563.383433:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5275 00010000:00010000:2.0:1786002563.383449:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002563.383454:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c69e1a9/0x7cee4af578416e23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.383461:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002563.383465:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c69e1a9/0x7cee4af578416e23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.383474:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c69e1a9/0x7cee4af578416e23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.383495:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c69e1a9/0x7cee4af578416e23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.383504:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c69e1a9/0x7cee4af578416e23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.383518:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002563.383521:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000090fdf56/0x7cee4af578416e2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.383527:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002563.383530:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000090fdf56/0x7cee4af578416e2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.383538:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000090fdf56/0x7cee4af578416e2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.383546:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000090fdf56/0x7cee4af578416e2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.383552:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000090fdf56/0x7cee4af578416e2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.383563:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002563.383565:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002563.383567:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786002563.383591:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be5f80/2, rc 0, transno 4294969904 00000100:00100000:2.0:1786002563.383599:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561013120:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.383624:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561013632:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.383649:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1786002563.383672:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f1f80/2, rc 0, transno 4294969916 00000100:00100000:2.0:1786002563.383680:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561012480:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1786002563.383707:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f1880/2, rc 0, transno 4294969917 00000100:00100000:2.0:1786002563.383714:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561012992:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1786002563.383739:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be5500/2, rc 0, transno 4294969901 00000100:00100000:2.0:1786002563.383746:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561013504:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1786002563.383769:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be7800/2, rc 0, transno 4294969902 00000100:00100000:2.0:1786002563.383775:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561014016:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.383800:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561015552:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786002563.383822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002563.383932:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561013632 00000100:00100000:3.0:1786002563.383936:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561013632 00000100:00100000:0.0:1786002563.383944:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3647:x1872758561015168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 599us (650us total) trans 4294969908 rc 0/0 00000100:00100000:0.0:1786002563.383950:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5276 00000100:00100000:3.0:1786002563.383958:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561015552 00000100:00100000:3.0:1786002563.383960:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561015552 00000100:00100000:0.0:1786002563.383962:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5277 00000100:00100000:0.0:1786002563.383967:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1872758561013632:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002563.383975:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5278 00002000:00080000:0.0:1786002563.383979:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2514 count 1 00000100:00100000:3.0:1786002563.383980:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3646:x1872758561015552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002563.383989:0:14665:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2536 count 1 00002000:00010000:0.0:1786002563.383992:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002563.383996:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e65e6160/0x7cee4af578416e31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002563.384002:0:14665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.384007:0:14665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a9ce5b3/0x7cee4af578416e38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.384010:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d2:0x0].0x0 since=923s v=(0 0) 00010000:00010000:0.0:1786002563.384013:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.384014:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e8:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.384017:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002563.384018:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e65e6160/0x7cee4af578416e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.384021:0:14665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a9ce5b3/0x7cee4af578416e38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.384027:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e65e6160/0x7cee4af578416e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.384030:0:14665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a9ce5b3/0x7cee4af578416e38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.384035:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e65e6160/0x7cee4af578416e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.384038:0:14665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a9ce5b3/0x7cee4af578416e38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.384043:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e65e6160/0x7cee4af578416e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.384046:0:14665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a9ce5b3/0x7cee4af578416e38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.384056:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1786002563.384058:0:14665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1786002563.384112:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3646:x1872758561015552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 131us (289us total) trans 4294969925 rc 0/0 00000100:00100000:0.0:1786002563.384112:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3646:x1872758561013632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 144us (462us total) trans 4294969909 rc 0/0 00000100:00100000:0.0:1786002563.384118:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5277 00010000:00010000:0.0:1786002563.385253:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786002563.385260:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e65e6160/0x7cee4af578416e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.385269:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002563.385272:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e65e6160/0x7cee4af578416e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.385285:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e65e6160/0x7cee4af578416e31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.385296:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e65e6160/0x7cee4af578416e31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.385301:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e65e6160/0x7cee4af578416e31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.385328:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002563.385331:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a9ce5b3/0x7cee4af578416e38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.385336:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002563.385339:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a9ce5b3/0x7cee4af578416e38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.385345:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a9ce5b3/0x7cee4af578416e38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.385351:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a9ce5b3/0x7cee4af578416e38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.385357:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a9ce5b3/0x7cee4af578416e38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.385371:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002563.385372:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002563.385374:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002563.385381:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002563.385397:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561015680:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002563.385426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.385923:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561015680 00000100:00100000:2.0:1786002563.385929:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561015680 00000100:00100000:0.0:1786002563.386087:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969906 gen 2 00000004:00080000:0.0:1786002563.386093:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be5180, transno 4294969900 00000004:00080000:0.0:1786002563.386100:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be5500, transno 4294969901 00000004:00080000:0.0:1786002563.386103:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be7800, transno 4294969902 00000004:00080000:0.0:1786002563.386105:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be5880, transno 4294969903 00000004:00080000:0.0:1786002563.386107:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be5f80, transno 4294969904 00000100:00100000:0.0:1786002563.386114:0:3647:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed2455f0700 x1872758561014144/t4294969907(4294969907) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786002579 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1786002563.386122:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245512a00/2, rc 0, transno 4294969908 00000100:00100000:0.0:1786002563.386126:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561015168:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1786002563.386139:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f537b80/2, rc 0, transno 4294969924 00000100:00100000:0.0:1786002563.386145:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561015040:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002563.386527:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5278 00010000:00010000:3.0:1786002563.386553:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002563.386568:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561014400:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002563.386598:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002563.386625:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561014912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002563.386641:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002563.386655:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561015424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002563.386670:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786002563.386689:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f3100/2, rc 0, transno 4294969920 00000100:00100000:3.0:1786002563.386694:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561012864:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002563.386702:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be4700/2, rc 0, transno 4294969905 00000100:00100000:3.0:1786002563.386706:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561013376:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786002563.386714:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be4a80/2, rc 0, transno 4294969906 00000100:00100000:3.0:1786002563.386717:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561013888:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002563.386724:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1786002563.386729:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561014784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002563.386745:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002563.386786:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561015296:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002563.386805:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002563.386817:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561015808:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002563.386834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002563.386931:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561014400 00000100:00100000:3.0:1786002563.386935:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561014400 00000100:00100000:3.0:1786002563.386950:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561014912 00000100:00100000:3.0:1786002563.386952:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561014912 00000100:00100000:3.0:1786002563.386961:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561015424 00000100:00100000:3.0:1786002563.386963:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561015424 00000100:00100000:3.0:1786002563.386970:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561014784 00000100:00100000:3.0:1786002563.386971:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561014784 00000100:00100000:3.0:1786002563.386978:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561015296 00000100:00100000:3.0:1786002563.386980:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561015296 00000100:00100000:3.0:1786002563.386988:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561015808 00000100:00100000:3.0:1786002563.386990:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561015808 00000100:00100000:3.0:1786002563.387000:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5279 00000100:00100000:3.0:1786002563.387007:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3645:x1872758561014400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786002563.387029:0:8764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2519 count 1 00002000:00010000:3.0:1786002563.387054:0:8764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.387061:0:8764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ea36e28/0x7cee4af578416e3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387072:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d7:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.387075:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.387080:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea36e28/0x7cee4af578416e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387091:0:8764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea36e28/0x7cee4af578416e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387099:0:8764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ea36e28/0x7cee4af578416e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387107:0:8764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ea36e28/0x7cee4af578416e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387120:0:8764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786002563.387220:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3645:x1872758561014400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 212us (620us total) trans 4294969910 rc 0/0 00000100:00100000:3.0:1786002563.387226:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5279 00000100:00100000:3.0:1786002563.387238:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5280 00000100:00100000:3.0:1786002563.387245:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3645:x1872758561014912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002563.387256:0:8764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2533 count 1 00002000:00010000:3.0:1786002563.387270:0:8764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.387279:0:8764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416e46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387288:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e5:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.387291:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.387295:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416e46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387304:0:8764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416e46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387316:0:8764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416e46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387322:0:8764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416e46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387337:0:8764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1786002563.387396:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3645:x1872758561014912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 151us (752us total) trans 4294969926 rc 0/0 00000100:00100000:3.0:1786002563.387402:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5280 00000100:00100000:3.0:1786002563.387413:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5281 00000100:00100000:3.0:1786002563.387419:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3645:x1872758561015424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002563.387429:0:8764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2535 count 1 00002000:00010000:3.0:1786002563.387442:0:8764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.387447:0:8764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416e4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387454:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e7:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.387457:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.387461:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416e4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387470:0:8764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416e4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387494:0:8764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416e4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387502:0:8764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416e4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387514:0:8764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1786002563.387572:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3645:x1872758561015424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 153us (900us total) trans 4294969927 rc 0/0 00000100:00100000:3.0:1786002563.387579:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5281 00000100:00100000:3.0:1786002563.387592:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5282 00000100:00100000:3.0:1786002563.387598:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3645:x1872758561014784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002563.387608:0:8764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2532 count 1 00002000:00010000:3.0:1786002563.387621:0:8764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.387625:0:8764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416e54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387633:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e4:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.387636:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.387640:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416e54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387649:0:8764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416e54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387661:0:8764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416e54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387667:0:8764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416e54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387675:0:8764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1786002563.387726:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3645:x1872758561014784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 128us (979us total) trans 4294969928 rc 0/0 00000100:00100000:3.0:1786002563.387732:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5282 00000100:00100000:3.0:1786002563.387743:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5283 00000100:00100000:3.0:1786002563.387748:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3645:x1872758561015296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786002563.387757:0:8764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2521 count 1 00002000:00010000:3.0:1786002563.387770:0:8764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.387775:0:8764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeecdbf/0x7cee4af578416e5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387783:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d9:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.387786:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.387789:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aeecdbf/0x7cee4af578416e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387797:0:8764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aeecdbf/0x7cee4af578416e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387809:0:8764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aeecdbf/0x7cee4af578416e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387816:0:8764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aeecdbf/0x7cee4af578416e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.387822:0:8764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1786002563.387947:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3645:x1872758561015296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 199us (1141us total) trans 4294969911 rc 0/0 00000100:00100000:3.0:1786002563.387953:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5283 00000100:00100000:3.0:1786002563.387964:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5284 00000100:00100000:3.0:1786002563.387969:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3645:x1872758561015808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786002563.387979:0:8764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2523 count 1 00002000:00010000:3.0:1786002563.387990:0:8764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002563.387995:0:8764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000615159bd/0x7cee4af578416e62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388003:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9db:0x0].0x0 since=923s v=(0 0) 00010000:00010000:3.0:1786002563.388005:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002563.388009:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000615159bd/0x7cee4af578416e62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388018:0:8764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000615159bd/0x7cee4af578416e62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388030:0:8764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000615159bd/0x7cee4af578416e62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388036:0:8764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000615159bd/0x7cee4af578416e62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388042:0:8764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1786002563.388092:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3645:x1872758561015808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 122us (1256us total) trans 4294969912 rc 0/0 00000100:00100000:3.0:1786002563.388099:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5284 00010000:00010000:3.0:1786002563.388124:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786002563.388129:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ea36e28/0x7cee4af578416e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388136:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.388140:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ea36e28/0x7cee4af578416e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388149:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ea36e28/0x7cee4af578416e3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388162:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ea36e28/0x7cee4af578416e3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388170:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea36e28/0x7cee4af578416e3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388186:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786002563.388190:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416e46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388196:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.388199:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416e46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388207:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416e46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388217:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416e46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388223:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416e46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388234:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786002563.388237:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416e4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388243:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.388246:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416e4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388256:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416e4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388265:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416e4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388272:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416e4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388283:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786002563.388286:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416e54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388292:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.388295:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416e54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388301:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416e54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388310:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416e54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388317:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416e54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388333:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786002563.388336:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aeecdbf/0x7cee4af578416e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388343:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.388346:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aeecdbf/0x7cee4af578416e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388353:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aeecdbf/0x7cee4af578416e5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388362:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aeecdbf/0x7cee4af578416e5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388368:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aeecdbf/0x7cee4af578416e5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388379:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002563.388381:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000615159bd/0x7cee4af578416e62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388386:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002563.388389:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000615159bd/0x7cee4af578416e62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388401:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000615159bd/0x7cee4af578416e62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388410:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000615159bd/0x7cee4af578416e62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388416:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000615159bd/0x7cee4af578416e62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002563.388427:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002563.388428:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002563.388430:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002563.388442:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786002563.388467:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f536a00/2, rc 0, transno 4294969928 00000100:00100000:3.0:1786002563.388472:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561014784:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002563.388491:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f534a80/2, rc 0, transno 4294969911 00000100:00100000:3.0:1786002563.388495:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561015296:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786002563.388503:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed243dd6680/2, rc 0, transno 4294969912 00000100:00100000:3.0:1786002563.388506:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561015808:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786002563.388514:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f2300/2, rc 0, transno 4294969910 00000100:00100000:3.0:1786002563.388518:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561014400:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786002563.388524:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f534700/2, rc 0, transno 4294969926 00000100:00100000:3.0:1786002563.388528:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561014912:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002563.388534:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f535f80/2, rc 0, transno 4294969927 00000100:00100000:3.0:1786002563.388538:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561015424:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002563.388566:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f1500/2, rc 0, transno 4294969921 00000100:00100000:3.0:1786002563.388570:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561014272:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1786002563.389365:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786002563.391575:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f535180/2, rc 0, transno 4294969925 00000100:00100000:0.0:1786002563.391586:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561015552:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1786002563.391599:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f3b80/2, rc 0, transno 4294969918 00000100:00100000:0.0:1786002563.391603:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561012608:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1786002563.391613:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be6d80/2, rc 0, transno 4294969909 00000100:00100000:0.0:1786002563.391617:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561013632:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.392782:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5285 00000100:00100000:2.0:1786002563.392798:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3647:x1872758561015680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.392827:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2522 count 1 00000004:00080000:0.0:1786002563.393025:0:9836:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 35 changes, 9 in progress, 1 in flight, 5 done 00000100:00100000:0.0:1786002563.393111:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561016192:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002563.393159:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1786002563.393212:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.393220:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416e69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.393234:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9da:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.393238:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.393244:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.393258:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.393268:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.393276:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.393293:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786002563.393402:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3647:x1872758561015680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 610us (7974us total) trans 4294969913 rc 0/0 00000100:00100000:2.0:1786002563.393410:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5285 00000100:00100000:3.0:1786002563.393496:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561015936:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002563.393529:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561016320:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002563.399018:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561016704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002563.399063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.399137:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561016192 00000100:00100000:2.0:1786002563.399144:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561016192 00000100:00100000:2.0:1786002563.399183:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5286 00000100:00100000:2.0:1786002563.399192:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3647:x1872758561016192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.399220:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2526 count 1 00002000:00010000:2.0:1786002563.399248:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.399255:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000196487c1/0x7cee4af578416e70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399269:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9de:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.399273:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.399279:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000196487c1/0x7cee4af578416e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399293:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000196487c1/0x7cee4af578416e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399302:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000196487c1/0x7cee4af578416e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399310:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000196487c1/0x7cee4af578416e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399327:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786002563.399445:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3647:x1872758561016192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 253us (6285us total) trans 4294969914 rc 0/0 00000100:00100000:2.0:1786002563.399452:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5286 00010000:00010000:2.0:1786002563.399471:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002563.399487:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399496:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002563.399500:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399511:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416e69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399528:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416e69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399536:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095c1376a/0x7cee4af578416e69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399554:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002563.399557:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000196487c1/0x7cee4af578416e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399563:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002563.399566:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000196487c1/0x7cee4af578416e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399573:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000196487c1/0x7cee4af578416e70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399581:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000196487c1/0x7cee4af578416e70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399587:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000196487c1/0x7cee4af578416e70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.399595:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002563.399597:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002563.399599:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786002563.406713:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f535c00/2, rc 0, transno 4294969913 00000100:00100000:0.0:1786002563.406731:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561015680:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1786002563.406749:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245510380/2, rc 0, transno 4294969914 00000100:00100000:0.0:1786002563.406752:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561016192:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002563.406758:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786002563.406767:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561016064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002563.406817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002563.406844:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561016576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002563.406883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786002563.408948:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002563.408965:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561016704 00000100:00100000:2.0:1786002563.408974:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561016704 00000100:00100000:2.0:1786002563.409015:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561016064 00000100:00100000:2.0:1786002563.409018:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561016064 00000100:00100000:2.0:1786002563.409030:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561016576 00000100:00100000:2.0:1786002563.409032:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561016576 00000100:00100000:2.0:1786002563.409048:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5287 00000100:00100000:2.0:1786002563.409056:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3647:x1872758561016704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.409080:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2530 count 1 00002000:00010000:2.0:1786002563.409109:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.409117:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d41a18df/0x7cee4af578416e77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409131:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e2:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.409135:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.409141:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d41a18df/0x7cee4af578416e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409153:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d41a18df/0x7cee4af578416e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409162:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d41a18df/0x7cee4af578416e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409170:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d41a18df/0x7cee4af578416e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409185:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786002563.409342:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3647:x1872758561016704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 286us (10277us total) trans 4294969915 rc 0/0 00000100:00100000:2.0:1786002563.409350:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5287 00000100:00100000:2.0:1786002563.409368:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5288 00000100:00100000:2.0:1786002563.409375:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3647:x1872758561016064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.409386:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2525 count 1 00002000:00010000:2.0:1786002563.409400:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.409405:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a67a87/0x7cee4af578416e7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409413:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9dd:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.409416:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.409421:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a67a87/0x7cee4af578416e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409430:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0a67a87/0x7cee4af578416e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409438:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0a67a87/0x7cee4af578416e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409445:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a67a87/0x7cee4af578416e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409459:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786002563.409532:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3647:x1872758561016064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 157us (2714us total) trans 4294969916 rc 0/0 00000100:00100000:2.0:1786002563.409538:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5288 00000100:00100000:2.0:1786002563.409550:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5289 00000100:00100000:2.0:1786002563.409556:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3647:x1872758561016576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.409566:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2529 count 1 00002000:00010000:2.0:1786002563.409578:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.409583:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047700358/0x7cee4af578416e85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409591:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e1:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.409594:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.409597:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047700358/0x7cee4af578416e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409605:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047700358/0x7cee4af578416e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409613:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047700358/0x7cee4af578416e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409619:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047700358/0x7cee4af578416e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409630:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1786002563.409680:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3647:x1872758561016576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 124us (2795us total) trans 4294969917 rc 0/0 00000100:00100000:2.0:1786002563.409686:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5289 00010000:00010000:2.0:1786002563.409700:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786002563.409705:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d41a18df/0x7cee4af578416e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409713:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002563.409718:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d41a18df/0x7cee4af578416e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409726:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d41a18df/0x7cee4af578416e77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409742:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d41a18df/0x7cee4af578416e77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409748:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d41a18df/0x7cee4af578416e77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409764:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786002563.409767:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0a67a87/0x7cee4af578416e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409772:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002563.409775:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a67a87/0x7cee4af578416e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409783:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0a67a87/0x7cee4af578416e7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409791:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0a67a87/0x7cee4af578416e7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409799:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0a67a87/0x7cee4af578416e7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409810:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002563.409814:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047700358/0x7cee4af578416e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409820:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002563.409823:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047700358/0x7cee4af578416e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.409830:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047700358/0x7cee4af578416e85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.410937:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786002563.411063:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245513b80/2, rc 0, transno 4294969916 00000100:00100000:0.0:1786002563.411073:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561016064:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1786002563.411083:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245512300/2, rc 0, transno 4294969917 00000100:00100000:0.0:1786002563.411086:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561016576:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1786002563.411093:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245512680/2, rc 0, transno 4294969915 00000100:00100000:0.0:1786002563.411097:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561016704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002563.411157:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561017216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002563.411188:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002563.411217:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002563.411224:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561017088:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002563.411244:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002563.411267:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561017216 00000100:00100000:0.0:1786002563.411271:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561017216 00000100:00100000:0.0:1786002563.411293:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561017088 00000100:00100000:0.0:1786002563.411296:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561017088 00000100:00100000:0.0:1786002563.411316:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5290 00000100:00100000:0.0:1786002563.411322:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3647:x1872758561017216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786002563.411336:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2534 count 1 00002000:00010000:0.0:1786002563.411353:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002563.411359:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af578416e8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.411368:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e6:0x0].0x0 since=923s v=(0 0) 00010000:00010000:0.0:1786002563.411372:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002563.411376:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af578416e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.411386:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af578416e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.411394:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af578416e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.411401:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af578416e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.411412:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786002563.411497:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3647:x1872758561017216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 174us (307us total) trans 4294969918 rc 0/0 00000100:00100000:0.0:1786002563.411504:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5290 00000100:00100000:0.0:1786002563.411519:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5291 00000100:00100000:0.0:1786002563.411525:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3647:x1872758561017088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786002563.411536:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2533 count 1 00002000:00010000:0.0:1786002563.411548:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002563.411552:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af578416e93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.411560:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e5:0x0].0x0 since=923s v=(0 0) 00010000:00010000:0.0:1786002563.411563:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002563.411567:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af578416e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.411575:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af578416e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.411582:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af578416e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.411588:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af578416e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.411595:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1786002563.411646:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3647:x1872758561017088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 121us (400us total) trans 4294969919 rc 0/0 00000100:00100000:0.0:1786002563.411654:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5291 00000004:00080000:0.0:1786002563.411676:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37136e300/2, rc 0, transno 4294969919 00000100:00100000:0.0:1786002563.411683:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561017088:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1786002563.411690:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37136ce00/2, rc 0, transno 4294969918 00000100:00100000:0.0:1786002563.411693:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561017216:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1786002563.411742:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002563.411748:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af578416e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.411755:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.411759:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af578416e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.411767:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af578416e8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.411779:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af578416e8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.411787:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af578416e8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.411807:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002563.411810:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af578416e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.411816:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.411819:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af578416e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.411827:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af578416e93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.411865:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af578416e93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.411874:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af578416e93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.411885:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002563.411887:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002563.411889:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002563.413636:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047700358/0x7cee4af578416e85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.413646:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047700358/0x7cee4af578416e85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.413663:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002563.413664:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002563.413666:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002563.413673:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002563.413690:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.413732:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561016448:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.413762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.413782:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561016960:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.413801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.413814:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002563.413820:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561016832:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002563.415026:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.415066:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.415938:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561015936 00000100:00100000:2.0:1786002563.415946:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561015936 00000100:00100000:2.0:1786002563.415985:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561016448 00000100:00100000:2.0:1786002563.415988:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561016448 00000100:00100000:2.0:1786002563.416001:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561016960 00000100:00100000:2.0:1786002563.416004:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561016960 00000100:00100000:2.0:1786002563.416012:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561016832 00000100:00100000:2.0:1786002563.416014:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561016832 00000100:00100000:2.0:1786002563.416021:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561016320 00000100:00100000:2.0:1786002563.416023:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561016320 00000100:00100000:2.0:1786002563.416036:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5292 00000100:00100000:2.0:1786002563.416043:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3645:x1872758561015936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.416066:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2524 count 1 00002000:00010000:2.0:1786002563.416091:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.416098:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416e9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416111:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9dc:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.416114:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.416120:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416137:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416146:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416153:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416166:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786002563.416293:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3645:x1872758561015936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 249us (2601us total) trans 4294969920 rc 0/0 00000100:00100000:2.0:1786002563.416300:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5292 00000100:00100000:2.0:1786002563.416316:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5293 00000100:00100000:2.0:1786002563.416322:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3645:x1872758561016448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.416336:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2528 count 1 00002000:00010000:2.0:1786002563.416348:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.416353:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416ea1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416361:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e0:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.416365:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.416369:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416383:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416391:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416398:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416410:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786002563.416464:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3645:x1872758561016448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 142us (2701us total) trans 4294969921 rc 0/0 00000100:00100000:2.0:1786002563.416470:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5293 00000100:00100000:2.0:1786002563.416493:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5294 00000100:00100000:2.0:1786002563.416500:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3645:x1872758561016960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.416511:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2532 count 1 00002000:00010000:2.0:1786002563.416523:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.416528:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005db65c72/0x7cee4af578416ea8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416536:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e4:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.416539:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.416543:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005db65c72/0x7cee4af578416ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416556:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005db65c72/0x7cee4af578416ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416563:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005db65c72/0x7cee4af578416ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416569:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005db65c72/0x7cee4af578416ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416580:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1786002563.416634:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3645:x1872758561016960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 135us (2832us total) trans 4294969922 rc 0/0 00000100:00100000:2.0:1786002563.416641:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5294 00000100:00100000:2.0:1786002563.416651:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5295 00000100:00100000:2.0:1786002563.416657:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3645:x1872758561016832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.416666:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2531 count 1 00002000:00010000:2.0:1786002563.416677:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.416682:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb47c57a/0x7cee4af578416eaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416690:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e3:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.416692:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.416696:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb47c57a/0x7cee4af578416eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416709:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb47c57a/0x7cee4af578416eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416716:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb47c57a/0x7cee4af578416eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416723:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb47c57a/0x7cee4af578416eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.416730:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1786002563.416782:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3645:x1872758561016832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 125us (1758us total) trans 4294969923 rc 0/0 00000100:00100000:2.0:1786002563.416788:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5295 00000100:00100000:2.0:1786002563.416798:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5296 00000100:00100000:2.0:1786002563.416804:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3644:x1872758561016320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002563.416813:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2527 count 1 00002000:00010000:2.0:1786002563.416825:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002563.416830:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416eb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417071:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1786002563.417078:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417086:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.417090:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417099:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416e9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417112:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416e9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417120:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416e9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417136:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786002563.417139:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417145:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.417148:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417154:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416ea1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417162:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416ea1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417169:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416ea1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417180:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002563.417183:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005db65c72/0x7cee4af578416ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417189:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.417192:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005db65c72/0x7cee4af578416ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417200:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005db65c72/0x7cee4af578416ea8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417209:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005db65c72/0x7cee4af578416ea8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417216:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005db65c72/0x7cee4af578416ea8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417226:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002563.417229:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb47c57a/0x7cee4af578416eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417235:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002563.417238:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb47c57a/0x7cee4af578416eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417250:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb47c57a/0x7cee4af578416eaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417258:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb47c57a/0x7cee4af578416eaf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417265:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb47c57a/0x7cee4af578416eaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002563.417274:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002563.417275:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002563.417277:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786002563.417977:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be5f80/2, rc 0, transno 4294969923 00000100:00100000:0.0:1786002563.417990:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561016832:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1786002563.418000:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37136c700/2, rc 0, transno 4294969922 00000100:00100000:0.0:1786002563.418003:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561016960:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1786002563.418012:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245513800/2, rc 0, transno 4294969920 00000100:00100000:0.0:1786002563.418015:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561015936:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1786002563.418022:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245510700/2, rc 0, transno 4294969921 00000100:00100000:0.0:1786002563.418025:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561016448:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786002563.418043:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002563.418919:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002563.421032:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9df:0x0].0x0 since=923s v=(0 0) 00010000:00010000:2.0:1786002563.421038:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002563.421047:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.421070:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.421082:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.421091:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002563.421153:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786002563.421369:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3644:x1872758561016320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4562us (6299us total) trans 4294969924 rc 0/0 00000100:00100000:2.0:1786002563.421378:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5296 00000004:00080000:3.0:1786002563.421513:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245510000/2, rc 0, transno 4294969924 00000100:00100000:3.0:1786002563.421533:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561016320:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786002563.421587:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002563.421594:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.421603:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002563.421606:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.421615:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416eb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.421635:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416eb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.421642:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416eb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002563.421661:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002563.421663:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002563.421664:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002563.954024:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002563.954045:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561017344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002563.954108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002563.954239:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561017344 00000100:00100000:2.0:1786002563.954247:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561017344 00000100:00100000:2.0:1786002563.954307:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1786002563.954317:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561017344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786002563.954341:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002563.954383:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561017344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002563.954389:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000004:00080000:2.0:1786002563.954625:0:8759:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 924135720445ns, next at 925135718212ns, rc = 0 00000100:00100000:2.0:1786002563.954645:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786002563.954654:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561017472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002563.954683:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002563.954748:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561017472 00000100:00100000:3.0:1786002563.954752:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561017472 00000100:00100000:3.0:1786002563.954788:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1786002563.954796:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+19:3644:x1872758561017472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786002563.954808:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1786002563.954868:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+19:3644:x1872758561017472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002563.954875:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1786002563.954915:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561017472:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786002563.955008:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002563.955089:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561017344:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1786002564.077124:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002564.437169:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002564.437203:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002564.437231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002564.437249:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002564.437270:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002564.437292:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531008512 00000100:00100000:1.0:1786002564.437301:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531008512 00000100:00100000:1.0:1786002564.437350:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531008640 00000100:00100000:1.0:1786002564.437353:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531008640 00000100:00100000:1.0:1786002564.437374:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 497 00000100:00100000:1.0:1786002564.437384:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531008512:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002564.437447:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531008512:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 65us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002564.437455:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 497 00000100:00100000:1.0:1786002564.437482:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 498 00000100:00100000:1.0:1786002564.437489:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531008640:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002564.437513:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531008640:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002564.437519:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 498 00000100:00100000:1.0:1786002564.437536:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531008128 00000100:00100000:1.0:1786002564.437539:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531008128 00000100:00100000:1.0:1786002564.437563:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 527 00000100:00100000:1.0:1786002564.437583:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531008128:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002564.437605:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531008128:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 37us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002564.437612:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 527 00000100:00100000:1.0:1786002564.437646:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531008256 00000100:00100000:1.0:1786002564.437650:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531008256 00000100:00100000:1.0:1786002564.437679:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531008384 00000100:00100000:1.0:1786002564.437682:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531008384 00000100:00100000:1.0:1786002564.437699:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 923 00000100:00100000:1.0:1786002564.437706:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2410:x1872758531008256:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002564.437737:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2410:x1872758531008256:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 31us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002564.437743:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 923 00000100:00100000:1.0:1786002564.437756:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 924 00000100:00100000:1.0:1786002564.437763:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531008384:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002564.437786:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531008384:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002564.437796:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 924 00000100:00080000:1.0:1786002564.437815:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786002564.437818:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786002564.437821:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002564.437822:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002564.459867:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002564.459890:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561017600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002564.459958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002564.460114:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561017600 00000100:00100000:3.0:1786002564.460122:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561017600 00000100:00100000:3.0:1786002564.460179:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050 00000100:00100000:3.0:1786002564.460189:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561017600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786002564.460222:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:3.0:1786002564.460266:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561017600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002564.460277:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050 00000100:00100000:2.0:1786002564.460839:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561017600:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1786002565.106131:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002565.482865:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561017856:0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.482930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002565.482994:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561018368:0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483026:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002565.483042:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561018880:0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483060:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002565.483072:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561019392:0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483088:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002565.483105:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1786002565.483110:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561017984:0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483128:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002565.483150:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561018496:0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483164:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002565.483182:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561019008:0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002565.483232:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561018368 00000100:00100000:3.0:1786002565.483239:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561018368 00000100:00100000:3.0:1786002565.483278:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051 00000100:00100000:3.0:1786002565.483284:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561018368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483331:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561018368:12345-0@lo:400:kworker.0 Request processed in 47us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002565.483337:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051 00000100:00100000:3.0:1786002565.483357:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561017984 00000100:00100000:3.0:1786002565.483360:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561017984 00000100:00100000:3.0:1786002565.483395:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561018496 00000100:00100000:3.0:1786002565.483397:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561018496 00000100:00100000:3.0:1786002565.483423:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561019008 00000100:00100000:3.0:1786002565.483425:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561019008 00000100:00100000:3.0:1786002565.483436:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:3.0:1786002565.483440:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561017984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483476:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561017984:12345-0@lo:400:kworker.0 Request processed in 35us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002565.483482:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:3.0:1786002565.483493:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:3.0:1786002565.483499:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561018496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483520:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561018496:12345-0@lo:400:kworker.0 Request processed in 22us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002565.483525:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:3.0:1786002565.483533:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:3.0:1786002565.483538:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561019008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483556:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561019008:12345-0@lo:400:kworker.0 Request processed in 18us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002565.483561:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00080000:3.0:1786002565.483578:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786002565.483605:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561017984:0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483615:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561018496:0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483622:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561019008:0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.483629:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561018368:0@lo:400:kworker.0 00000100:00100000:2.0:1786002565.483757:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561017856 00000100:00100000:2.0:1786002565.483761:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561017856 00000100:00100000:2.0:1786002565.483792:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1786002565.483799:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561017856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002565.483832:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561017856:12345-0@lo:400:kworker.0 Request processed in 34us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002565.483838:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1786002565.484010:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561018112:0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484037:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002565.484053:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561018624:0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002565.484083:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561019136:0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484096:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002565.484109:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1786002565.484113:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561017728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002565.484129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002565.484140:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758561018240:0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484154:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002565.484163:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561018752:0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484177:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002565.484202:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561019264:0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484213:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002565.484234:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561018880 00000100:00100000:1.0:1786002565.484236:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561018880 00000100:00100000:1.0:1786002565.484265:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561019392 00000100:00100000:1.0:1786002565.484267:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561019392 00000100:00100000:1.0:1786002565.484285:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561018752 00000100:00100000:1.0:1786002565.484287:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561018752 00000100:00100000:1.0:1786002565.484314:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561019264 00000100:00100000:1.0:1786002565.484316:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561019264 00000100:00100000:1.0:1786002565.484333:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1786002565.484338:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3644:x1872758561018880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484363:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3644:x1872758561018880:12345-0@lo:400:kworker.0 Request processed in 25us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002565.484368:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1786002565.484377:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1786002565.484381:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3644:x1872758561019392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484400:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3644:x1872758561019392:12345-0@lo:400:kworker.0 Request processed in 19us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002565.484404:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1786002565.484412:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1786002565.484416:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561018752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484440:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561018752:12345-0@lo:400:kworker.0 Request processed in 24us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002565.484445:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1786002565.484453:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1786002565.484457:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561019264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484491:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561019264:12345-0@lo:400:kworker.0 Request processed in 33us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002565.484495:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1786002565.484511:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561018624 00000100:00100000:1.0:1786002565.484513:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561018624 00000100:00100000:1.0:1786002565.484528:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561019136 00000100:00100000:1.0:1786002565.484530:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561019136 00000100:00100000:1.0:1786002565.484538:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561018240 00000100:00100000:1.0:1786002565.484540:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561018240 00000100:00100000:1.0:1786002565.484548:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1786002565.484553:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561018624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484574:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561018624:12345-0@lo:400:kworker.0 Request processed in 21us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002565.484579:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1786002565.484587:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:1.0:1786002565.484591:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561019136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484609:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561019136:12345-0@lo:400:kworker.0 Request processed in 17us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002565.484613:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:1.0:1786002565.484621:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:1.0:1786002565.484625:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758561018240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484642:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758561018240:12345-0@lo:400:kworker.0 Request processed in 17us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002565.484647:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:1.0:1786002565.484679:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758561018240:0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484687:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561018752:0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484693:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561019264:0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484699:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561018624:0@lo:400:kworker.0 00000100:00100000:1.0:1786002565.484706:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561019136:0@lo:400:kworker.0 00000100:00100000:2.0:1786002565.484816:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561018112 00000100:00100000:2.0:1786002565.484820:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561018112 00000100:00100000:2.0:1786002565.484867:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4052 00000100:00100000:2.0:1786002565.484873:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561018112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002565.484906:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561018112:12345-0@lo:400:kworker.0 Request processed in 34us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002565.484911:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4052 00000100:00100000:2.0:1786002565.484933:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561018112:0@lo:400:kworker.0 00000100:00100000:3.0:1786002565.485051:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561017728 00000100:00100000:3.0:1786002565.485055:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561017728 00000100:00100000:3.0:1786002565.486528:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1786002565.486540:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561017728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786002565.486563:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1786002565.486607:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561017728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002565.486613:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1786002565.486685:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561017728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002565.486953:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561017856:0@lo:400:kworker.0 00000100:00100000:0.0:1786002565.486980:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561018880:0@lo:400:kworker.0 00000100:00100000:0.0:1786002565.486993:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561019392:0@lo:400:kworker.0 00000100:00080000:0.0:1786002565.487037:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786002565.487042:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786002565.487045:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1786002565.487203:0:9839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 925668354921ns, next at 926668352853ns, rc = 0 00000100:00100000:0.0:1786002565.487257:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561019520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002565.487290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002565.492131:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561019520 00000100:00100000:2.0:1786002565.492145:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561019520 00000100:00100000:2.0:1786002565.492196:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1786002565.492206:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3645:x1872758561019520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002565.492230:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1786002565.492292:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3645:x1872758561019520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (5000us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002565.492303:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1786002565.493118:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561019520:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786002566.121939:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786002566.771546:0:21871:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_60j path oi.1/0x1:0xc:0x0 is not in 'O/1/d/' format 00000100:00100000:1.0:1786002567.017956:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561019648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002567.018020:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002567.018087:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561019648 00000100:00100000:1.0:1786002567.018093:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561019648 00000100:00100000:1.0:1786002567.018142:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053 00000100:00100000:1.0:1786002567.018150:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561019648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786002567.018178:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:1.0:1786002567.018216:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561019648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002567.018222:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053 00000100:00100000:1.0:1786002567.018261:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561019648:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1786002567.153608:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002568.173058:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786002568.559689:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 90 committed 00000004:00080000:0.0:1786002568.559710:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 93 committed 00000100:00100000:3.0:1786002568.559896:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561020160:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.559959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.560009:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561020672:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.560028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.560049:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786002568.560053:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561019776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.560069:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.560081:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561020288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.560095:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.560116:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561019904:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.560132:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.560145:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561020416:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.560159:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.560171:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786002568.560175:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561020032:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.560190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.560202:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561020544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.560216:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.560237:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561020160 00000100:00100000:3.0:1786002568.560243:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561020160 00000100:00100000:3.0:1786002568.560284:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561020672 00000100:00100000:3.0:1786002568.560286:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561020672 00000100:00100000:3.0:1786002568.560298:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561019776 00000100:00100000:3.0:1786002568.560300:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561019776 00000100:00100000:3.0:1786002568.560309:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561020288 00000100:00100000:3.0:1786002568.560311:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561020288 00000100:00100000:3.0:1786002568.560318:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561019904 00000100:00100000:3.0:1786002568.560320:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561019904 00000100:00100000:3.0:1786002568.560326:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561020416 00000100:00100000:3.0:1786002568.560328:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561020416 00000100:00100000:3.0:1786002568.560334:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561020032 00000100:00100000:3.0:1786002568.560336:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561020032 00000100:00100000:3.0:1786002568.560343:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561020544 00000100:00100000:3.0:1786002568.560344:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561020544 00000100:00100000:3.0:1786002568.560355:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5297 00000100:00100000:3.0:1786002568.560362:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3646:x1872758561020160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.560384:0:14691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2540 count 1 00002000:00010000:3.0:1786002568.560413:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.560421:0:14691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aeecdbf/0x7cee4af578416ebd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560435:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ec:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.560439:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.560459:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aeecdbf/0x7cee4af578416ebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560473:0:14691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aeecdbf/0x7cee4af578416ebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560483:0:14691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aeecdbf/0x7cee4af578416ebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560490:0:14691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aeecdbf/0x7cee4af578416ebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560504:0:14691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786002568.560684:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3646:x1872758561020160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 321us (724us total) trans 4294969929 rc 0/0 00000100:00100000:3.0:1786002568.560691:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5297 00000100:00100000:3.0:1786002568.560706:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5298 00000100:00100000:3.0:1786002568.560711:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3646:x1872758561020672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.560721:0:14691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2544 count 1 00002000:00010000:3.0:1786002568.560733:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.560737:0:14691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000615159bd/0x7cee4af578416ec4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560745:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f0:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.560748:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.560752:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000615159bd/0x7cee4af578416ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560760:0:14691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000615159bd/0x7cee4af578416ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560772:0:14691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000615159bd/0x7cee4af578416ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560779:0:14691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000615159bd/0x7cee4af578416ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560790:0:14691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1786002568.560839:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3646:x1872758561020672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 127us (809us total) trans 4294969930 rc 0/0 00000100:00100000:3.0:1786002568.560844:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5298 00000100:00100000:3.0:1786002568.560882:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5299 00000100:00100000:3.0:1786002568.560888:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3646:x1872758561019776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.560897:0:14691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2537 count 1 00002000:00010000:3.0:1786002568.560909:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.560913:0:14691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416ecb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560921:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e9:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.560924:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.560928:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416ecb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560936:0:14691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416ecb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560949:0:14691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416ecb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560955:0:14691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416ecb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.560967:0:14691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1786002568.561017:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3646:x1872758561019776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 129us (946us total) trans 4294969931 rc 0/0 00000100:00100000:3.0:1786002568.561023:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5299 00000100:00100000:3.0:1786002568.561033:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5300 00000100:00100000:3.0:1786002568.561038:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3646:x1872758561020288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.561048:0:14691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2541 count 1 00002000:00010000:3.0:1786002568.561059:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.561064:0:14691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416ed2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561071:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ed:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.561073:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.561077:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561085:0:14691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561097:0:14691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561104:0:14691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561111:0:14691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1786002568.561157:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3646:x1872758561020288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 119us (1061us total) trans 4294969932 rc 0/0 00000100:00100000:3.0:1786002568.561162:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5300 00000100:00100000:3.0:1786002568.561172:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5301 00000100:00100000:3.0:1786002568.561177:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3644:x1872758561019904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.561186:0:14691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2538 count 1 00002000:00010000:3.0:1786002568.561197:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.561201:0:14691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416ed9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561208:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ea:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.561211:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.561215:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561223:0:14691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561236:0:14691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561242:0:14691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561250:0:14691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1786002568.561298:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3644:x1872758561019904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 120us (1164us total) trans 4294969933 rc 0/0 00000100:00100000:3.0:1786002568.561303:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5301 00000100:00100000:3.0:1786002568.561313:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5302 00000100:00100000:3.0:1786002568.561318:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3644:x1872758561020416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.561327:0:14691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2542 count 1 00002000:00010000:3.0:1786002568.561338:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.561342:0:14691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ea36e28/0x7cee4af578416ee0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561350:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ee:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.561352:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.561356:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ea36e28/0x7cee4af578416ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561364:0:14691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ea36e28/0x7cee4af578416ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561377:0:14691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ea36e28/0x7cee4af578416ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561384:0:14691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ea36e28/0x7cee4af578416ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561391:0:14691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1786002568.561436:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3644:x1872758561020416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 118us (1275us total) trans 4294969934 rc 0/0 00000100:00100000:3.0:1786002568.561454:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5302 00000100:00100000:3.0:1786002568.561469:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5303 00000100:00100000:3.0:1786002568.561474:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3644:x1872758561020032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.561484:0:14691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2539 count 1 00002000:00010000:3.0:1786002568.561496:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.561501:0:14691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416ee7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561509:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9eb:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.561512:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.561517:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.561525:0:14691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002568.561698:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5304 00000100:00100000:2.0:1786002568.561706:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3644:x1872758561020544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786002568.561717:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2543 count 1 00002000:00010000:2.0:1786002568.561729:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002568.561734:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005db65c72/0x7cee4af578416eee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.561742:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ef:0x0].0x0 since=928s v=(0 0) 00010000:00010000:2.0:1786002568.561745:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002568.561750:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005db65c72/0x7cee4af578416eee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.561758:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005db65c72/0x7cee4af578416eee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.561766:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005db65c72/0x7cee4af578416eee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.561773:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005db65c72/0x7cee4af578416eee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.561781:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:2.0:1786002568.561844:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3644:x1872758561020544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 139us (1626us total) trans 4294969935 rc 0/0 00000100:00100000:2.0:1786002568.561872:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5304 00000100:00100000:0.0:1786002568.562081:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561020800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002568.562114:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002568.562154:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561021312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002568.562177:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002568.562192:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786002568.562197:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561021184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786002568.562214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002568.562227:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561020800 00000100:00100000:0.0:1786002568.562228:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561021696:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786002568.562234:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561020800 00000100:00100000:0.0:1786002568.562248:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002568.562263:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561021312 00000100:00100000:1.0:1786002568.562267:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561021312 00010000:00010000:0.0:1786002568.562272:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00000100:00100000:1.0:1786002568.562279:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561021184 00010000:00010000:0.0:1786002568.562280:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aeecdbf/0x7cee4af578416ebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.562282:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561021184 00000100:00100000:1.0:1786002568.562290:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561021696 00010000:00010000:0.0:1786002568.562292:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83800 already unused, calling callback (ffffffffc0c84fd0) 00000100:00100000:1.0:1786002568.562294:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561021696 00010000:00010000:0.0:1786002568.562299:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aeecdbf/0x7cee4af578416ebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.562307:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5305 00010000:00010000:0.0:1786002568.562312:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aeecdbf/0x7cee4af578416ebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.562315:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3647:x1872758561020800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786002568.562333:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2535 count 1 00010000:00010000:0.0:1786002568.562337:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aeecdbf/0x7cee4af578416ebd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562347:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aeecdbf/0x7cee4af578416ebd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002568.562351:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.562361:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c942e5c/0x7cee4af578416ef5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562368:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1786002568.562373:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e7:0x0].0x0 since=928s v=(0 0) 00010000:00010000:0.0:1786002568.562374:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000615159bd/0x7cee4af578416ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562379:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.562389:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c942e5c/0x7cee4af578416ef5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562390:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002568.562395:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000615159bd/0x7cee4af578416ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562408:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c942e5c/0x7cee4af578416ef5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562410:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000615159bd/0x7cee4af578416ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562429:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c942e5c/0x7cee4af578416ef5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562433:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000615159bd/0x7cee4af578416ec4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562455:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c942e5c/0x7cee4af578416ef5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562459:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000615159bd/0x7cee4af578416ec4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562471:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1786002568.562477:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1786002568.562481:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416ecb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562488:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002568.562492:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416ecb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562500:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416ecb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562510:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416ecb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562517:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ea82150/0x7cee4af578416ecb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562528:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1786002568.562532:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562546:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002568.562551:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.562560:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3647:x1872758561020800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 244us (444us total) trans 4294969925 rc 0/0 00010000:00010000:0.0:1786002568.562561:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.562574:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5305 00010000:00010000:0.0:1786002568.562581:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416ed2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.562590:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5306 00010000:00010000:0.0:1786002568.562592:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578416ed2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.562599:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3647:x1872758561021312:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786002568.562608:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00002000:00080000:1.0:1786002568.562612:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2539 count 1 00010000:00010000:0.0:1786002568.562613:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562622:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002568.562625:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002568.562628:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.562637:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d96a6d48/0x7cee4af578416efc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562639:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416ed9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562656:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9eb:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.562660:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002568.562661:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416ed9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562667:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d96a6d48/0x7cee4af578416efc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562674:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076090f66/0x7cee4af578416ed9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562700:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d96a6d48/0x7cee4af578416efc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562701:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786002568.562707:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ea36e28/0x7cee4af578416ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562714:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d96a6d48/0x7cee4af578416efc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562719:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002568.562725:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ea36e28/0x7cee4af578416ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562727:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d96a6d48/0x7cee4af578416efc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562749:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1786002568.562753:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ea36e28/0x7cee4af578416ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562763:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ea36e28/0x7cee4af578416ee0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562770:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ea36e28/0x7cee4af578416ee0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.562793:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786002568.562797:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005db65c72/0x7cee4af578416eee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.562806:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3647:x1872758561021312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 208us (626us total) trans 4294969926 rc 0/0 00010000:00010000:0.0:1786002568.562806:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2a00 already unused, calling callback (ffffffffc0c84fd0) 00000100:00100000:1.0:1786002568.562814:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5306 00000100:00100000:1.0:1786002568.562825:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5307 00000100:00100000:1.0:1786002568.562830:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3647:x1872758561021184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786002568.562840:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2538 count 1 00002000:00010000:1.0:1786002568.562871:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.562876:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578416f03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562884:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ea:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.562887:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.562891:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578416f03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562906:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578416f03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562914:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578416f03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562920:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578416f03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.562928:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1786002568.562977:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3647:x1872758561021184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 145us (760us total) trans 4294969927 rc 0/0 00010000:00010000:0.0:1786002568.562977:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005db65c72/0x7cee4af578416eee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.562992:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5307 00010000:00010000:0.0:1786002568.562998:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005db65c72/0x7cee4af578416eee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.563007:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5308 00010000:00010000:0.0:1786002568.563011:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005db65c72/0x7cee4af578416eee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.563015:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3647:x1872758561021696:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786002568.563026:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005db65c72/0x7cee4af578416eee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1786002568.563029:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2542 count 1 00002000:00010000:1.0:1786002568.563043:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.563050:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f0304cf/0x7cee4af578416f0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563050:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786002568.563057:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c942e5c/0x7cee4af578416ef5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563062:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ee:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.563071:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002568.563071:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.563079:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f0304cf/0x7cee4af578416f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563080:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c942e5c/0x7cee4af578416ef5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563101:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c942e5c/0x7cee4af578416ef5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563112:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f0304cf/0x7cee4af578416f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563117:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c942e5c/0x7cee4af578416ef5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563125:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f0304cf/0x7cee4af578416f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563129:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c942e5c/0x7cee4af578416ef5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563140:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f0304cf/0x7cee4af578416f0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563148:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002568.563151:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1786002568.563153:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d96a6d48/0x7cee4af578416efc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563161:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002568.563164:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d96a6d48/0x7cee4af578416efc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563177:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d96a6d48/0x7cee4af578416efc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563187:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d96a6d48/0x7cee4af578416efc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563195:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d96a6d48/0x7cee4af578416efc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.563202:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3647:x1872758561021696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 187us (952us total) trans 4294969928 rc 0/0 00000100:00100000:1.0:1786002568.563212:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5308 00010000:00010000:0.0:1786002568.563213:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786002568.563218:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578416f03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563224:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002568.563228:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578416f03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786002568.563231:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002568.563236:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786002568.563238:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578416f03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.563249:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561021056:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786002568.563250:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578416f03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563261:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578416f03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.563276:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786002568.563277:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002568.563282:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f0304cf/0x7cee4af578416f0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563288:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002568.563291:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f0304cf/0x7cee4af578416f0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.563295:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561021568:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786002568.563305:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f0304cf/0x7cee4af578416f0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.563317:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786002568.563317:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f0304cf/0x7cee4af578416f0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002568.563328:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f0304cf/0x7cee4af578416f0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.563333:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786002568.563341:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561020928:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786002568.563343:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002568.563347:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002568.563351:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002568.563360:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002568.563364:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002568.563375:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561021440:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786002568.563392:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002568.563412:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561021056 00000100:00100000:1.0:1786002568.563415:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561021056 00000100:00100000:1.0:1786002568.563430:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561021568 00000100:00100000:1.0:1786002568.563432:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561021568 00000100:00100000:1.0:1786002568.563440:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561020928 00000100:00100000:1.0:1786002568.563456:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561020928 00000100:00100000:1.0:1786002568.563466:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561021440 00000100:00100000:1.0:1786002568.563467:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561021440 00000100:00100000:1.0:1786002568.563477:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5309 00000100:00100000:1.0:1786002568.563482:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3645:x1872758561021056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786002568.563492:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2537 count 1 00002000:00010000:1.0:1786002568.563504:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.563509:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578416f11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563518:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e9:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.563521:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.563525:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578416f11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563534:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578416f11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563542:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578416f11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563549:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578416f11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563567:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786002568.563619:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3645:x1872758561021056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 136us (344us total) trans 4294969929 rc 0/0 00000100:00100000:1.0:1786002568.563625:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5309 00000100:00100000:1.0:1786002568.563636:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5310 00000100:00100000:1.0:1786002568.563642:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3645:x1872758561021568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786002568.563651:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2541 count 1 00002000:00010000:1.0:1786002568.563662:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.563667:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578416f18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563676:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ed:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.563679:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.563684:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578416f18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002568.563694:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5311 00010000:00010000:1.0:1786002568.563696:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578416f18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002568.563705:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3645:x1872758561020928:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1786002568.563708:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578416f18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563718:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578416f18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1786002568.563723:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2536 count 1 00010000:00010000:1.0:1786002568.563739:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786002568.563743:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002568.563750:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416f1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.563760:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e8:0x0].0x0 since=928s v=(0 0) 00010000:00010000:2.0:1786002568.563764:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002568.563768:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.563790:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3645:x1872758561021568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 147us (472us total) trans 4294969930 rc 0/0 00010000:00010000:2.0:1786002568.563791:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.563802:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5310 00010000:00010000:2.0:1786002568.563809:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.563817:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5312 00010000:00010000:2.0:1786002568.563820:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416f1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.563826:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3645:x1872758561021440:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1786002568.563836:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:1.0:1786002568.563840:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2540 count 1 00002000:00010000:1.0:1786002568.563874:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.563879:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bea09308/0x7cee4af578416f26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563888:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ec:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.563891:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.563896:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bea09308/0x7cee4af578416f26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563906:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bea09308/0x7cee4af578416f26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563914:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bea09308/0x7cee4af578416f26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.563921:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bea09308/0x7cee4af578416f26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002568.563931:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3645:x1872758561020928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 228us (567us total) trans 4294969931 rc 0/0 00010000:00010000:1.0:1786002568.563940:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1786002568.563945:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5311 00000100:00100000:1.0:1786002568.563997:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3645:x1872758561021440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 172us (603us total) trans 4294969932 rc 0/0 00000100:00100000:1.0:1786002568.564002:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5312 00000004:00080000:1.0:1786002568.564033:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f537480/2, rc 0, transno 4294969931 00000100:00100000:1.0:1786002568.564051:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561020928:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1786002568.564059:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f536300/2, rc 0, transno 4294969932 00000100:00100000:1.0:1786002568.564063:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561021440:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1786002568.564069:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f536680/2, rc 0, transno 4294969929 00000100:00100000:1.0:1786002568.564072:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561021056:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1786002568.564078:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed243dd5880/2, rc 0, transno 4294969930 00000100:00100000:1.0:1786002568.564080:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561021568:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1786002568.564110:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f534000/2, rc 0, transno 4294969927 00000100:00100000:1.0:1786002568.564113:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561021184:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1786002568.564120:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f2a00/2, rc 0, transno 4294969928 00000100:00100000:1.0:1786002568.564123:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561021696:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1786002568.564130:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f534380/2, rc 0, transno 4294969925 00000100:00100000:1.0:1786002568.564133:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561020800:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1786002568.564139:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f537800/2, rc 0, transno 4294969926 00000100:00100000:1.0:1786002568.564142:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561021312:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1786002568.564196:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1786002568.564201:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578416f11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564209:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.564213:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578416f11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564221:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578416f11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564232:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578416f11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564240:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578416f11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564253:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786002568.564256:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578416f18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564263:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.564267:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578416f18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564275:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578416f18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564284:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578416f18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564291:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578416f18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564303:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002568.564307:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416f1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564315:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.564318:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416f1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564327:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416f1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564338:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416f1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564347:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fca30a4e/0x7cee4af578416f1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564361:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002568.564365:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bea09308/0x7cee4af578416f26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564372:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.564376:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bea09308/0x7cee4af578416f26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564384:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bea09308/0x7cee4af578416f26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564394:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bea09308/0x7cee4af578416f26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564401:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bea09308/0x7cee4af578416f26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.564412:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786002568.564414:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969928 is committed 00010000:00010000:1.0:1786002568.564415:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.564418:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.564426:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002568.564463:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561022080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.564488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.564531:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561022592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.564556:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.564571:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786002568.564576:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561021952:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.564591:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.564601:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561022464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.564618:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.564631:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561021824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.564647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.564654:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561022336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.564667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.564679:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786002568.564683:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561022208:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.564697:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.564704:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561022720:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.564716:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.564729:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561022080 00000100:00100000:2.0:1786002568.564733:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561022080 00000100:00100000:2.0:1786002568.564748:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561022592 00000100:00100000:2.0:1786002568.564750:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561022592 00000100:00100000:2.0:1786002568.564758:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561021952 00000100:00100000:2.0:1786002568.564759:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561021952 00000100:00100000:2.0:1786002568.564766:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561022464 00000100:00100000:2.0:1786002568.564768:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561022464 00000100:00100000:2.0:1786002568.564775:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561021824 00000100:00100000:2.0:1786002568.564777:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561021824 00000100:00100000:1.0:1786002568.564934:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561022336 00000100:00100000:1.0:1786002568.564938:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561022336 00000100:00100000:1.0:1786002568.564951:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561022208 00000100:00100000:1.0:1786002568.564953:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561022208 00000100:00100000:1.0:1786002568.564961:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561022720 00000100:00100000:1.0:1786002568.564963:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561022720 00000100:00100000:1.0:1786002568.564971:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5313 00000100:00100000:1.0:1786002568.564976:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3645:x1872758561022080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786002568.564989:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2545 count 1 00002000:00010000:1.0:1786002568.565002:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.565007:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f748683/0x7cee4af578416f2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565020:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f1:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.565023:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.565027:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f748683/0x7cee4af578416f2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565036:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f748683/0x7cee4af578416f2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565044:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f748683/0x7cee4af578416f2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565052:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f748683/0x7cee4af578416f2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565063:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786002568.565126:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3645:x1872758561022080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 148us (636us total) trans 4294969933 rc 0/0 00000100:00100000:1.0:1786002568.565132:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5313 00000100:00100000:1.0:1786002568.565143:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5314 00000100:00100000:1.0:1786002568.565148:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3645:x1872758561022592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786002568.565157:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2549 count 1 00002000:00010000:1.0:1786002568.565168:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.565173:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c95d83e2/0x7cee4af578416f34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565186:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f5:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.565189:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.565193:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c95d83e2/0x7cee4af578416f34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565202:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c95d83e2/0x7cee4af578416f34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565210:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c95d83e2/0x7cee4af578416f34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565218:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c95d83e2/0x7cee4af578416f34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565229:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1786002568.565276:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3645:x1872758561022592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 128us (719us total) trans 4294969934 rc 0/0 00000100:00100000:1.0:1786002568.565282:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5314 00000100:00100000:1.0:1786002568.565292:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5315 00000100:00100000:1.0:1786002568.565297:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3645:x1872758561021952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786002568.565307:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2544 count 1 00002000:00010000:1.0:1786002568.565317:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.565322:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a570285/0x7cee4af578416f3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565334:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f0:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.565337:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.565340:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a570285/0x7cee4af578416f3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565349:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a570285/0x7cee4af578416f3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565357:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a570285/0x7cee4af578416f3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565363:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a570285/0x7cee4af578416f3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565371:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1786002568.565416:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3645:x1872758561021952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 118us (823us total) trans 4294969935 rc 0/0 00000100:00100000:1.0:1786002568.565422:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5315 00000100:00100000:1.0:1786002568.565432:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5316 00000100:00100000:1.0:1786002568.565437:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3645:x1872758561022464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786002568.565461:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2548 count 1 00002000:00010000:1.0:1786002568.565473:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.565477:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8eb75a8/0x7cee4af578416f42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565490:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f4:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.565493:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.565497:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8eb75a8/0x7cee4af578416f42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.565506:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8eb75a8/0x7cee4af578416f42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002568.565633:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5317 00000100:00100000:2.0:1786002568.565639:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3647:x1872758561022336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002568.565648:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2547 count 1 00002000:00010000:2.0:1786002568.565659:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002568.565664:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416f49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.565672:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f3:0x0].0x0 since=928s v=(0 0) 00010000:00010000:2.0:1786002568.565675:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002568.565679:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416f49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.565687:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416f49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.565695:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416f49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.565702:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416f49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.565709:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1786002568.565764:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3647:x1872758561022336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 124us (1095us total) trans 4294969936 rc 0/0 00000100:00100000:2.0:1786002568.565769:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5317 00000001:00080000:0.0:1786002568.566020:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969924 is committed 00010000:00010000:3.0:1786002568.566102:0:14691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.566114:0:14691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.566263:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8eb75a8/0x7cee4af578416f42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.566271:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8eb75a8/0x7cee4af578416f42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.566281:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1786002568.566334:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3645:x1872758561022464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 896us (1714us total) trans 4294969937 rc 0/0 00000100:00100000:2.0:1786002568.566364:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5318 00000100:00100000:2.0:1786002568.566372:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3647:x1872758561022208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002568.566383:0:14685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2546 count 1 00002000:00010000:2.0:1786002568.566395:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002568.566399:0:14685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416f50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.566407:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f2:0x0].0x0 since=928s v=(0 0) 00010000:00010000:2.0:1786002568.566410:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002568.566414:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416f50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.566423:0:14685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416f50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.566430:0:14685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416f50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.566437:0:14685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416f50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.566458:0:14685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1786002568.566508:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3647:x1872758561022208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 137us (1808us total) trans 4294969938 rc 0/0 00000100:00100000:3.0:1786002568.566704:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5319 00000100:00100000:3.0:1786002568.566712:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3647:x1872758561022720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786002568.566723:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2550 count 1 00002000:00010000:3.0:1786002568.566736:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.566741:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416f57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.566749:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f6:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.566752:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.566756:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416f57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.566765:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416f57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.566772:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416f57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.566790:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416f57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.566799:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:3.0:1786002568.566881:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3647:x1872758561022720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 171us (2163us total) trans 4294969939 rc 0/0 00000100:00100000:3.0:1786002568.566888:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5319 00000100:00100000:3.0:1786002568.566901:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5320 00000100:00100000:3.0:1786002568.566906:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3647:x1872758561021824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786002568.566916:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2543 count 1 00002000:00010000:3.0:1786002568.566928:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.566933:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2c36cb4/0x7cee4af578416f5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.566940:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ef:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.566943:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.566947:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2c36cb4/0x7cee4af578416f5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.566955:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2c36cb4/0x7cee4af578416f5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.566963:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2c36cb4/0x7cee4af578416f5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.566969:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2c36cb4/0x7cee4af578416f5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.566982:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:3.0:1786002568.567029:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3647:x1872758561021824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 123us (2381us total) trans 4294969940 rc 0/0 00000100:00100000:3.0:1786002568.567035:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5320 00010000:00010000:3.0:1786002568.567106:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1786002568.567111:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f748683/0x7cee4af578416f2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567119:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002568.567123:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f748683/0x7cee4af578416f2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567132:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f748683/0x7cee4af578416f2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567146:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f748683/0x7cee4af578416f2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567153:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f748683/0x7cee4af578416f2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567166:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1786002568.567169:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c95d83e2/0x7cee4af578416f34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567180:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002568.567183:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c95d83e2/0x7cee4af578416f34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567189:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c95d83e2/0x7cee4af578416f34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567196:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c95d83e2/0x7cee4af578416f34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567202:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c95d83e2/0x7cee4af578416f34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567211:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1786002568.567214:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a570285/0x7cee4af578416f3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567220:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002568.567222:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a570285/0x7cee4af578416f3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567229:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a570285/0x7cee4af578416f3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567236:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a570285/0x7cee4af578416f3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567243:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a570285/0x7cee4af578416f3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567252:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1786002568.567255:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416f49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567261:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002568.567264:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416f49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567271:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416f49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567279:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416f49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567286:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578416f49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567295:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786002568.567298:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8eb75a8/0x7cee4af578416f42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567303:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002568.567306:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8eb75a8/0x7cee4af578416f42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567314:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8eb75a8/0x7cee4af578416f42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567321:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8eb75a8/0x7cee4af578416f42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567328:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8eb75a8/0x7cee4af578416f42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567337:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786002568.567339:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416f50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567345:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002568.567348:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416f50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567354:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416f50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567362:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416f50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567369:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dab2baf7/0x7cee4af578416f50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567379:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786002568.567382:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416f57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567387:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002568.567390:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416f57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567397:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416f57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567404:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416f57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567411:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004a424c8/0x7cee4af578416f57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567421:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002568.567424:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2c36cb4/0x7cee4af578416f5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567430:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002568.567433:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2c36cb4/0x7cee4af578416f5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567458:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2c36cb4/0x7cee4af578416f5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567467:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2c36cb4/0x7cee4af578416f5e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567475:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2c36cb4/0x7cee4af578416f5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567486:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002568.567487:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002568.567489:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786002568.567521:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc51c00/2, rc 0, transno 4294969935 00000100:00100000:3.0:1786002568.567531:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561020544:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002568.567550:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc51500/2, rc 0, transno 4294969933 00000100:00100000:3.0:1786002568.567553:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561019904:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002568.567561:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc53480/2, rc 0, transno 4294969934 00000100:00100000:3.0:1786002568.567564:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561020416:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.567618:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561022976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.567642:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.567666:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786002568.567671:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561023104:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.567685:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.567700:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561022976 00000100:00100000:3.0:1786002568.567704:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561022976 00000100:00100000:3.0:1786002568.567721:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561023104 00000100:00100000:3.0:1786002568.567723:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561023104 00000100:00100000:3.0:1786002568.567735:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5321 00000100:00100000:3.0:1786002568.567740:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3644:x1872758561022976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.567750:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2546 count 1 00002000:00010000:3.0:1786002568.567764:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.567769:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc5c8e86/0x7cee4af578416f65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567777:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f2:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.567780:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.567784:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc5c8e86/0x7cee4af578416f65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567793:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc5c8e86/0x7cee4af578416f65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567800:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc5c8e86/0x7cee4af578416f65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567806:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc5c8e86/0x7cee4af578416f65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567816:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786002568.567898:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3644:x1872758561022976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 158us (255us total) trans 4294969936 rc 0/0 00000100:00100000:3.0:1786002568.567905:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5321 00000100:00100000:3.0:1786002568.567917:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5322 00000100:00100000:3.0:1786002568.567922:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3644:x1872758561023104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.567931:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2547 count 1 00002000:00010000:3.0:1786002568.567942:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.567947:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cec4d78/0x7cee4af578416f6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567955:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f3:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.567958:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.567962:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cec4d78/0x7cee4af578416f6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567970:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cec4d78/0x7cee4af578416f6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567977:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cec4d78/0x7cee4af578416f6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567985:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cec4d78/0x7cee4af578416f6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.567991:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1786002568.568037:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3644:x1872758561023104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 115us (350us total) trans 4294969937 rc 0/0 00000100:00100000:3.0:1786002568.568042:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5322 00010000:00010000:3.0:1786002568.568058:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786002568.568062:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc5c8e86/0x7cee4af578416f65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.568069:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82e00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002568.568072:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc5c8e86/0x7cee4af578416f65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.568079:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc5c8e86/0x7cee4af578416f65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.568089:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc5c8e86/0x7cee4af578416f65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.568095:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc5c8e86/0x7cee4af578416f65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.568106:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002568.568109:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cec4d78/0x7cee4af578416f6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.568115:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002568.568119:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cec4d78/0x7cee4af578416f6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.568125:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cec4d78/0x7cee4af578416f6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.568133:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cec4d78/0x7cee4af578416f6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.568140:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cec4d78/0x7cee4af578416f6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.568149:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002568.568151:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002568.568152:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002568.568164:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969928 gen 2 00000004:00080000:3.0:1786002568.568168:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f0e00, transno 4294969915 00000004:00080000:3.0:1786002568.568173:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f1f80, transno 4294969916 00000004:00080000:3.0:1786002568.568176:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f1880, transno 4294969917 00000004:00080000:3.0:1786002568.568178:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f3b80, transno 4294969918 00000004:00080000:3.0:1786002568.568180:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f3480, transno 4294969919 00000004:00080000:3.0:1786002568.568183:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f3100, transno 4294969920 00000004:00080000:3.0:1786002568.568185:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f1500, transno 4294969921 00000004:00080000:3.0:1786002568.568187:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f536d80, transno 4294969922 00000004:00080000:3.0:1786002568.568189:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f535500, transno 4294969923 00000004:00080000:3.0:1786002568.568192:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f537b80, transno 4294969924 00000004:00080000:3.0:1786002568.568194:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f535180, transno 4294969925 00000004:00080000:3.0:1786002568.568196:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f534700, transno 4294969926 00000004:00080000:3.0:1786002568.568198:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f535f80, transno 4294969927 00000004:00080000:3.0:1786002568.568200:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f536a00, transno 4294969928 00000100:00100000:3.0:1786002568.568206:0:3644:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed37bc51500 x1872758561019904/t4294969933(4294969933) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786002584 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1786002568.568214:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454c3100/2, rc 0, transno 4294969937 00000100:00100000:3.0:1786002568.568217:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561023104:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002568.568224:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f3a3480/2, rc 0, transno 4294969936 00000100:00100000:3.0:1786002568.568228:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561022976:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002568.568311:0:8758:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 12 changes, 11 in progress, 6 in flight, 14 done 00000100:00100000:3.0:1786002568.568339:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561023232:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.568359:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786002568.568383:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc52680/2, rc 0, transno 4294969931 00000100:00100000:3.0:1786002568.568388:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561019776:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002568.568396:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc51180/2, rc 0, transno 4294969932 00000100:00100000:3.0:1786002568.568399:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561020288:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002568.568406:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc52d80/2, rc 0, transno 4294969929 00000100:00100000:3.0:1786002568.568409:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561020160:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002568.568415:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc50700/2, rc 0, transno 4294969930 00000100:00100000:3.0:1786002568.568418:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561020672:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.568424:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786002568.568428:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561022848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.568980:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002568.569030:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5316 00000100:00100000:3.0:1786002568.569065:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561023360:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.569085:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.569125:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5318 00000100:00100000:1.0:1786002568.572732:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561023232 00000100:00100000:1.0:1786002568.572744:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561023232 00000100:00100000:1.0:1786002568.572794:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561022848 00000100:00100000:1.0:1786002568.572797:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561022848 00000100:00100000:1.0:1786002568.572815:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5323 00000100:00100000:1.0:1786002568.572823:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3646:x1872758561023232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002568.572858:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2548 count 1 00002000:00010000:1.0:1786002568.572883:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.572891:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1e3e2d8/0x7cee4af578416f73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.572903:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f4:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.572907:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.572913:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1e3e2d8/0x7cee4af578416f73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.572925:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1e3e2d8/0x7cee4af578416f73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.572934:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1e3e2d8/0x7cee4af578416f73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.572941:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1e3e2d8/0x7cee4af578416f73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.572955:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786002568.573084:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3646:x1872758561023232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 261us (4723us total) trans 4294969938 rc 0/0 00000100:00100000:1.0:1786002568.573090:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5323 00000100:00100000:1.0:1786002568.573103:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5324 00000100:00100000:1.0:1786002568.573108:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3646:x1872758561022848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002568.573117:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2545 count 1 00002000:00010000:1.0:1786002568.573129:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.573133:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000491c2aa4/0x7cee4af578416f7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573146:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f1:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.573149:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.573153:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000491c2aa4/0x7cee4af578416f7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573161:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000491c2aa4/0x7cee4af578416f7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573168:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000491c2aa4/0x7cee4af578416f7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573175:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000491c2aa4/0x7cee4af578416f7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573183:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1786002568.573232:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3646:x1872758561022848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 124us (4252us total) trans 4294969939 rc 0/0 00000100:00100000:1.0:1786002568.573237:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5324 00010000:00010000:1.0:1786002568.573260:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002568.573265:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1e3e2d8/0x7cee4af578416f73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573273:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.573277:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1e3e2d8/0x7cee4af578416f73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573290:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1e3e2d8/0x7cee4af578416f73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573305:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1e3e2d8/0x7cee4af578416f73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573312:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1e3e2d8/0x7cee4af578416f73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573328:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002568.573331:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000491c2aa4/0x7cee4af578416f7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573336:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.573339:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000491c2aa4/0x7cee4af578416f7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573346:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000491c2aa4/0x7cee4af578416f7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573353:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000491c2aa4/0x7cee4af578416f7a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573359:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000491c2aa4/0x7cee4af578416f7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.573373:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.573374:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.573376:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.573382:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.573474:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786002568.573983:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454c0700/2, rc 0, transno 4294969938 00000100:00100000:3.0:1786002568.573990:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561023232:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002568.574000:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f3a3800/2, rc 0, transno 4294969939 00000100:00100000:3.0:1786002568.574003:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561022848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.574019:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561023360 00000100:00100000:3.0:1786002568.574022:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561023360 00000100:00100000:3.0:1786002568.574044:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5325 00000100:00100000:3.0:1786002568.574049:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3646:x1872758561023360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.574060:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2549 count 1 00002000:00010000:3.0:1786002568.574074:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.574079:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d046223/0x7cee4af578416f81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.574087:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f5:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.574090:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.574094:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d046223/0x7cee4af578416f81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.574103:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d046223/0x7cee4af578416f81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.574111:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d046223/0x7cee4af578416f81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.574117:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d046223/0x7cee4af578416f81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.574127:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786002568.574186:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3646:x1872758561023360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 136us (5099us total) trans 4294969940 rc 0/0 00000100:00100000:3.0:1786002568.574192:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5325 00000100:00100000:3.0:1786002568.574275:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561023488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.574300:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.574315:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561024000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.574330:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.574342:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786002568.574346:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561023616:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.574360:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.574369:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561024128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.574381:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.574397:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561023488 00000100:00100000:3.0:1786002568.574399:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561023488 00000100:00100000:3.0:1786002568.574413:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561024000 00000100:00100000:3.0:1786002568.574415:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561024000 00000100:00100000:3.0:1786002568.574427:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561023616 00000100:00100000:3.0:1786002568.574429:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561023616 00000100:00100000:3.0:1786002568.574436:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561024128 00000100:00100000:3.0:1786002568.574438:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561024128 00000100:00100000:3.0:1786002568.574463:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5326 00000100:00100000:3.0:1786002568.574468:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3644:x1872758561023488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.574478:0:14665:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2550 count 1 00002000:00010000:3.0:1786002568.574490:0:14665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.574494:0:14665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578416f88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.574502:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f6:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.574505:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.574509:0:14665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578416f88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002568.574636:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5327 00000100:00100000:1.0:1786002568.574644:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3644:x1872758561024000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002568.574654:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2554 count 1 00002000:00010000:1.0:1786002568.574666:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.574671:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002603801/0x7cee4af578416f8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.574679:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fa:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.574682:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.574686:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002603801/0x7cee4af578416f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.574694:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002603801/0x7cee4af578416f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.574701:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002603801/0x7cee4af578416f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.574708:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002603801/0x7cee4af578416f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.574724:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1786002568.574797:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3644:x1872758561024000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 154us (465us total) trans 4294969941 rc 0/0 00000100:00100000:1.0:1786002568.574803:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5327 00000100:00100000:1.0:1786002568.574815:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5328 00000100:00100000:1.0:1786002568.574820:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3644:x1872758561023616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002568.574830:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2551 count 1 00002000:00010000:1.0:1786002568.574840:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.574858:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f6e5e5f/0x7cee4af578416f96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.574865:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f7:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.574868:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.574872:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f6e5e5f/0x7cee4af578416f96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.574880:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f6e5e5f/0x7cee4af578416f96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.574887:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f6e5e5f/0x7cee4af578416f96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.574894:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f6e5e5f/0x7cee4af578416f96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.574910:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1786002568.574959:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3644:x1872758561023616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 138us (596us total) trans 4294969942 rc 0/0 00000100:00100000:1.0:1786002568.574965:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5328 00000100:00100000:1.0:1786002568.574975:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5329 00000100:00100000:1.0:1786002568.574980:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3644:x1872758561024128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002568.574989:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2555 count 1 00002000:00010000:1.0:1786002568.575000:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.575004:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578416f9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575011:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fb:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.575014:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.575018:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578416f9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575025:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578416f9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575033:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578416f9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575040:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578416f9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575052:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1786002568.575098:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3644:x1872758561024128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 117us (715us total) trans 4294969943 rc 0/0 00000100:00100000:1.0:1786002568.575104:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5329 00010000:00010000:1.0:1786002568.575120:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1786002568.575124:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d046223/0x7cee4af578416f81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575132:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.575135:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d046223/0x7cee4af578416f81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575144:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d046223/0x7cee4af578416f81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575155:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d046223/0x7cee4af578416f81 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575162:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d046223/0x7cee4af578416f81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575177:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786002568.575180:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002603801/0x7cee4af578416f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575191:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999a00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.575194:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002603801/0x7cee4af578416f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575201:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002603801/0x7cee4af578416f8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575209:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002603801/0x7cee4af578416f8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575217:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002603801/0x7cee4af578416f8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575226:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002568.575229:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f6e5e5f/0x7cee4af578416f96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575235:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.575238:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f6e5e5f/0x7cee4af578416f96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575244:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f6e5e5f/0x7cee4af578416f96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575251:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f6e5e5f/0x7cee4af578416f96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575259:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f6e5e5f/0x7cee4af578416f96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575268:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002568.575270:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578416f9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575276:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.575279:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578416f9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575286:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578416f9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575294:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578416f9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575300:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578416f9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575309:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.575311:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.575312:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786002568.575327:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454c1500/2, rc 0, transno 4294969942 00000100:00100000:1.0:1786002568.575336:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561023616:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1786002568.575343:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454c0000/2, rc 0, transno 4294969943 00000100:00100000:1.0:1786002568.575346:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561024128:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1786002568.575352:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454c3480/2, rc 0, transno 4294969941 00000100:00100000:1.0:1786002568.575355:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561024000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786002568.575393:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561024512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786002568.575413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786002568.575431:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002568.575436:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561024512 00000100:00100000:1.0:1786002568.575439:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561024512 00000100:00100000:1.0:1786002568.575469:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5330 00000100:00100000:1.0:1786002568.575474:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3644:x1872758561024512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002568.575483:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2558 count 1 00002000:00010000:1.0:1786002568.575496:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.575500:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e4dfe7/0x7cee4af578416fa4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575508:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fe:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.575521:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.575526:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e4dfe7/0x7cee4af578416fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575535:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e4dfe7/0x7cee4af578416fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575656:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e4dfe7/0x7cee4af578416fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575669:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e4dfe7/0x7cee4af578416fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575681:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786002568.575737:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3644:x1872758561024512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 262us (322us total) trans 4294969944 rc 0/0 00000100:00100000:1.0:1786002568.575742:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5330 00000004:00080000:1.0:1786002568.575764:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f572300/2, rc 0, transno 4294969944 00000100:00100000:1.0:1786002568.575771:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561024512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786002568.575869:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002568.575876:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561024640:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786002568.575896:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002568.575914:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561024640 00000100:00100000:1.0:1786002568.575917:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561024640 00000100:00100000:1.0:1786002568.575934:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5331 00000100:00100000:1.0:1786002568.575939:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3644:x1872758561024640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002568.575948:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2559 count 1 00002000:00010000:1.0:1786002568.575962:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.575967:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000286f18ba/0x7cee4af578416fab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575975:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ff:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.575978:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.575982:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000286f18ba/0x7cee4af578416fab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.575996:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000286f18ba/0x7cee4af578416fab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576003:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000286f18ba/0x7cee4af578416fab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576010:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000286f18ba/0x7cee4af578416fab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576020:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1786002568.576072:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3644:x1872758561024640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 132us (174us total) trans 4294969945 rc 0/0 00000100:00100000:1.0:1786002568.576077:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5331 00010000:00010000:1.0:1786002568.576089:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002568.576093:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e4dfe7/0x7cee4af578416fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576100:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed382166c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.576103:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e4dfe7/0x7cee4af578416fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576111:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e4dfe7/0x7cee4af578416fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576121:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e4dfe7/0x7cee4af578416fa4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576129:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e4dfe7/0x7cee4af578416fa4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576141:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002568.576144:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000286f18ba/0x7cee4af578416fab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576150:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.576153:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000286f18ba/0x7cee4af578416fab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576160:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000286f18ba/0x7cee4af578416fab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576168:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000286f18ba/0x7cee4af578416fab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576175:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000286f18ba/0x7cee4af578416fab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576184:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.576185:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.576187:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786002568.576200:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f573800/2, rc 0, transno 4294969945 00000100:00100000:1.0:1786002568.576204:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561024640:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1786002568.576212:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.576217:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002568.576423:0:14665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578416f88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.576431:0:14665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578416f88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.576438:0:14665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578416f88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.576466:0:14665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786002568.576652:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3644:x1872758561023488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2182us (2349us total) trans 4294969946 rc 0/0 00000100:00100000:3.0:1786002568.576659:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5326 00000100:00100000:3.0:1786002568.576684:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561023744:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.576704:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.576723:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561024256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.576738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786002568.576754:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454c3800/2, rc 0, transno 4294969940 00000100:00100000:3.0:1786002568.576757:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561023360:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.576764:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786002568.576769:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561023872:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786002568.576902:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561023744 00000100:00100000:1.0:1786002568.576907:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561023744 00000100:00100000:1.0:1786002568.576925:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561024256 00000100:00100000:1.0:1786002568.576927:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561024256 00000100:00100000:1.0:1786002568.576940:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5332 00000100:00100000:1.0:1786002568.576945:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3646:x1872758561023744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002568.576955:0:14678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2552 count 1 00002000:00010000:1.0:1786002568.576968:0:14678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.576973:0:14678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b40a23c/0x7cee4af578416fb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576982:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f8:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.576985:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.576989:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b40a23c/0x7cee4af578416fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.576999:0:14678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b40a23c/0x7cee4af578416fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577006:0:14678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b40a23c/0x7cee4af578416fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577013:0:14678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b40a23c/0x7cee4af578416fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577025:0:14678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1786002568.577076:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3646:x1872758561023744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 130us (370us total) trans 4294969947 rc 0/0 00000100:00100000:1.0:1786002568.577082:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5332 00000100:00100000:1.0:1786002568.577091:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5333 00000100:00100000:1.0:1786002568.577097:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3646:x1872758561024256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786002568.577105:0:14678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2556 count 1 00002000:00010000:1.0:1786002568.577116:0:14678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.577120:0:14678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d815bb5/0x7cee4af578416fb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577128:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fc:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.577131:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.577135:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d815bb5/0x7cee4af578416fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577143:0:14678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d815bb5/0x7cee4af578416fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577151:0:14678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d815bb5/0x7cee4af578416fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577158:0:14678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d815bb5/0x7cee4af578416fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577169:0:14678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1786002568.577215:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3646:x1872758561024256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 118us (475us total) trans 4294969948 rc 0/0 00000100:00100000:1.0:1786002568.577224:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5333 00010000:00010000:1.0:1786002568.577237:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786002568.577241:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578416f88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577248:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.577252:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578416f88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577260:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578416f88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577270:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578416f88 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577278:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578416f88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577290:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002568.577294:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b40a23c/0x7cee4af578416fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577300:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.577303:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b40a23c/0x7cee4af578416fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577315:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b40a23c/0x7cee4af578416fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577323:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b40a23c/0x7cee4af578416fb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577330:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b40a23c/0x7cee4af578416fb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577339:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002568.577342:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d815bb5/0x7cee4af578416fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577348:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556aa00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.577351:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d815bb5/0x7cee4af578416fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577358:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d815bb5/0x7cee4af578416fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577365:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d815bb5/0x7cee4af578416fb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577371:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d815bb5/0x7cee4af578416fb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.577385:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.577386:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.577388:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786002568.577403:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454c2680/2, rc 0, transno 4294969946 00000100:00100000:1.0:1786002568.577407:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561023488:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1786002568.577415:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.577420:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002568.577472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.577500:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561024384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.577532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1786002568.577558:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454c1f80/2, rc 0, transno 4294969947 00000100:00100000:3.0:1786002568.577561:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561023744:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002568.577570:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f570e00/2, rc 0, transno 4294969948 00000100:00100000:3.0:1786002568.577572:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561024256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002568.577586:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561023872 00000100:00100000:3.0:1786002568.577588:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561023872 00000100:00100000:3.0:1786002568.577604:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561024384 00000100:00100000:3.0:1786002568.577606:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561024384 00000100:00100000:3.0:1786002568.577618:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5334 00000100:00100000:3.0:1786002568.577622:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3646:x1872758561023872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.577632:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2553 count 1 00002000:00010000:3.0:1786002568.577645:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.577649:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080daa107/0x7cee4af578416fc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.577657:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f9:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.577660:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.577664:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080daa107/0x7cee4af578416fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.577673:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080daa107/0x7cee4af578416fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.577680:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080daa107/0x7cee4af578416fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.577688:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080daa107/0x7cee4af578416fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.577703:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786002568.577756:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3646:x1872758561023872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 132us (284us total) trans 4294969949 rc 0/0 00000100:00100000:3.0:1786002568.577762:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5334 00000100:00100000:3.0:1786002568.577772:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5335 00000100:00100000:3.0:1786002568.577778:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3646:x1872758561024384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786002568.577798:0:14687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2557 count 1 00002000:00010000:3.0:1786002568.577811:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.577816:0:14687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051cfe320/0x7cee4af578416fc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.577823:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fd:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.577826:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.577830:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051cfe320/0x7cee4af578416fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.577839:0:14687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051cfe320/0x7cee4af578416fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.577862:0:14687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051cfe320/0x7cee4af578416fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.577871:0:14687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051cfe320/0x7cee4af578416fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.577886:0:14687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1786002568.577934:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3646:x1872758561024384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 156us (400us total) trans 4294969950 rc 0/0 00000100:00100000:3.0:1786002568.577939:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5335 00000004:00080000:3.0:1786002568.577961:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454c0380/2, rc 0, transno 4294969949 00000100:00100000:3.0:1786002568.577965:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561023872:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1786002568.577971:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37f570a80/2, rc 0, transno 4294969950 00000100:00100000:3.0:1786002568.577974:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561024384:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1786002568.577986:0:14691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1786002568.578040:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3644:x1872758561020032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16565us (17848us total) trans 4294969951 rc 0/0 00000100:00100000:3.0:1786002568.578045:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5303 00000004:00080000:1.0:1786002568.578351:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37bc50000/2, rc 0, transno 4294969951 00000100:00100000:1.0:1786002568.578356:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561020032:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1786002568.578367:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786002568.578371:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080daa107/0x7cee4af578416fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.578379:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83600 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.578382:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080daa107/0x7cee4af578416fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.578390:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080daa107/0x7cee4af578416fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.578401:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080daa107/0x7cee4af578416fc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.578408:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080daa107/0x7cee4af578416fc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.578426:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002568.578429:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051cfe320/0x7cee4af578416fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.578436:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82400 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.578439:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051cfe320/0x7cee4af578416fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.578459:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051cfe320/0x7cee4af578416fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.578468:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051cfe320/0x7cee4af578416fc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.578475:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051cfe320/0x7cee4af578416fc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.578487:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002568.578491:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.578496:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.578500:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002568.578937:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f1180/2, rc 0, transno 4294969935 00000100:00100000:3.0:1786002568.578948:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561021952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002568.578956:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969924 gen 2 00000004:00080000:3.0:1786002568.578959:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be4700, transno 4294969905 00000004:00080000:3.0:1786002568.578962:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be4a80, transno 4294969906 00000004:00080000:3.0:1786002568.578965:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f0700, transno 4294969907 00000004:00080000:3.0:1786002568.578967:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245512a00, transno 4294969908 00000004:00080000:3.0:1786002568.578970:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be6d80, transno 4294969909 00000004:00080000:3.0:1786002568.578972:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f2300, transno 4294969910 00000004:00080000:3.0:1786002568.578974:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f534a80, transno 4294969911 00000004:00080000:3.0:1786002568.578977:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed243dd6680, transno 4294969912 00000004:00080000:3.0:1786002568.578979:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f535c00, transno 4294969913 00000004:00080000:3.0:1786002568.578981:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245510380, transno 4294969914 00000004:00080000:3.0:1786002568.578984:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245512680, transno 4294969915 00000004:00080000:3.0:1786002568.578986:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245513b80, transno 4294969916 00000004:00080000:3.0:1786002568.578989:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245512300, transno 4294969917 00000004:00080000:3.0:1786002568.578991:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37136ce00, transno 4294969918 00000004:00080000:3.0:1786002568.578994:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37136e300, transno 4294969919 00000004:00080000:3.0:1786002568.578996:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245513800, transno 4294969920 00000004:00080000:3.0:1786002568.578998:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245510700, transno 4294969921 00000004:00080000:3.0:1786002568.579000:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37136c700, transno 4294969922 00000004:00080000:3.0:1786002568.579002:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be5f80, transno 4294969923 00000004:00080000:3.0:1786002568.579004:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245510000, transno 4294969924 00000100:00100000:3.0:1786002568.579010:0:3645:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ed37f534380 x1872758561020800/t4294969925(4294969925) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786002584 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1786002568.579018:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245513480/2, rc 0, transno 4294969937 00000100:00100000:3.0:1786002568.579022:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561022464:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786002568.579029:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f3800/2, rc 0, transno 4294969933 00000100:00100000:3.0:1786002568.579032:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561022080:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786002568.579039:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245511f80/2, rc 0, transno 4294969934 00000100:00100000:3.0:1786002568.579042:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561022592:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1786002568.579086:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416ee7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.579100:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416ee7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.579107:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc79ec13/0x7cee4af578416ee7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.579121:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.579123:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.579124:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.579128:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.579132:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786002568.580928:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f2d80/2, rc 0, transno 4294969938 00000100:00100000:3.0:1786002568.580936:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561022208:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786002568.580945:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be6300/2, rc 0, transno 4294969939 00000100:00100000:3.0:1786002568.580949:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561022720:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786002568.580956:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2455f0000/2, rc 0, transno 4294969940 00000100:00100000:3.0:1786002568.580959:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561021824:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786002568.580966:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed245511500/2, rc 0, transno 4294969936 00000100:00100000:3.0:1786002568.580969:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561022336:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1786002568.581706:0:9836:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 8 changes, 16 in progress, 0 in flight, 20 done 00000100:00100000:3.0:1786002568.581768:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561024768:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002568.581815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002568.581948:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561024768 00000100:00100000:1.0:1786002568.581954:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561024768 00000100:00100000:1.0:1786002568.581986:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5336 00000100:00100000:1.0:1786002568.581993:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3646:x1872758561024768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786002568.582013:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2551 count 1 00002000:00010000:1.0:1786002568.582035:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.582041:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fbd3869/0x7cee4af578416fce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.582054:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f7:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.582059:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.582074:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fbd3869/0x7cee4af578416fce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.582087:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fbd3869/0x7cee4af578416fce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.582096:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fbd3869/0x7cee4af578416fce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.582103:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fbd3869/0x7cee4af578416fce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.582117:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786002568.584646:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3646:x1872758561024768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2648us (2825us total) trans 4294969941 rc 0/0 00000100:00100000:1.0:1786002568.584657:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5336 00010000:00010000:1.0:1786002568.584722:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002568.584728:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fbd3869/0x7cee4af578416fce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.584740:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556be00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.584744:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fbd3869/0x7cee4af578416fce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.584754:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fbd3869/0x7cee4af578416fce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.584770:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fbd3869/0x7cee4af578416fce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.584827:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fbd3869/0x7cee4af578416fce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.584859:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.584861:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.584863:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002568.586010:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561024896:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786002568.586054:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002568.586096:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561024896 00000100:00100000:1.0:1786002568.586102:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561024896 00000100:00100000:1.0:1786002568.586132:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5337 00000100:00100000:1.0:1786002568.586138:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3647:x1872758561024896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786002568.586158:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2552 count 1 00002000:00010000:1.0:1786002568.586179:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.586185:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c4ee386/0x7cee4af578416fd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.586197:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f8:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.586200:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.586206:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c4ee386/0x7cee4af578416fd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.586217:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c4ee386/0x7cee4af578416fd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.586231:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c4ee386/0x7cee4af578416fd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.586239:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c4ee386/0x7cee4af578416fd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.586251:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786002568.586352:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3647:x1872758561024896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 214us (297us total) trans 4294969942 rc 0/0 00000100:00100000:1.0:1786002568.586359:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5337 00000004:00080000:1.0:1786002568.586389:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be4a80/2, rc 0, transno 4294969942 00000100:00100000:1.0:1786002568.586394:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561024896:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1786002568.586403:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002568.586408:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c4ee386/0x7cee4af578416fd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.586416:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.586419:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c4ee386/0x7cee4af578416fd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.586428:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c4ee386/0x7cee4af578416fd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.586439:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c4ee386/0x7cee4af578416fd5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.586460:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c4ee386/0x7cee4af578416fd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.586473:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.586475:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.586477:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786002568.586580:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be4700/2, rc 0, transno 4294969941 00000100:00100000:3.0:1786002568.586585:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561024768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.586909:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561025152:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.586935:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.586957:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561025664:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.586972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.586986:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786002568.586991:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561025024:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.587005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.587016:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561025536:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786002568.587030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002568.587048:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561025152 00000100:00100000:2.0:1786002568.587051:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561025152 00000100:00100000:2.0:1786002568.587071:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561025664 00000100:00100000:2.0:1786002568.587073:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561025664 00000100:00100000:2.0:1786002568.587085:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561025024 00000100:00100000:2.0:1786002568.587087:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561025024 00000100:00100000:2.0:1786002568.587097:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561025536 00000100:00100000:2.0:1786002568.587099:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561025536 00000100:00100000:2.0:1786002568.587111:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5338 00000100:00100000:2.0:1786002568.587116:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3645:x1872758561025152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002568.587127:0:8764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2554 count 1 00002000:00010000:2.0:1786002568.587141:0:8764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002568.587146:0:8764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af578416fdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587155:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fa:0x0].0x0 since=928s v=(0 0) 00010000:00010000:2.0:1786002568.587158:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002568.587162:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af578416fdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587172:0:8764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af578416fdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587180:0:8764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af578416fdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587187:0:8764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af578416fdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587199:0:8764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786002568.587260:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3645:x1872758561025152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 143us (324us total) trans 4294969943 rc 0/0 00000100:00100000:2.0:1786002568.587267:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5338 00000100:00100000:2.0:1786002568.587278:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5339 00000100:00100000:2.0:1786002568.587283:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3645:x1872758561025664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002568.587293:0:8764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2558 count 1 00002000:00010000:2.0:1786002568.587304:0:8764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002568.587309:0:8764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cd7dcdf/0x7cee4af578416fe3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587317:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fe:0x0].0x0 since=928s v=(0 0) 00010000:00010000:2.0:1786002568.587320:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002568.587324:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cd7dcdf/0x7cee4af578416fe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587333:0:8764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cd7dcdf/0x7cee4af578416fe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587346:0:8764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cd7dcdf/0x7cee4af578416fe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587353:0:8764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cd7dcdf/0x7cee4af578416fe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587365:0:8764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1786002568.587412:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3645:x1872758561025664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 128us (438us total) trans 4294969944 rc 0/0 00000100:00100000:2.0:1786002568.587418:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5339 00000100:00100000:2.0:1786002568.587428:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5340 00000100:00100000:2.0:1786002568.587433:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3645:x1872758561025024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002568.587455:0:8764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2553 count 1 00002000:00010000:2.0:1786002568.587466:0:8764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002568.587471:0:8764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416fea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587479:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f9:0x0].0x0 since=928s v=(0 0) 00010000:00010000:2.0:1786002568.587482:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002568.587486:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416fea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587495:0:8764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416fea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.587508:0:8764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416fea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.588115:0:8764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416fea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.588156:0:8764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1786002568.588213:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3645:x1872758561025024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 778us (1205us total) trans 4294969945 rc 0/0 00000100:00100000:2.0:1786002568.588219:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5340 00000100:00100000:2.0:1786002568.588230:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5341 00000100:00100000:2.0:1786002568.588235:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3645:x1872758561025536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002568.588245:0:8764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2557 count 1 00002000:00010000:2.0:1786002568.588256:0:8764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002568.588261:0:8764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416ff1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.588269:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fd:0x0].0x0 since=928s v=(0 0) 00010000:00010000:2.0:1786002568.588272:0:8764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002568.588275:0:8764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416ff1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.588284:0:8764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416ff1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.588297:0:8764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416ff1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002568.588304:0:8764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416ff1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002568.588397:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561025280:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002568.588421:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.588455:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002568.588461:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561025408:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1786002568.588478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002568.588498:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561025280 00000100:00100000:3.0:1786002568.588502:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561025280 00000100:00100000:3.0:1786002568.588530:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561025408 00000100:00100000:3.0:1786002568.588532:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561025408 00000100:00100000:3.0:1786002568.588552:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5342 00000100:00100000:3.0:1786002568.588557:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3646:x1872758561025280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1786002568.588567:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2555 count 1 00002000:00010000:3.0:1786002568.588578:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002568.588583:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af578416ff8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.588590:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fb:0x0].0x0 since=928s v=(0 0) 00010000:00010000:3.0:1786002568.588593:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002568.588597:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af578416ff8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.588612:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af578416ff8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.588619:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af578416ff8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002568.588627:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af578416ff8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.592974:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1786002568.592985:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af578416fdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593002:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.593007:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af578416fdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593022:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af578416fdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593045:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af578416fdc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593053:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af578416fdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593074:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1786002568.593078:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cd7dcdf/0x7cee4af578416fe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593099:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.593103:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cd7dcdf/0x7cee4af578416fe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593111:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cd7dcdf/0x7cee4af578416fe3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593120:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cd7dcdf/0x7cee4af578416fe3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593127:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cd7dcdf/0x7cee4af578416fe3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593137:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786002568.593140:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416fea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593147:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.593150:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416fea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593157:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416fea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593170:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416fea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593178:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af578416fea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593192:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786002568.593195:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416ff1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593201:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.593205:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416ff1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593212:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416ff1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593220:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416ff1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593226:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002568.593229:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af578416ff8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593236:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83c00 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.593239:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af578416ff8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593255:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af578416ff8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593267:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af578416ff8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593274:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.593276:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.593278:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002568.593307:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5343 00000100:00100000:1.0:1786002568.593324:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3646:x1872758561025408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786002568.593362:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2556 count 1 00002000:00010000:1.0:1786002568.593385:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002568.593391:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000286f18ba/0x7cee4af578416fff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593401:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fc:0x0].0x0 since=928s v=(0 0) 00010000:00010000:1.0:1786002568.593405:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002568.593410:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000286f18ba/0x7cee4af578416fff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593421:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000286f18ba/0x7cee4af578416fff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593429:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000286f18ba/0x7cee4af578416fff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593438:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000286f18ba/0x7cee4af578416fff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593469:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786002568.593777:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3646:x1872758561025408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 457us (5296us total) trans 4294969946 rc 0/0 00000100:00100000:1.0:1786002568.593800:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5343 00010000:00010000:1.0:1786002568.593825:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786002568.593829:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000286f18ba/0x7cee4af578416fff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593837:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:1.0:1786002568.593840:0:14667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000286f18ba/0x7cee4af578416fff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593864:0:14667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000286f18ba/0x7cee4af578416fff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593879:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000286f18ba/0x7cee4af578416fff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593887:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000286f18ba/0x7cee4af578416fff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002568.593903:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.593905:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.593907:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002568.594906:0:8764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1786002568.594913:0:8764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa707bcf/0x7cee4af578416ff1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002568.595022:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3645:x1872758561025536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6785us (7989us total) trans 4294969947 rc 0/0 00000100:00100000:2.0:1786002568.595029:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5341 00000004:00080000:2.0:1786002568.595081:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be6d80/2, rc 0, transno 4294969945 00000100:00100000:2.0:1786002568.595086:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561025024:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1786002568.595094:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be7800/2, rc 0, transno 4294969947 00000100:00100000:2.0:1786002568.595097:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561025536:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1786002568.595105:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be5f80/2, rc 0, transno 4294969943 00000100:00100000:2.0:1786002568.595108:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561025152:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1786002568.595114:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be5880/2, rc 0, transno 4294969944 00000100:00100000:2.0:1786002568.595117:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561025664:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1786002568.595134:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002568.595141:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002568.595263:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002568.595347:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786002568.595353:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af578416ff8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002568.595429:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3646:x1872758561025280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6871us (7006us total) trans 4294969948 rc 0/0 00000100:00100000:3.0:1786002568.595435:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5342 00000004:00080000:3.0:1786002568.595486:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be5500/2, rc 0, transno 4294969946 00000100:00100000:3.0:1786002568.595496:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561025408:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1786002568.595504:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed244be5180/2, rc 0, transno 4294969948 00000100:00100000:3.0:1786002568.595506:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561025280:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1786002568.595689:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002569.066899:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561025792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002569.066971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002569.067049:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561025792 00000100:00100000:0.0:1786002569.067057:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561025792 00000100:00100000:0.0:1786002569.067100:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1786002569.067109:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+28:3646:x1872758561025792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786002569.067137:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1786002569.067179:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+28:3646:x1872758561025792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002569.067186:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1786002569.067230:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561025792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002569.068759:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561025920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002569.068795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002569.070186:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561025920 00000100:00100000:3.0:1786002569.070193:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561025920 00000100:00100000:3.0:1786002569.070253:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1786002569.070262:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561025920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786002569.070284:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1786002569.070331:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561025920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002569.070338:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1786002569.070375:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561025920:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1786002569.070874:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786002569.195054:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786002569.467908:0:21968:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786002569.467914:0:21968:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1786002569.467933:0:21968:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1786002569.467939:0:21968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1786002569.552573:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002569.552640:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531008768 00000100:00100000:1.0:1786002569.552649:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531008768 00000100:00100000:1.0:1786002569.552733:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24157 00000100:00100000:1.0:1786002569.552743:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:19565:x1872758531008768:12345-192.168.203.49@tcp:46:lfs.0 00000004:00000080:1.0:1786002569.552795:0:6521:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=424066b3 len=12 karg=ffff9ed34bf07288 uarg=0000000000000000 00000004:00000080:1.0:1786002569.552837:0:6521:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b3 len=12 karg=ffff9ed34bf07288 00000004:00000080:1.0:1786002569.552844:0:6521:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=1, endrec=0 00000040:00080000:1.0:1786002569.552913:0:6521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786002569.552917:0:6521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1786002569.552934:0:6521:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl1 endrec = 0 00000040:00080000:1.0:1786002569.552997:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1786002569.553002:0:6521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1786002569.553007:0:6521:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:1.0:1786002569.553495:0:6521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1786002569.553578:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:19565:x1872758531008768:12345-192.168.203.49@tcp:46:lfs.0 Request processed in 836us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002569.553586:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24157 00000100:00080000:2.0:1786002569.554171:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002569.556635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002569.556675:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002569.556732:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531008896 00000100:00100000:3.0:1786002569.556738:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531008896 00000100:00100000:3.0:1786002569.556790:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 529 00000100:00100000:3.0:1786002569.556799:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531008896:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002569.556869:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531008896:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 70us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002569.556877:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 529 00000100:00100000:2.0:1786002569.557950:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531009024 00000100:00100000:2.0:1786002569.557966:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531009024 00000100:00100000:2.0:1786002569.558017:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 931 00000100:00100000:2.0:1786002569.558026:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2410:x1872758531009024:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002569.558065:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2410:x1872758531009024:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 40us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002569.558072:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 931 00000100:00100000:2.0:1786002569.558262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002569.558343:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002569.558362:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531009280 00000100:00100000:2.0:1786002569.558366:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531009280 00000100:00100000:2.0:1786002569.558390:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531009152 00000100:00100000:2.0:1786002569.558392:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531009152 00000100:00100000:2.0:1786002569.558412:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 503 00000100:00100000:2.0:1786002569.558418:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531009280:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002569.558460:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531009280:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002569.558483:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 503 00000100:00100000:2.0:1786002569.558496:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 504 00000100:00100000:2.0:1786002569.558502:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531009152:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002569.558526:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531009152:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002569.558532:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 504 00000100:00080000:1.0:1786002569.559102:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786002569.559107:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002569.559110:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002569.579152:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002569.579174:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561026048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002569.579235:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002569.579332:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561026048 00000100:00100000:3.0:1786002569.579339:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561026048 00000100:00100000:3.0:1786002569.579387:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4054 00000100:00100000:3.0:1786002569.579397:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561026048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786002569.579428:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:3.0:1786002569.579497:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561026048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002569.579504:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4054 00000100:00100000:3.0:1786002569.579546:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561026048:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1786002570.231394:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002570.604390:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561026176:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.604490:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.605320:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561026688:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.605349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.605375:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561027200:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.605396:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.605415:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561027712:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.605447:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.605471:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1786002570.605477:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561026560:0@lo:400:kworker.0 00000100:00100000:1.0:1786002570.606050:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561026688 00000100:00100000:1.0:1786002570.606057:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561026688 00000100:00100000:1.0:1786002570.606100:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4055 00000100:00100000:1.0:1786002570.606110:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561026688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002570.606160:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561026688:12345-0@lo:400:kworker.0 Request processed in 51us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002570.606167:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4055 00000100:00100000:2.0:1786002570.607019:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.607728:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561027072:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.607755:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.607775:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561027584:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.607794:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.607825:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561026688:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.607879:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561026304:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.607923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.612752:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561026816:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.612805:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.612837:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561027328:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.612875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.612893:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561027840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002570.612917:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.612958:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1786002570.612966:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561026432:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.612989:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.613008:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561026944:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.613028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.613043:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561027456:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.613062:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.613072:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561027968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002570.613090:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002570.613133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561026176 00000100:00100000:2.0:1786002570.613140:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561026176 00000100:00100000:2.0:1786002570.613183:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1786002570.613192:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561026176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.613241:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561026176:12345-0@lo:400:kworker.0 Request processed in 50us (8750us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002570.613248:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1786002570.613279:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561027200 00000100:00100000:2.0:1786002570.613283:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561027200 00000100:00100000:2.0:1786002570.613318:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561027712 00000100:00100000:2.0:1786002570.613321:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561027712 00000100:00100000:2.0:1786002570.613340:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561027072 00000100:00100000:2.0:1786002570.613343:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561027072 00000100:00100000:2.0:1786002570.613360:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561027584 00000100:00100000:2.0:1786002570.613363:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561027584 00000100:00100000:2.0:1786002570.613381:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1786002570.613387:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3645:x1872758561027200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.613420:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3645:x1872758561027200:12345-0@lo:400:kworker.0 Request processed in 33us (8022us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002570.613425:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1786002570.613484:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561026560 00000100:00100000:3.0:1786002570.613489:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561026560 00000100:00100000:3.0:1786002570.613657:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561026304 00000100:00100000:3.0:1786002570.613661:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561026304 00000100:00100000:3.0:1786002570.613676:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561026816 00000100:00100000:3.0:1786002570.613678:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561026816 00000100:00100000:3.0:1786002570.613689:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561027328 00000100:00100000:3.0:1786002570.613691:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561027328 00000100:00100000:3.0:1786002570.613702:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561026944 00000100:00100000:3.0:1786002570.613704:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561026944 00000100:00100000:3.0:1786002570.613714:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561027456 00000100:00100000:3.0:1786002570.613716:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561027456 00000100:00100000:3.0:1786002570.613731:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1786002570.613737:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561026560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002570.613773:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561026560:12345-0@lo:400:kworker.0 Request processed in 36us (6754us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002570.613813:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1786002570.613828:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:3.0:1786002570.613835:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561026304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002570.613890:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561026304:12345-0@lo:400:kworker.0 Request processed in 55us (5965us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002570.613896:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:3.0:1786002570.613909:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:3.0:1786002570.613915:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561026816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002570.613942:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561026816:12345-0@lo:400:kworker.0 Request processed in 28us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002570.613948:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:3.0:1786002570.613959:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1786002570.613965:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561027328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002570.613989:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561027328:12345-0@lo:400:kworker.0 Request processed in 25us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002570.613994:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1786002570.614004:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:3.0:1786002570.614010:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561026944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002570.614034:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561026944:12345-0@lo:400:kworker.0 Request processed in 25us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002570.614040:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:3.0:1786002570.614051:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:3.0:1786002570.614056:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561027456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002570.614083:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561027456:12345-0@lo:400:kworker.0 Request processed in 26us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002570.614088:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1786002570.618463:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1786002570.618486:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3645:x1872758561027712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.618557:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3645:x1872758561027712:12345-0@lo:400:kworker.0 Request processed in 76us (13109us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002570.618565:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1786002570.619159:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1786002570.619168:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561027072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.619203:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561027072:12345-0@lo:400:kworker.0 Request processed in 36us (11446us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002570.619209:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1786002570.619221:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1786002570.619229:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561027584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.619259:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561027584:12345-0@lo:400:kworker.0 Request processed in 30us (11462us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002570.619264:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1786002570.619316:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561027840 00000100:00100000:2.0:1786002570.619323:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561027840 00000100:00100000:2.0:1786002570.619362:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561027968 00000100:00100000:2.0:1786002570.619365:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561027968 00000100:00100000:2.0:1786002570.619379:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1786002570.619386:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3646:x1872758561027840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002570.619405:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00002000:00000024:2.0:1786002570.619406:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1786002570.619414:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561027968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786002570.619425:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1786002570.619466:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561027968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (6374us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002570.619471:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1786002570.619716:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3646:x1872758561027840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 227us (6694us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002570.619723:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1786002570.619745:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561026432 00000100:00100000:2.0:1786002570.619749:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561026432 00000100:00100000:2.0:1786002570.619903:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056 00000100:00100000:2.0:1786002570.619910:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561026432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.619945:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561026432:12345-0@lo:400:kworker.0 Request processed in 35us (6954us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002570.619950:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056 00000100:00080000:2.0:1786002570.619979:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786002570.619984:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786002570.619987:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786002570.619989:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002570.620034:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561026432:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.620048:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561026944:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.620059:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561027456:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.620073:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561027968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002570.620085:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561026304:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.620095:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561026816:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.620105:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561027328:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.620118:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561027840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002570.620173:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561026560:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.620182:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561027072:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.620190:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561027584:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.620199:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561026176:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.620210:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561027200:0@lo:400:kworker.0 00000100:00100000:2.0:1786002570.620219:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561027712:0@lo:400:kworker.0 00000020:00000080:0.0:1786002570.947503:0:22016:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffe8bd0d8e0 00000004:00000080:0.0:1786002570.947520:0:22016:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=424066b2 len=576 karg=ffff9ed37f5a8800 uarg=0000000000000000 00000004:00000080:0.0:1786002570.947566:0:22016:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b2 len=576 karg=ffff9ed37f5a8800 00000004:00000080:0.0:1786002570.947573:0:22016:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=1, endrec=0 00000040:00080000:0.0:1786002570.947637:0:22016:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786002570.947641:0:22016:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1786002570.947661:0:22016:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl1 endrec = 0 00000040:00080000:0.0:1786002570.947703:0:22016:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1786002570.947709:0:22016:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1786002570.947745:0:22016:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:0.0:1786002570.948250:0:22016:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000004:00000080:0.0:1786002570.948274:0:22016:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0001: Purge request: id=1 00000040:00080000:0.0:1786002570.948300:0:22016:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786002570.948303:0:22016:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1786002570.948348:0:22016:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1786002570.948352:0:22016:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1786002570.948369:0:22016:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:0.0:1786002570.948371:0:22016:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0001: changelog off 00000004:00000080:0.0:1786002570.961761:0:22016:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0001: Purge changelog entries for user cl1 record=18446744073709551615 00000040:00080000:1.0:1786002570.962631:0:22016:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1786002570.962725:0:22016:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786002570.962729:0:22016:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1786002570.963413:0:22016:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1786002570.963420:0:22016:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:1.0:1786002571.250791:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002572.138094:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002572.138147:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561028096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786002572.138264:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002572.138534:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561028096 00000100:00100000:1.0:1786002572.138542:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561028096 00000100:00100000:1.0:1786002572.138594:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4057 00000100:00100000:1.0:1786002572.138630:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561028096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786002572.138681:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:1.0:1786002572.138754:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561028096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002572.138787:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4057 00000100:00100000:2.0:1786002572.139006:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561028096:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786002572.281932:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786002572.468977:0:22064:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786002572.468986:0:22064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1786002572.469693:0:22064:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1786002572.469704:0:22064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1786002573.291723:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786002573.882348:0:22112:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786002573.882355:0:22112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1786002573.882375:0:22112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:3.0:1786002573.882382:0:22112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1786002573.982243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002573.986279:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531009408 00000100:00100000:0.0:1786002573.986293:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531009408 00000100:00100000:0.0:1786002573.986356:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24158 00000100:00100000:0.0:1786002573.986367:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:19599:x1872758531009408:12345-192.168.203.49@tcp:46:lfs.0 00000004:00000080:0.0:1786002573.986453:0:10360:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff9ed34bf07a88 uarg=0000000000000000 00000004:00000080:0.0:1786002573.986498:0:10360:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff9ed34bf07a88 00000004:00000080:0.0:1786002573.986504:0:10360:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:0.0:1786002573.986542:0:10360:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786002573.986546:0:10360:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1786002573.986563:0:10360:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 400 00000040:00080000:0.0:1786002573.986621:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:0.0:1786002573.986627:0:10360:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1786002573.986631:0:10360:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:0.0:1786002573.986645:0:10360:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786002573.986647:0:10360:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000100:00080000:3.0:1786002573.993881:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1786002574.013988:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 400 count 1 00000040:00080000:1.0:1786002574.014000:0:10360:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:1.0:1786002574.014121:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:19599:x1872758531009408:12345-192.168.203.49@tcp:46:lfs.0 Request processed in 27750us (31879us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002574.014133:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24158 00000100:00100000:1.0:1786002574.190199:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561028224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002574.190311:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002574.190393:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561028224 00000100:00100000:1.0:1786002574.190400:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561028224 00000100:00100000:1.0:1786002574.191741:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1786002574.191861:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561028224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002574.191892:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002574.192078:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561028224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 235us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002574.192085:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00080000:1.0:1786002574.192109:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002574.192146:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561028224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002574.202726:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561028352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002574.202803:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002574.202888:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561028352 00000100:00100000:0.0:1786002574.202896:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561028352 00000100:00100000:0.0:1786002574.202947:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1786002574.202956:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+28:3646:x1872758561028352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786002574.202977:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1786002574.203031:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+28:3646:x1872758561028352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002574.203038:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1786002574.203082:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561028352:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786002574.203629:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786002574.317643:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002574.680951:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002574.680986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002574.681013:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002574.681037:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002574.681061:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002574.681089:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531010048 00000100:00100000:0.0:1786002574.681096:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531009792 00000100:00100000:3.0:1786002574.681099:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531010048 00000100:00100000:0.0:1786002574.681099:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531009792 00000100:00100000:3.0:1786002574.681144:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531009920 00000100:00100000:3.0:1786002574.681153:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531009920 00000100:00100000:1.0:1786002574.681155:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531009536 00000100:00100000:1.0:1786002574.681158:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531009536 00000100:00100000:1.0:1786002574.681193:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 531 00000100:00100000:1.0:1786002574.681203:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531009536:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002574.681270:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531009536:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 68us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002574.681277:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 531 00000100:00100000:0.0:1786002574.685457:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531009664 00000100:00100000:0.0:1786002574.685468:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531009664 00000100:00100000:0.0:1786002574.685499:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 938 00000100:00100000:0.0:1786002574.685510:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531009792:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002574.685575:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531009792:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 67us (4587us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002574.685582:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 938 00000100:00100000:0.0:1786002574.685599:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 939 00000100:00100000:0.0:1786002574.685606:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2410:x1872758531009664:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002574.685631:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2410:x1872758531009664:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (4593us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002574.685636:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 939 00000100:00100000:3.0:1786002574.690110:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 509 00000100:00100000:3.0:1786002574.690126:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531010048:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002574.690207:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531010048:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 86us (9192us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002574.690216:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 509 00000100:00100000:3.0:1786002574.690237:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 510 00000100:00100000:3.0:1786002574.690245:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531009920:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002574.690273:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531009920:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 30us (9212us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002574.690280:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 510 00000100:00100000:0.0:1786002574.698410:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786002574.698430:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561028480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002574.698493:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002574.698552:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561028480 00000100:00100000:0.0:1786002574.698558:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561028480 00000100:00100000:0.0:1786002574.698606:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4058 00000100:00100000:0.0:1786002574.698615:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561028480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002574.698645:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:0.0:1786002574.698689:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561028480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002574.698700:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4058 00000100:00100000:0.0:1786002574.698744:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561028480:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1786002574.703667:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786002574.703700:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786002574.703703:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1786002574.706734:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969951 is committed 00000001:00080000:3.0:1786002574.713956:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969948 is committed 00000020:00000080:0.0:1786002575.262127:0:22161:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffd959f20b0 00000004:00000080:0.0:1786002575.263229:0:22161:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff9ed37f5aac00 uarg=0000000000000000 00000004:00000080:0.0:1786002575.263291:0:22161:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff9ed37f5aac00 00000004:00000080:0.0:1786002575.263298:0:22161:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=1, endrec=0 00000040:00080000:0.0:1786002575.263362:0:22161:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786002575.263367:0:22161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:0.0:1786002575.263387:0:22161:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl1 endrec = 400 00000040:00080000:0.0:1786002575.263448:0:22161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 2 00000040:00080000:0.0:1786002575.263454:0:22161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1786002575.263485:0:22161:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl1 entries up to 18446744073709551615 00000040:00080000:0.0:1786002575.263516:0:22161:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786002575.263518:0:22161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1786002575.265500:0:22161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 64768 count 1 00000040:00080000:0.0:1786002575.265513:0:22161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:0.0:1786002575.265549:0:22161:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=1 00000040:00080000:0.0:1786002575.265593:0:22161:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786002575.265596:0:22161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1786002575.265652:0:22161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1786002575.265656:0:22161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:0.0:1786002575.265674:0:22161:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:0.0:1786002575.265675:0:22161:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:0.0:1786002575.278321:0:22161:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl1 record=18446744073709551615 00000040:00080000:0.0:1786002575.278434:0:22161:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786002575.278439:0:22161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:0.0:1786002575.281795:0:22161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 64768 count 1 00000040:00080000:0.0:1786002575.281812:0:22161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:0.0:1786002575.282023:0:22161:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786002575.282027:0:22161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1786002575.282722:0:22161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:0.0:1786002575.282729:0:22161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:1.0:1786002575.338247:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002575.722627:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561028736:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.722689:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.722730:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561029248:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.722865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.722883:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561029760:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.722903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.722976:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561030272:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.722999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.723022:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1786002575.723027:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561028608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002575.723046:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.723059:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561029120:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.723077:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.723090:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561029632:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.723106:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.723118:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561030144:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.723134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.723155:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561028864:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.723193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.723209:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561029376:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.723226:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.723238:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561029888:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.723255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.723268:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1786002575.723272:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561028992:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.723289:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.723302:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561029504:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.723318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.723336:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561030016:0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.723351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002575.723377:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561028736 00000100:00100000:1.0:1786002575.723383:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561028736 00000100:00100000:1.0:1786002575.723437:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1786002575.723445:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561028736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.723501:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561028736:12345-0@lo:400:kworker.0 Request processed in 57us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002575.723509:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1786002575.723540:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561029248 00000100:00100000:1.0:1786002575.723544:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561029248 00000100:00100000:1.0:1786002575.723568:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561028992 00000100:00100000:1.0:1786002575.723571:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561028992 00000100:00100000:1.0:1786002575.723587:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059 00000100:00100000:1.0:1786002575.723592:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561029248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002575.723625:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561029248:12345-0@lo:400:kworker.0 Request processed in 32us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.723626:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561029120 00000100:00100000:0.0:1786002575.723630:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561029120 00000100:00100000:1.0:1786002575.723631:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059 00000100:00100000:1.0:1786002575.723644:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4060 00000100:00100000:1.0:1786002575.723649:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561028992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.723651:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561028864 00000100:00100000:0.0:1786002575.723653:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561028864 00000100:00100000:0.0:1786002575.723662:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561029376 00000100:00100000:0.0:1786002575.723664:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561029376 00000100:00100000:1.0:1786002575.723678:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561028992:12345-0@lo:400:kworker.0 Request processed in 28us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002575.723684:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4060 00000100:00100000:0.0:1786002575.723684:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561029888 00000100:00100000:0.0:1786002575.723686:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561029888 00000100:00100000:0.0:1786002575.723697:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561029504 00000100:00100000:1.0:1786002575.723699:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561029760 00000100:00100000:0.0:1786002575.723699:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561029504 00000100:00100000:1.0:1786002575.723701:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561029760 00000100:00100000:0.0:1786002575.723709:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561030016 00000100:00100000:0.0:1786002575.723711:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561030016 00000100:00100000:1.0:1786002575.723720:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561030272 00000100:00100000:1.0:1786002575.723723:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561030272 00000100:00100000:0.0:1786002575.723723:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:0.0:1786002575.723728:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561029120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.723760:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561029120:12345-0@lo:400:kworker.0 Request processed in 31us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.723766:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:0.0:1786002575.723779:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1786002575.723785:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561028864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.723811:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561028864:12345-0@lo:400:kworker.0 Request processed in 26us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.723816:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1786002575.723827:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:0.0:1786002575.723832:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561029376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.723873:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561029376:12345-0@lo:400:kworker.0 Request processed in 41us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.723879:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00100000:0.0:1786002575.723890:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1786002575.723896:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561029888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.723921:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561029888:12345-0@lo:400:kworker.0 Request processed in 25us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.723926:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1786002575.723937:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1786002575.723943:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561029504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.723968:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561029504:12345-0@lo:400:kworker.0 Request processed in 25us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.723973:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1786002575.723984:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:0.0:1786002575.723989:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561030016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.724014:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561030016:12345-0@lo:400:kworker.0 Request processed in 25us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.724020:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:1.0:1786002575.730538:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561029632 00000100:00100000:1.0:1786002575.730551:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561029632 00000100:00100000:0.0:1786002575.737775:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561030144 00000100:00100000:0.0:1786002575.737788:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561030144 00000100:00100000:0.0:1786002575.737864:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1786002575.737874:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561029760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.737956:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561029760:12345-0@lo:400:kworker.0 Request processed in 83us (15050us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.737963:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1786002575.737980:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1786002575.737987:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561030272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.738018:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561030272:12345-0@lo:400:kworker.0 Request processed in 32us (15018us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.738024:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1786002575.738034:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1786002575.738039:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561029632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.738062:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561029632:12345-0@lo:400:kworker.0 Request processed in 23us (14954us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.738066:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1786002575.738075:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1786002575.738080:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561030144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.738100:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561030144:12345-0@lo:400:kworker.0 Request processed in 21us (14965us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.738105:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1786002575.738138:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561028608 00000100:00100000:0.0:1786002575.738153:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561028608 00000100:00100000:0.0:1786002575.738177:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1786002575.738182:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561028608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786002575.738201:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1786002575.738230:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561028608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (15183us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.738236:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1786002575.742839:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561030400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002575.742922:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002575.742976:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561028992:0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.742988:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561029504:0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.742998:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561030016:0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.743010:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561028864:0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.743020:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561029376:0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.743029:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561029888:0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.743079:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969948 gen 2 00000004:00080000:0.0:1786002575.743084:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f534380, transno 4294969925 00000004:00080000:0.0:1786002575.743094:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f537800, transno 4294969926 00000004:00080000:0.0:1786002575.743097:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f534000, transno 4294969927 00000004:00080000:0.0:1786002575.743100:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f2a00, transno 4294969928 00000004:00080000:0.0:1786002575.743102:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f536680, transno 4294969929 00000004:00080000:0.0:1786002575.743105:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed243dd5880, transno 4294969930 00000004:00080000:0.0:1786002575.743108:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f537480, transno 4294969931 00000004:00080000:0.0:1786002575.743110:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f536300, transno 4294969932 00000004:00080000:0.0:1786002575.743113:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f3800, transno 4294969933 00000004:00080000:0.0:1786002575.743115:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245511f80, transno 4294969934 00000004:00080000:0.0:1786002575.743118:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f1180, transno 4294969935 00000004:00080000:0.0:1786002575.743120:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245511500, transno 4294969936 00000004:00080000:0.0:1786002575.743122:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed245513480, transno 4294969937 00000004:00080000:0.0:1786002575.743124:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f2d80, transno 4294969938 00000004:00080000:0.0:1786002575.743126:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be6300, transno 4294969939 00000004:00080000:0.0:1786002575.743128:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2455f0000, transno 4294969940 00000004:00080000:0.0:1786002575.743130:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be4700, transno 4294969941 00000004:00080000:0.0:1786002575.743132:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be4a80, transno 4294969942 00000004:00080000:0.0:1786002575.743134:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be5f80, transno 4294969943 00000004:00080000:0.0:1786002575.743149:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be5880, transno 4294969944 00000004:00080000:0.0:1786002575.743152:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be6d80, transno 4294969945 00000004:00080000:0.0:1786002575.743154:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be5500, transno 4294969946 00000004:00080000:0.0:1786002575.743157:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be7800, transno 4294969947 00000004:00080000:0.0:1786002575.743159:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed244be5180, transno 4294969948 00000100:00100000:0.0:1786002575.743170:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561028608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002575.743182:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561029120:0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.743192:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561029632:0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.743201:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561030144:0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.743209:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561028736:0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.743219:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561029248:0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.743226:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969951 gen 2 00000004:00080000:0.0:1786002575.743230:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc52d80, transno 4294969929 00000004:00080000:0.0:1786002575.743237:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc50700, transno 4294969930 00000004:00080000:0.0:1786002575.743240:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc52680, transno 4294969931 00000004:00080000:0.0:1786002575.743242:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc51180, transno 4294969932 00000004:00080000:0.0:1786002575.743244:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc51500, transno 4294969933 00000004:00080000:0.0:1786002575.743246:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc53480, transno 4294969934 00000004:00080000:0.0:1786002575.743248:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc51c00, transno 4294969935 00000004:00080000:0.0:1786002575.743251:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f3a3480, transno 4294969936 00000004:00080000:0.0:1786002575.743253:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454c3100, transno 4294969937 00000004:00080000:0.0:1786002575.743255:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454c0700, transno 4294969938 00000004:00080000:0.0:1786002575.743257:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f3a3800, transno 4294969939 00000004:00080000:0.0:1786002575.743259:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454c3800, transno 4294969940 00000004:00080000:0.0:1786002575.743261:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454c3480, transno 4294969941 00000004:00080000:0.0:1786002575.743264:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454c1500, transno 4294969942 00000004:00080000:0.0:1786002575.743266:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454c0000, transno 4294969943 00000004:00080000:0.0:1786002575.743268:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f572300, transno 4294969944 00000004:00080000:0.0:1786002575.743270:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f573800, transno 4294969945 00000004:00080000:0.0:1786002575.743273:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454c2680, transno 4294969946 00000004:00080000:0.0:1786002575.743275:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454c1f80, transno 4294969947 00000004:00080000:0.0:1786002575.743277:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f570e00, transno 4294969948 00000004:00080000:0.0:1786002575.743279:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454c0380, transno 4294969949 00000004:00080000:0.0:1786002575.743281:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37f570a80, transno 4294969950 00000004:00080000:0.0:1786002575.743283:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37bc50000, transno 4294969951 00000100:00100000:0.0:1786002575.743286:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561029760:0@lo:400:kworker.0 00000100:00100000:0.0:1786002575.743294:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561030272:0@lo:400:kworker.0 00000004:00080000:0.0:1786002575.743476:0:9836:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 24 done 00000100:00080000:0.0:1786002575.756914:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786002575.756933:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786002575.756936:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002575.758038:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561030400 00000100:00100000:0.0:1786002575.758049:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561030400 00000100:00100000:0.0:1786002575.758111:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1786002575.758122:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561030400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786002575.758147:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67475136 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1786002575.758226:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561030400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (15302us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002575.758233:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1786002575.758286:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561030400:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1786002575.761027:0:8758:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 23 done 00010000:00010000:3.0:1786002576.366002:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786002577.011629:0:22209:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786002577.011637:0:22209:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1786002577.012257:0:22209:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:1.0:1786002577.012268:0:22209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:2.0:1786002577.267477:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786002577.267499:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561030528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002577.267572:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002577.269742:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561030528 00000100:00100000:1.0:1786002577.269751:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561030528 00000100:00100000:1.0:1786002577.269804:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4061 00000100:00100000:1.0:1786002577.269814:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561030528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786002577.269860:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:1.0:1786002577.269942:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561030528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002577.269948:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4061 00000100:00100000:2.0:1786002577.270079:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561030528:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1786002577.386546:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002578.410065:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002579.308130:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002579.308152:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561030656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002579.308216:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002579.308282:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561030656 00000100:00100000:0.0:1786002579.308289:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561030656 00000100:00100000:0.0:1786002579.308339:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1786002579.308348:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561030656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786002579.308383:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1786002579.308426:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561030656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002579.308434:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00080000:0.0:1786002579.308454:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002579.308489:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561030656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786002579.309442:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786002579.309493:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561030784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002579.309530:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002579.309641:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561030784 00000100:00100000:1.0:1786002579.309647:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561030784 00000100:00100000:1.0:1786002579.309692:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1786002579.309700:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561030784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786002579.309713:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002579.309748:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561030784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002579.309755:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00080000:2.0:1786002579.310084:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002579.310113:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561030784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786002579.440153:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002579.818692:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002579.818712:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561030912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002579.818770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002579.818837:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561030912 00000100:00100000:0.0:1786002579.818844:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561030912 00000100:00100000:0.0:1786002579.818905:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4062 00000100:00100000:0.0:1786002579.818914:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561030912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002579.818945:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:0.0:1786002579.818989:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561030912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002579.819006:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4062 00000100:00100000:0.0:1786002579.819049:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561030912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002579.820894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002579.820934:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002579.820955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002579.820972:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002579.820993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002579.821119:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531010432 00000100:00100000:3.0:1786002579.821127:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531010432 00000100:00100000:3.0:1786002579.821181:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531010304 00000100:00100000:3.0:1786002579.821185:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531010304 00000100:00100000:3.0:1786002579.821210:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 946 00000100:00100000:3.0:1786002579.821219:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531010432:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002579.821278:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531010432:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 59us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002579.821286:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 946 00000100:00100000:3.0:1786002579.821303:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 947 00000100:00100000:3.0:1786002579.821311:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2411:x1872758531010304:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002579.821337:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2411:x1872758531010304:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002579.821343:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 947 00000100:00100000:3.0:1786002579.821383:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531010688 00000100:00100000:3.0:1786002579.821387:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531010688 00000100:00100000:3.0:1786002579.821411:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531010560 00000100:00100000:3.0:1786002579.821414:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531010560 00000100:00100000:3.0:1786002579.821434:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 515 00000100:00100000:3.0:1786002579.821440:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531010688:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002579.821465:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531010688:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002579.821470:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 515 00000100:00100000:3.0:1786002579.821482:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 516 00000100:00100000:3.0:1786002579.821488:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531010560:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002579.821510:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531010560:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 22us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002579.821515:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 516 00000100:00080000:2.0:1786002579.821678:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786002579.821683:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786002579.821685:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786002579.821687:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002579.821740:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531010176 00000100:00100000:1.0:1786002579.821745:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531010176 00000100:00100000:1.0:1786002579.821782:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 533 00000100:00100000:1.0:1786002579.821789:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758531010176:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002579.821827:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758531010176:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 38us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002579.821835:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 533 00010000:00010000:0.0:1786002580.459690:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786002580.551798:0:22257:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 61a: mmap() writes don't make sync hang ========================================================================== 03:49:37 (1786002577) 00000100:00100000:0.0:1786002580.741204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002580.749634:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531010944 00000100:00100000:1.0:1786002580.749646:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531010944 00000100:00100000:1.0:1786002580.750130:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24159 00000100:00100000:1.0:1786002580.750141:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:19761:x1872758531010944:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002580.750160:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002580.750163:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786002580.750227:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed244f34800/0x7cee4af57841546f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad22 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002580.750253:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002580.750258:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002580.750280:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417006 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3aff3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002580.750401:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841700d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002580.750414:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841700d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002580.750426:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841700d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002580.750453:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417014 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002580.750461:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417014 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002580.750468:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417014 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002580.751431:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ff:0x0], index 1: 0 00010000:00010000:2.0:1786002580.757747:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af57841701b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.757770:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af57841701b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.757781:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af57841701b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.757820:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841700d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.757827:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841700d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.757833:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841700d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.757839:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841700d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.758912:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002580.758919:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841700d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.758928:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841700d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.758947:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002580.758950:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002580.758954:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841700d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.759023:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841700d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002580.759039:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b846492d reply state 00000000c6070dbf transno 4294984107 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417014 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.759049:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417014 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.759054:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa58cf3a (ffff9ed35363dc00) 00010000:00010000:2.0:1786002580.759056:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002580.759059:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002580.759099:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417006 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aff3 expref: 12 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.759113:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2000/0x7cee4af57841701b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3aff3 expref: 11 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002580.759120:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ab:0x0].0x0 (ffff9ed245735300) 00010000:00010000:2.0:1786002580.759122:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002580.759125:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed2000, rc 0) 00000100:00100000:2.0:1786002580.759245:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:19761:x1872758531010944:12345-192.168.203.49@tcp:101:dd.0 Request processed in 9104us (18047us total) trans 4294984107 rc 0/0 00000100:00100000:2.0:1786002580.759255:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24159 00000100:00100000:3.0:1786002580.778312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002580.778446:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531011072 00000100:00100000:1.0:1786002580.778455:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531011072 00000100:00100000:1.0:1786002580.778515:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5344 00000100:00100000:1.0:1786002580.778535:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:19761:x1872758531011072:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002580.778552:0:14686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002580.778571:0:14686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b40a23c/0x7cee4af578417029 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3affa expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002580.778594:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002580.778615:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ff:0x0].0x0 since=940s v=(0 0) 00010000:00010000:1.0:1786002580.778620:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002580.778630:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b40a23c/0x7cee4af578417029 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3affa expref: 7 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002580.778644:0:14686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b40a23c/0x7cee4af578417029 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3affa expref: 7 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002580.778657:0:14686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b400, rc 0) 00000100:00100000:1.0:1786002580.778708:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:19761:x1872758531011072:12345-192.168.203.49@tcp:101:dd.0 Request processed in 175us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002580.778715:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5344 00000100:00100000:3.0:1786002580.790231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002580.790299:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531011328 00000100:00100000:0.0:1786002580.790307:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531011328 00000100:00100000:0.0:1786002580.790372:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5216 00000100:00100000:0.0:1786002580.790382:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:19761:x1872758531011328:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:3.0:1786002580.800686:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:19761:x1872758531011328:12345-192.168.203.49@tcp:35:dd.0 Request processed in 10294us (10452us total) trans 4294984108 rc 0/0 00000100:00100000:3.0:1786002580.800700:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5216 00000100:00100000:2.0:1786002580.831737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002580.831795:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531011456 00000100:00100000:3.0:1786002580.831806:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531011456 00000100:00100000:3.0:1786002580.831911:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1518 00000100:00100000:3.0:1786002580.831923:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:6189:x1872758531011456:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002580.831937:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:3.0:1786002580.831953:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 2 00002000:00010000:3.0:1786002580.831956:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1786002358 00002000:00010000:3.0:1786002580.831959:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1786002358 00002000:00010000:3.0:1786002580.831961:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1786002358 00002000:00010000:3.0:1786002580.831963:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1786002580.831987:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006da866ee/0x7cee4af5783fe6d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b36497 expref: 7 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002580.832018:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a38a5e98/0x7cee4af5783fe5f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3645f expref: 6 pid: 14687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002580.832029:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002580.832089:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:6189:x1872758531011456:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 168us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002580.832097:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1518 00000100:00100000:1.0:1786002580.839402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002580.839539:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531011584 00000100:00100000:3.0:1786002580.839549:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531011584 00002000:00100000:3.0:1786002580.839596:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9ff:0x0] (0->4095) req@ffff9ed370e02300 x1872758531011584/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:261/0 lens 4584/0 e 0 to 0 dl 1786002591 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002580.839607:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed370e02300 with x1872758531011584 ext(0->4095) 00002000:00010000:3.0:1786002580.839612:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed370e02300 00000100:00100000:3.0:1786002580.839645:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 17 00000100:00100000:3.0:1786002580.839655:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531011584:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002580.840791:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2411:x1872758531011584:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1133us (1392us total) trans 4294969949 rc 0/0 00000100:00100000:3.0:1786002580.840800:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 17 00002000:00100000:3.0:1786002580.840808:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9ff:0x0] (0->4095) req@ffff9ed370e02300 x1872758531011584/t4294969949(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:261/0 lens 4584/448 e 0 to 0 dl 1786002591 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002580.840829:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed370e02300 with x1872758531011584 ext(0->4095) 00002000:00010000:3.0:1786002580.841694:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed370e02300 00000100:00100000:3.0:1786002580.842626:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002580.842646:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561031040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002580.842656:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561031168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002580.844427:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561031552:0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.846182:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002580.846296:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561031424:0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.846328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002580.846342:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561031936:0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.846372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002580.846387:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561032448:0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.846405:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002580.846431:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561031424 00000100:00100000:3.0:1786002580.846437:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561031424 00000100:00100000:3.0:1786002580.846469:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561031936 00000100:00100000:3.0:1786002580.846471:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561031936 00000100:00100000:3.0:1786002580.846490:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561032448 00000100:00100000:3.0:1786002580.846492:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561032448 00000100:00100000:3.0:1786002580.846506:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:3.0:1786002580.846513:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561031424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.846557:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561031424:12345-0@lo:400:kworker.0 Request processed in 44us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002580.846563:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:3.0:1786002580.846577:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:3.0:1786002580.846582:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561031936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.846601:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561031936:12345-0@lo:400:kworker.0 Request processed in 20us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002580.846607:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:3.0:1786002580.846615:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:3.0:1786002580.846620:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561032448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.846637:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561032448:12345-0@lo:400:kworker.0 Request processed in 18us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002580.846642:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:3.0:1786002580.846670:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561031424:0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.846678:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561031936:0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.846684:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561032448:0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.847960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002580.847984:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531011712 00000100:00100000:3.0:1786002580.847989:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531011712 00000100:00100000:3.0:1786002580.848023:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1519 00000100:00100000:3.0:1786002580.848030:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:6659:x1872758531011712:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002580.848040:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:3.0:1786002580.848054:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 35414 00002000:00010000:3.0:1786002580.848057:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1786002104 00002000:00010000:3.0:1786002580.848060:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1786002104 00002000:00010000:3.0:1786002580.848062:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 72 00010000:00010000:3.0:1786002580.848084:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000f4d80d/0x7cee4af578386b6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b1ca0d expref: 9 pid: 8764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002580.848108:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x9ff:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1786002580.848110:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x9ff:0x0] updating lvb mtime from disk: 0 -> 1786002580 00002000:00010000:3.0:1786002580.848112:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x9ff:0x0] updating lvb ctime from disk: 0 -> 1786002580 00002000:00010000:3.0:1786002580.848114:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x9ff:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1786002580.848120:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b40a23c/0x7cee4af578417029 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3affa expref: 8 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002580.848132:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002580.848264:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:6659:x1872758531011712:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 233us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002580.848271:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1519 00000100:00080000:3.0:1786002580.852278:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002580.853452:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002580.853900:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872758561031680:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.853949:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002580.854826:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561032192:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.854872:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002580.854891:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561032704:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.854913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002580.854936:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1786002580.854942:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561031296:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.855034:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002580.855059:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561031808:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.855082:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002580.855098:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561032320:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.855117:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002580.855133:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561032832:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.855152:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002580.855194:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561031040 00000100:00100000:0.0:1786002580.855201:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561031040 00000100:00100000:0.0:1786002580.855247:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561031168 00000100:00100000:0.0:1786002580.855250:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561031168 00000100:00100000:0.0:1786002580.855268:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1786002580.855276:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561031040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786002580.855297:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75912896 pending 28672 free 3923492864 avail 3691970560 00000100:00100000:3.0:1786002580.856638:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1786002580.856650:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561031168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786002580.856665:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75912896 pending 28672 free 3923492864 avail 3691970560 00000100:00100000:3.0:1786002580.856724:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561031168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (3276us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002580.856731:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1786002580.856829:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561031040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (9162us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002580.856838:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1786002580.856874:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561031680 00000100:00100000:0.0:1786002580.856879:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561031680 00000100:00100000:0.0:1786002580.856909:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1786002580.856916:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872758561031680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.856954:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872758561031680:12345-0@lo:400:kworker.0 Request processed in 39us (3004us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002580.857024:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1786002580.857048:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561032192 00000100:00100000:0.0:1786002580.857051:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561032192 00000100:00100000:0.0:1786002580.857126:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561032704 00000100:00100000:0.0:1786002580.857131:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561032704 00000100:00100000:2.0:1786002580.857462:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002580.857496:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561031808 00000100:00100000:2.0:1786002580.857502:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561031808 00000100:00100000:2.0:1786002580.857532:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561031552 00000100:00100000:2.0:1786002580.857535:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561031552 00000100:00100000:2.0:1786002580.857556:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4063 00000100:00100000:2.0:1786002580.857565:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561031808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002580.857606:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561031808:12345-0@lo:400:kworker.0 Request processed in 43us (2522us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002580.857613:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4063 00000100:00100000:2.0:1786002580.857629:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4064 00000100:00100000:2.0:1786002580.857636:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561031552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002580.857668:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561031552:12345-0@lo:400:kworker.0 Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002580.857674:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4064 00000100:00100000:2.0:1786002580.857786:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561031552:0@lo:400:kworker.0 00000100:00100000:2.0:1786002580.858012:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561032064:0@lo:400:kworker.0 00000100:00100000:2.0:1786002580.858045:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002580.858065:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561032576:0@lo:400:kworker.0 00000100:00100000:2.0:1786002580.858086:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002580.862493:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561032320 00000100:00100000:3.0:1786002580.862507:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561032320 00000100:00100000:3.0:1786002580.866210:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561032832 00000100:00100000:3.0:1786002580.866221:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561032832 00000100:00100000:3.0:1786002580.866245:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1786002580.866255:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561032192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.866338:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561032192:12345-0@lo:400:kworker.0 Request processed in 85us (11464us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002580.866356:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1786002580.866381:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1786002580.866388:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561032704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.866417:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561032704:12345-0@lo:400:kworker.0 Request processed in 30us (11504us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002580.866423:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1786002580.866434:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1786002580.866440:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561032320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.866480:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561032320:12345-0@lo:400:kworker.0 Request processed in 40us (11361us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002580.866486:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1786002580.866497:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1786002580.866503:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561032832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002580.866540:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561032832:12345-0@lo:400:kworker.0 Request processed in 37us (11387us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002580.866545:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00080000:3.0:1786002580.868967:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002580.870112:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561031808:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.870128:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561032320:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.870138:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561032832:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.870148:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872758561031680:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.870158:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561032192:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.870169:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561032704:0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.870186:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561031168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002580.870275:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561032064 00000100:00100000:0.0:1786002580.870281:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561032064 00000100:00100000:0.0:1786002580.870326:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561032576 00000100:00100000:0.0:1786002580.870329:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561032576 00000100:00100000:0.0:1786002580.870366:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:0.0:1786002580.870376:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561032064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.870446:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561032064:12345-0@lo:400:kworker.0 Request processed in 72us (12399us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002580.870452:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:0.0:1786002580.873473:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1786002580.873488:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561032576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002580.873653:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561032576:12345-0@lo:400:kworker.0 Request processed in 169us (15564us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002580.873660:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00080000:0.0:1786002580.873717:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002580.873769:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561031040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002580.874047:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561031296 00000100:00100000:2.0:1786002580.874055:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561031296 00000100:00100000:2.0:1786002580.874088:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1786002580.874094:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561031296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002580.874135:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561031296:12345-0@lo:400:kworker.0 Request processed in 41us (19100us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002580.874141:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1786002580.874812:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561031296:0@lo:400:kworker.0 00000100:00100000:2.0:1786002580.875142:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561032064:0@lo:400:kworker.0 00000100:00100000:2.0:1786002580.876008:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561032576:0@lo:400:kworker.0 00000100:00100000:2.0:1786002581.001318:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002581.001784:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531011840 00000100:00100000:0.0:1786002581.001794:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531011840 00000100:00100000:0.0:1786002581.001955:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24160 00000100:00100000:0.0:1786002581.001976:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:19774:x1872758531011840:12345-192.168.203.49@tcp:101:multiop.0 00010000:00010000:0.0:1786002581.001999:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002581.002019:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b001 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002581.002080:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417037 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002581.002098:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417037 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002581.002111:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417037 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002581.002153:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:0.0:1786002581.002156:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786002581.002187:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417037 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002581.002209:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b001 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002581.002225:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417037 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b001 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002581.002233:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002581.002235:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786002581.002239:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245716e00, rc 0) 00000100:00100000:0.0:1786002581.002294:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:19774:x1872758531011840:12345-192.168.203.49@tcp:101:multiop.0 Request processed in 321us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002581.002302:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24160 00000100:00080000:3.0:1786002581.011106:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786002581.012667:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002581.012879:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531012096 00000100:00100000:2.0:1786002581.012889:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531012096 00000100:00100000:2.0:1786002581.012945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24161 00000100:00100000:2.0:1786002581.012962:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:19774:x1872758531012096:12345-192.168.203.49@tcp:101:multiop.0 00010000:00010000:2.0:1786002581.012982:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002581.012984:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786002581.013007:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417037 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b001 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002581.013025:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002581.013029:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002581.013040:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af57841703e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b008 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002581.013130:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578417045 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002581.013143:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578417045 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002581.013156:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578417045 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002581.013165:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ab:0x0]: returning size 4096 00010000:00010000:2.0:1786002581.013261:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af57841703e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b008 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002581.013274:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578417045 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b008 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002581.013281:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ab:0x0].0x0 (ffff9ed245735300) 00010000:00010000:2.0:1786002581.013283:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002581.013285:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3c00, rc 0) 00000100:00100000:2.0:1786002581.013347:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:19774:x1872758531012096:12345-192.168.203.49@tcp:101:multiop.0 Request processed in 393us (686us total) trans 4294984109 rc 0/0 00000100:00100000:2.0:1786002581.013354:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24161 00000100:00100000:2.0:1786002581.021871:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002581.021966:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002581.022017:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531012352 00000100:00100000:3.0:1786002581.022026:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531012352 00000100:00100000:3.0:1786002581.022090:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5345 00000100:00100000:3.0:1786002581.022100:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531012352:12345-192.168.203.49@tcp:101:multiop.0 00010000:00010000:3.0:1786002581.022119:0:14691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1786002581.022128:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531012224 00000100:00100000:1.0:1786002581.022134:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531012224 00010000:00010000:3.0:1786002581.022137:0:14691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc5c8e86/0x7cee4af578417053 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b00f expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002581.022161:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9ff:0x0] initial LVB size: 4096, mtime: 0x6a743c94, atime: 0x0, ctime: 0x6a743c94, blocks: 0x8 00000100:00100000:1.0:1786002581.022177:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1520 00010000:00010000:3.0:1786002581.022180:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ff:0x0].0x0 since=941s v=(0 0) 00010000:00010000:3.0:1786002581.022185:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ff:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1786002581.022190:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2410:x1872758531012224:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002581.022198:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc5c8e86/0x7cee4af578417053 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b00f expref: 8 pid: 14691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002581.022203:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002581.022218:0:14691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc5c8e86/0x7cee4af578417053 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b00f expref: 8 pid: 14691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002581.022228:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af578417045 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b008 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002581.022233:0:14691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82e00, rc 0) 00010000:00010000:1.0:1786002581.022248:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ab:0x0].0x0 (ffff9ed245735300) 00010000:00010000:1.0:1786002581.022254:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002581.022297:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758531012352:12345-192.168.203.49@tcp:101:multiop.0 Request processed in 197us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002581.022305:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5345 00000100:00080000:2.0:1786002581.022374:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002581.027448:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2410:x1872758531012224:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 5251us (5598us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002581.027473:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1520 00000100:00100000:1.0:1786002581.041701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002581.041789:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531012480 00000100:00100000:3.0:1786002581.041799:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531012480 00000100:00100000:3.0:1786002581.041946:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5346 00000100:00100000:3.0:1786002581.041957:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:19774:x1872758531012480:12345-192.168.203.49@tcp:101:multiop.0 00010000:00010000:3.0:1786002581.041973:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002581.041990:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af57841705a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b016 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002581.042018:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc5c8e86/0x7cee4af578417053 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b00f expref: 9 pid: 14691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002581.042026:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002581.042030:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002581.042035:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af57841705a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b016 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002581.042067:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc5c8e86/0x7cee4af578417053 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b00f expref: 9 pid: 14691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002581.042081:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc5c8e86/0x7cee4af578417053 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b00f expref: 9 pid: 14691 timeout: 1041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002581.042096:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1872758561032960:192.168.203.49@tcp:104: 00000100:00100000:3.0:1786002581.042192:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e46540 going to sleep for 11 seconds 00000100:00100000:0.0:1786002581.046110:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1872758561032960:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002581.046142:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af57841705a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b016 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002581.046159:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83c00, rc 0) 00000100:00100000:0.0:1786002581.047806:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:19774:x1872758531012480:12345-192.168.203.49@tcp:101:multiop.0 Request processed in 5842us (6104us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002581.047818:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5346 00000100:00100000:2.0:1786002581.048015:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002581.048133:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531012608 00000100:00100000:3.0:1786002581.048141:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531012608 00010000:00010000:3.0:1786002581.048314:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc5c8e86/0x7cee4af578417053 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b00f expref: 9 pid: 14691 timeout: 1041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002581.048404:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1698 00000100:00100000:3.0:1786002581.048415:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758531012608:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002581.048429:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002581.048448:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc5c8e86/0x7cee4af578417053 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b00f expref: 9 pid: 14691 timeout: 1041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002581.048480:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc5c8e86/0x7cee4af578417053 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b00f expref: 9 pid: 14691 timeout: 1041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002581.048502:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc5c8e86/0x7cee4af578417053 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b00f expref: 9 pid: 14691 timeout: 1041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002581.048516:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002581.048521:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002581.048529:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af57841705a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b016 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002581.048540:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af57841705a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b016 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002581.048571:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006cec4d78/0x7cee4af57841705a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b016 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002581.048584:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6505:1872758561033088:192.168.203.49@tcp:105: 00000100:00100000:3.0:1786002581.048649:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e46780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002581.052196:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6505:1872758561033088:192.168.203.49@tcp:105: 00010000:00010000:3.0:1786002581.052228:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002581.052278:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758531012608:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 3864us (4263us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002581.052288:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1698 00000100:00100000:1.0:1786002581.056044:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002581.056174:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531012736 00000100:00100000:0.0:1786002581.056183:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531012736 00002000:00100000:0.0:1786002581.056228:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9ff:0x0] (0->4095) req@ffff9ed370e00e00 x1872758531012736/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:262/0 lens 488/0 e 0 to 0 dl 1786002592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002581.056238:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed370e00e00 with x1872758531012736 ext(0->4095) 00002000:00010000:0.0:1786002581.056243:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed370e00e00 00000100:00100000:0.0:1786002581.056274:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 18 00000100:00100000:0.0:1786002581.056283:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2411:x1872758531012736:12345-192.168.203.49@tcp:3:dd.0 00000100:00100000:0.0:1786002581.056497:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2411:x1872758531012736:12345-192.168.203.49@tcp:3:dd.0 Request processed in 214us (460us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786002581.056505:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 18 00002000:00100000:0.0:1786002581.056511:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x9ff:0x0] (0->4095) req@ffff9ed370e00e00 x1872758531012736/t0(0) o3->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:262/0 lens 488/4536 e 0 to 0 dl 1786002592 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002581.056520:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed370e00e00 with x1872758531012736 ext(0->4095) 00002000:00010000:0.0:1786002581.056523:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed370e00e00 00000100:00100000:1.0:1786002581.065350:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002581.065644:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531012992 00000100:00100000:0.0:1786002581.065654:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531012992 00000100:00100000:0.0:1786002581.065710:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5217 00000100:00100000:0.0:1786002581.065720:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:19774:x1872758531012992:12345-192.168.203.49@tcp:35:multiop.0 00000001:00080000:0.0:1786002581.066128:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984110 00000100:00100000:0.0:1786002581.066227:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:19774:x1872758531012992:12345-192.168.203.49@tcp:35:multiop.0 Request processed in 507us (883us total) trans 4294984111 rc 0/0 00000100:00100000:0.0:1786002581.066239:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5217 00000020:00080000:0.0:1786002581.066244:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002581.096340:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002581.096440:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531013120 00000100:00100000:3.0:1786002581.096450:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531013120 00002000:00100000:3.0:1786002581.096498:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9ff:0x0] (0->4095) req@ffff9ed370e01500 x1872758531013120/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:262/0 lens 4584/0 e 0 to 0 dl 1786002592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002581.096509:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed370e01500 with x1872758531013120 ext(0->4095) 00002000:00010000:3.0:1786002581.096516:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed370e01500 00000100:00100000:3.0:1786002581.096548:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 19 00000100:00100000:3.0:1786002581.096559:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758531013120:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002581.099422:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2413:x1872758531013120:12345-192.168.203.49@tcp:4:dd.0 Request processed in 2860us (3085us total) trans 4294969950 rc 0/0 00000100:00100000:3.0:1786002581.099433:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 19 00002000:00100000:3.0:1786002581.099443:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x9ff:0x0] (0->4095) req@ffff9ed370e01500 x1872758531013120/t4294969950(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:262/0 lens 4584/448 e 0 to 0 dl 1786002592 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002581.099453:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed370e01500 with x1872758531013120 ext(0->4095) 00002000:00010000:3.0:1786002581.099459:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed370e01500 00010000:00010000:1.0:1786002581.482013:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002582.381725:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786002582.381747:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561033216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002582.381812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002582.382004:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561033216 00000100:00100000:1.0:1786002582.382012:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561033216 00000100:00100000:1.0:1786002582.382054:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4065 00000100:00100000:1.0:1786002582.382063:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561033216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786002582.382094:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:1.0:1786002582.382136:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561033216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002582.382143:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4065 00000100:00100000:1.0:1786002582.382184:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561033216:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786002582.506057:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002583.530052:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002584.426067:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786002584.426087:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561033344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002584.426152:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002584.426259:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561033344 00000100:00100000:1.0:1786002584.426266:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561033344 00000100:00100000:1.0:1786002584.426325:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1786002584.426344:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561033344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002584.426372:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002584.426420:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561033344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002584.426427:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1786002584.426488:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561033344:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1786002584.426658:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002584.427063:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002584.427073:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561033472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002584.427104:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002584.430824:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561033472 00000100:00100000:1.0:1786002584.430834:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561033472 00000100:00100000:1.0:1786002584.430913:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1786002584.430923:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561033472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786002584.430945:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002584.431018:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561033472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (3912us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002584.431025:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1786002584.431074:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561033472:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786002584.432662:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786002584.554054:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002584.940969:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786002584.940988:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561033600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002584.941052:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002584.941107:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561033600 00000100:00100000:0.0:1786002584.941113:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561033600 00000100:00100000:0.0:1786002584.941153:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4066 00000100:00100000:0.0:1786002584.941161:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561033600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002584.941189:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:0.0:1786002584.941227:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561033600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002584.941234:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4066 00000100:00100000:0.0:1786002584.941277:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561033600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002584.948631:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002584.948673:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002584.948697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002584.948717:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002584.948753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002584.948781:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531013504 00000100:00100000:1.0:1786002584.948790:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531013504 00000100:00100000:1.0:1786002584.948862:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 954 00000100:00100000:1.0:1786002584.948875:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531013504:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002584.948944:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531013504:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 73us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002584.948952:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 954 00000100:00100000:1.0:1786002584.948968:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531013376 00000100:00100000:1.0:1786002584.948971:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531013376 00000100:00100000:1.0:1786002584.948993:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 955 00000100:00100000:1.0:1786002584.948999:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531013376:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002584.949024:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531013376:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002584.949030:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 955 00000100:00100000:1.0:1786002584.949045:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531013760 00000100:00100000:1.0:1786002584.949048:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531013760 00000100:00100000:1.0:1786002584.949068:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531013632 00000100:00100000:1.0:1786002584.949071:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531013632 00000100:00100000:1.0:1786002584.949090:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 521 00000100:00100000:1.0:1786002584.949095:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2413:x1872758531013760:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002584.949116:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2413:x1872758531013760:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 21us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002584.949122:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 521 00000100:00100000:1.0:1786002584.949131:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 522 00000100:00100000:1.0:1786002584.949136:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:2413:x1872758531013632:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002584.949154:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:2413:x1872758531013632:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 17us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002584.949159:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 522 00000100:00080000:1.0:1786002584.949176:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786002584.949179:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002584.949182:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786002584.949184:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002584.949375:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531013248 00000100:00100000:0.0:1786002584.949379:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531013248 00000100:00100000:0.0:1786002584.949407:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 535 00000100:00100000:0.0:1786002584.949414:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531013248:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002584.949444:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531013248:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 31us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002584.949450:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 535 00010000:00010000:1.0:1786002585.578373:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002585.962250:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561033856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002585.962373:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002585.962436:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561033856 00000100:00100000:1.0:1786002585.962444:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561033856 00000100:00100000:3.0:1786002585.962467:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786002585.962479:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561033728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002585.962496:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1786002585.962502:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002585.962506:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561033856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786002585.962532:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84350656 pending 57344 free 3923488768 avail 3691966464 00000100:00100000:3.0:1786002585.962547:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561033728 00000100:00100000:3.0:1786002585.962550:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561033728 00000100:00100000:3.0:1786002585.962572:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1786002585.962576:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561033856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002585.962578:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561033728:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002585.962583:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00002000:00000024:3.0:1786002585.962588:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84350656 pending 57344 free 3923488768 avail 3691966464 00000100:00100000:3.0:1786002585.962613:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561033728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002585.962620:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1786002585.962659:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561033728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786002585.962671:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561033856:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786002585.962724:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002585.963708:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561034368:0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.963741:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002585.963761:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561034880:0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.963793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002585.963810:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1786002585.963816:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561034240:0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.963839:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002585.963875:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561034752:0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.963895:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002585.963907:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24322fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561035264:0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.963923:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002585.963945:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561034368 00000100:00100000:3.0:1786002585.963949:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561034368 00000100:00100000:3.0:1786002585.963975:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561034752 00000100:00100000:3.0:1786002585.963977:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561034752 00000100:00100000:3.0:1786002585.963992:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561035264 00000100:00100000:3.0:1786002585.963994:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561035264 00000100:00100000:3.0:1786002585.964008:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:3.0:1786002585.964014:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561034368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.964047:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561034368:12345-0@lo:400:kworker.0 Request processed in 33us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002585.964056:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:3.0:1786002585.964075:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:3.0:1786002585.964081:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561034752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.964104:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561034752:12345-0@lo:400:kworker.0 Request processed in 23us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002585.964110:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:3.0:1786002585.964120:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1786002585.964126:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561035264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.964150:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561035264:12345-0@lo:400:kworker.0 Request processed in 25us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002585.964155:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1786002585.964194:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561034752:0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.964212:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24322fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561035264:0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.964221:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561034368:0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964299:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561033984:0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964342:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002585.964371:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561034496:0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964391:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002585.964405:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561035008:0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964424:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002585.964439:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1786002585.964444:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561034112:0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964462:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002585.964475:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561034624:0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964490:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002585.964498:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561035136:0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002585.964530:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561034240 00000100:00100000:1.0:1786002585.964533:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561034240 00000100:00100000:1.0:1786002585.964553:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561034496 00000100:00100000:1.0:1786002585.964556:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561034496 00000100:00100000:1.0:1786002585.964569:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4067 00000100:00100000:1.0:1786002585.964575:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561034240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964606:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561034240:12345-0@lo:400:kworker.0 Request processed in 31us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002585.964612:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4067 00000100:00100000:1.0:1786002585.964623:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4068 00000100:00100000:1.0:1786002585.964629:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561034496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964659:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561034496:12345-0@lo:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002585.964667:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4068 00000100:00100000:1.0:1786002585.964682:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561034112 00000100:00100000:1.0:1786002585.964686:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561034112 00000100:00100000:1.0:1786002585.964701:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561034624 00000100:00100000:1.0:1786002585.964703:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561034624 00000100:00100000:1.0:1786002585.964714:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561035136 00000100:00100000:1.0:1786002585.964717:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561035136 00000100:00100000:1.0:1786002585.964730:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1786002585.964735:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561034112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964765:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561034112:12345-0@lo:400:kworker.0 Request processed in 29us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002585.964771:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1786002585.964782:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1786002585.964787:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561034624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964812:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561034624:12345-0@lo:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002585.964817:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1786002585.964827:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1786002585.964833:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561035136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964886:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561035136:12345-0@lo:400:kworker.0 Request processed in 52us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002585.964892:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1786002585.964928:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561034112:0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964937:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561034624:0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964945:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561035136:0@lo:400:kworker.0 00000100:00100000:1.0:1786002585.964954:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561034496:0@lo:400:kworker.0 00000100:00100000:0.0:1786002585.965140:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561034880 00000100:00100000:0.0:1786002585.965144:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561034880 00000100:00100000:0.0:1786002585.965190:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561035008 00000100:00100000:0.0:1786002585.965199:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561035008 00000100:00100000:0.0:1786002585.965219:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1786002585.965226:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561034880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002585.965257:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561034880:12345-0@lo:400:kworker.0 Request processed in 32us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002585.965262:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1786002585.965287:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1786002585.965295:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561035008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002585.965332:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561035008:12345-0@lo:400:kworker.0 Request processed in 30us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002585.965338:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00080000:0.0:1786002585.965359:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786002585.965362:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002585.965377:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561035008:0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.965707:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561033984 00000100:00100000:3.0:1786002585.965712:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561033984 00000100:00100000:3.0:1786002585.965745:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:3.0:1786002585.965752:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561033984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.965786:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561033984:12345-0@lo:400:kworker.0 Request processed in 35us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002585.965792:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:3.0:1786002585.965828:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561034240:0@lo:400:kworker.0 00000100:00100000:3.0:1786002585.965837:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561034880:0@lo:400:kworker.0 00000100:00100000:0.0:1786002585.966041:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561033984:0@lo:400:kworker.0 00010000:00010000:0.0:1786002586.603220:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786002586.988288:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984111 is committed 00010000:00010000:3.0:1786002586.988749:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417014 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002586.988763:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417014 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002586.988781:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417014 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002586.988788:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002586.988793:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417014 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002586.988800:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417014 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002586.988818:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa58cf3a (ffff9ed35363dc00) 00010000:00010000:3.0:1786002586.988821:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002586.988826:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417014 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002586.988831:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417014 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfa58cf3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002586.990535:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969950 is committed 00000100:00100000:1.0:1786002587.497969:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786002587.497990:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561035392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002587.498056:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002587.498115:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561035392 00000100:00100000:1.0:1786002587.498122:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561035392 00000100:00100000:1.0:1786002587.498175:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4069 00000100:00100000:1.0:1786002587.498183:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561035392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786002587.498213:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:1.0:1786002587.498267:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561035392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002587.498275:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4069 00000100:00100000:1.0:1786002587.498330:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561035392:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786002587.631464:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002588.650316:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002589.550524:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786002589.550554:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561035520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786002589.550620:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002589.550681:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561035520 00000100:00100000:3.0:1786002589.550688:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561035520 00000100:00100000:3.0:1786002589.550737:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1786002589.550747:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561035520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786002589.550774:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1786002589.550813:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561035520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002589.550819:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1786002589.550892:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561035520:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1786002589.552158:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002589.557628:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786002589.557651:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561035648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002589.557716:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002589.557831:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561035648 00000100:00100000:0.0:1786002589.557837:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561035648 00000100:00100000:0.0:1786002589.557909:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1786002589.557918:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561035648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786002589.557939:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1786002589.557980:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561035648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002589.557986:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1786002589.558030:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561035648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786002589.558614:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786002589.678777:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786002589.885190:0:22455:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 61b: mmap() of unstriped file is successful ========================================================== 03:49:47 (1786002587) 00000100:00100000:3.0:1786002589.976964:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002589.976996:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531013888 00000100:00100000:3.0:1786002589.977005:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531013888 00000100:00100000:3.0:1786002589.977061:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24162 00000100:00100000:3.0:1786002589.977070:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:20350:x1872758531013888:12345-192.168.203.49@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1786002589.977088:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002589.977107:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417061 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b01d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002589.977165:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417068 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002589.977178:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417068 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002589.977192:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417068 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002589.977234:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:3.0:1786002589.977237:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786002589.977270:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417068 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002589.977310:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417061 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b01d expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002589.977326:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417068 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b01d expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002589.977334:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002589.977337:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786002589.977341:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82600, rc 0) 00000100:00100000:3.0:1786002589.980236:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:20350:x1872758531013888:12345-192.168.203.49@tcp:101:mmap_mknod_test.0 Request processed in 3160us (3274us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002589.980247:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24162 00000100:00080000:3.0:1786002589.980276:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002590.001978:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002590.008552:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531014144 00000100:00100000:3.0:1786002590.008564:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531014144 00000100:00100000:3.0:1786002590.009122:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24163 00000100:00100000:3.0:1786002590.009137:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:20350:x1872758531014144:12345-192.168.203.49@tcp:36:mmap_mknod_test.0 00010000:00010000:3.0:1786002590.009188:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002590.009211:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417068 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b01d expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.009228:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002590.009233:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002590.009293:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841706f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.009317:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841706f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.009328:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841706f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.009430:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578417076 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x99d161db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.009440:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578417076 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.009448:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578417076 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.010332:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841706f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.010341:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841706f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.010347:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841706f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.010353:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841706f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.010359:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002590.010362:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841706f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.012440:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841706f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.012463:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002590.012466:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002590.012472:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841706f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.012480:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af57841706f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002590.012496:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008771aabe reply state 000000000eaad7d1 transno 4294984112 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578417076 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.012508:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578417076 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.012515:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99d161db (ffff9ed2456f9a00) 00010000:00010000:3.0:1786002590.012517:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002590.012520:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002590.012623:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:20350:x1872758531014144:12345-192.168.203.49@tcp:36:mmap_mknod_test.0 Request processed in 3487us (10648us total) trans 4294984112 rc 0/0 00000100:00100000:3.0:1786002590.012894:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24163 00000100:00100000:3.0:1786002590.026965:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002590.027003:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531014272 00000100:00100000:3.0:1786002590.027012:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531014272 00000100:00100000:3.0:1786002590.027062:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24164 00000100:00100000:3.0:1786002590.027072:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:20350:x1872758531014272:12345-192.168.203.49@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1786002590.027094:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002590.027115:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841707d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b024 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.027176:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417084 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.027194:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.027204:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002590.027245:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:3.0:1786002590.027250:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786002590.027269:0:10360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.027291:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af57841707d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b024 expref: 14 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.027317:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b024 expref: 13 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.027325:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002590.027328:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786002590.027331:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82400, rc 0) 00000100:00100000:3.0:1786002590.027383:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:20350:x1872758531014272:12345-192.168.203.49@tcp:101:mmap_mknod_test.0 Request processed in 313us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002590.027390:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24164 00000100:00100000:3.0:1786002590.042511:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002590.042662:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531014400 00000100:00100000:0.0:1786002590.042672:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531014400 00000100:00100000:0.0:1786002590.042732:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 537 00000100:00100000:0.0:1786002590.042741:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758531014400:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002590.042808:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758531014400:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 67us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002590.042816:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 537 00000100:00100000:3.0:1786002590.043058:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002590.043093:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002590.043116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002590.043138:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002590.043198:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531014528 00000100:00100000:3.0:1786002590.043203:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531014528 00000100:00100000:3.0:1786002590.043242:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531014912 00000100:00100000:3.0:1786002590.043247:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531014912 00000100:00100000:3.0:1786002590.043267:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 962 00000100:00100000:3.0:1786002590.043274:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531014528:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002590.043323:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531014528:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002590.043329:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 962 00000100:00100000:3.0:1786002590.043345:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24165 00000100:00100000:3.0:1786002590.043351:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:20350:x1872758531014912:12345-192.168.203.49@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1786002590.043362:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002590.043437:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841708b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b02b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043494:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417092 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043507:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043517:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043527:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417099 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043534:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043675:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043799:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af5784170a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043808:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af5784170a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043816:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af5784170a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002590.043878:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ac:0x0]: returning size 0 00000004:00200000:3.0:1786002590.043882:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786002590.043900:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af5784170a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043911:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af5784170a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043920:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417092 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043927:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417092 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043933:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417092 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043939:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417092 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043949:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002590.043953:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417092 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043961:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417092 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043972:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002590.043975:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002590.043979:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417092 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043986:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af578417092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.043998:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.044004:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417099 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.044009:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.044014:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002590.044017:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.044022:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417099 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.044033:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99d161db (ffff9ed2456f9a00) 00010000:00010000:3.0:1786002590.044035:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002590.044038:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417099 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.044044:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af578417099 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.044067:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af57841708b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b02b expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.044078:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af5784170a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b02b expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.044086:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ac:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:3.0:1786002590.044088:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002590.044090:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83000, rc 0) 00000100:00100000:3.0:1786002590.044115:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:20350:x1872758531014912:12345-192.168.203.49@tcp:101:mmap_mknod_test.0 Request processed in 764us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002590.044122:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24165 00000100:00100000:3.0:1786002590.044145:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531014656 00000100:00100000:3.0:1786002590.044149:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531014656 00000100:00100000:3.0:1786002590.044173:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531014784 00000100:00100000:3.0:1786002590.044176:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531014784 00000100:00100000:3.0:1786002590.044197:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 525 00000100:00100000:3.0:1786002590.044203:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:2412:x1872758531014656:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002590.044230:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:2412:x1872758531014656:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 27us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002590.044237:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 525 00000100:00100000:3.0:1786002590.044249:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 526 00000100:00100000:3.0:1786002590.044255:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531014784:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002590.044274:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531014784:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 20us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002590.044280:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 526 00000100:00080000:3.0:1786002590.044316:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786002590.044320:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786002590.044322:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002590.059836:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002590.062509:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531015040 00000100:00100000:3.0:1786002590.062519:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531015040 00000100:00100000:0.0:1786002590.063111:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561035776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002590.063172:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002590.063234:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561035776 00000100:00100000:0.0:1786002590.063238:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561035776 00000100:00100000:0.0:1786002590.063268:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4070 00000100:00100000:0.0:1786002590.063276:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561035776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002590.063321:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:0.0:1786002590.063365:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561035776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002590.063385:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4070 00000100:00100000:0.0:1786002590.063432:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561035776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786002590.063588:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24166 00000100:00100000:3.0:1786002590.063598:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:20350:x1872758531015040:12345-192.168.203.49@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1786002590.063609:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002590.063637:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784170a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b032 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.063671:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784170ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.063692:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784170ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.063704:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784170ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.063796:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784170a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b032 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.063812:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784170ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b032 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.063821:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ac:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:3.0:1786002590.063823:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786002590.063827:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82800, rc 0) 00000100:00100000:3.0:1786002590.063890:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20350:x1872758531015040:12345-192.168.203.49@tcp:101:mmap_mknod_test.0 Request processed in 293us (4059us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002590.063896:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24166 00000100:00100000:0.0:1786002590.074454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002590.074496:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531015296 00000100:00100000:0.0:1786002590.074505:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531015296 00000100:00100000:0.0:1786002590.074566:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24167 00000100:00100000:0.0:1786002590.074577:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20350:x1872758531015296:12345-192.168.203.49@tcp:36:mmap_mknod_test.0 00010000:00010000:0.0:1786002590.074770:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002590.074796:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83000/0x7cee4af5784170a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b02b expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002590.074815:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ac:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:0.0:1786002590.074820:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002590.074899:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784170b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002590.074913:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784170b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002590.074923:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784170b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002590.075017:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6ab4694 reply state 000000008e80eb42 transno 4294984113 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784170b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002590.075029:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784170b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002590.075039:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ac:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:0.0:1786002590.075042:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002590.075044:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002590.075121:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20350:x1872758531015296:12345-192.168.203.49@tcp:36:mmap_mknod_test.0 Request processed in 546us (674us total) trans 4294984113 rc 0/0 00000100:00100000:0.0:1786002590.075128:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24167 00000100:00100000:0.0:1786002590.081964:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002590.083769:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531015424 00000100:00100000:3.0:1786002590.083780:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531015424 00000100:00100000:3.0:1786002590.083836:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24168 00000100:00100000:3.0:1786002590.084431:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20350:x1872758531015424:12345-192.168.203.49@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1786002590.084456:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002590.084476:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784170bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x15ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b039 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.084532:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784170bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b039 expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.084603:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784170bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b039 expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.084613:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ac:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:3.0:1786002590.084616:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786002590.084620:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83200, rc 0) 00000100:00100000:3.0:1786002590.085988:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20350:x1872758531015424:12345-192.168.203.49@tcp:101:mmap_mknod_test.0 Request processed in 2138us (4027us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002590.085997:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24168 00000100:00100000:3.0:1786002590.104651:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002590.104768:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531015552 00000100:00100000:3.0:1786002590.104778:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531015552 00000100:00100000:3.0:1786002590.104830:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5218 00000100:00100000:3.0:1786002590.104839:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20350:x1872758531015552:12345-192.168.203.49@tcp:49:mmap_mknod_test.0 00000100:00100000:3.0:1786002590.104967:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20350:x1872758531015552:12345-192.168.203.49@tcp:49:mmap_mknod_test.0 Request processed in 128us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002590.104975:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5218 00000100:00100000:2.0:1786002590.124875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002590.125534:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531015808 00000100:00100000:3.0:1786002590.125592:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531015808 00000100:00100000:3.0:1786002590.125651:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24169 00000100:00100000:3.0:1786002590.125660:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20350:x1872758531015808:12345-192.168.203.49@tcp:101:mmap_mknod_test.0 00010000:00010000:3.0:1786002590.125679:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002590.125791:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af5784170c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b040 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.125941:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af5784170ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.125954:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af5784170ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.125964:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af5784170ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.125977:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af5784170d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.125983:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af5784170d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.125989:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af5784170d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126080:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784170d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126088:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784170d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126095:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784170d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002590.126103:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ac:0x0]: returning size 4096 00010000:00010000:3.0:1786002590.126166:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af5784170ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126173:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af5784170ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126178:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af5784170ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126185:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af5784170ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126190:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002590.126195:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af5784170ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126202:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af5784170ca lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126213:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002590.126216:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002590.126221:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af5784170ca lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126227:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af5784170ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126236:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af5784170d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126242:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af5784170d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126248:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af5784170d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126253:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002590.126256:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af5784170d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126261:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af5784170d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126900:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99d161db (ffff9ed2456f9a00) 00010000:00010000:3.0:1786002590.126904:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002590.126908:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af5784170d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126914:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82e00/0x7cee4af5784170d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126952:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af5784170c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b040 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126965:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784170d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b040 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002590.126972:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ac:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:3.0:1786002590.126974:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002590.126976:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82000, rc 0) 00000100:00100000:3.0:1786002590.127027:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20350:x1872758531015808:12345-192.168.203.49@tcp:101:mmap_mknod_test.0 Request processed in 1368us (2179us total) trans 4294984114 rc 0/0 00000100:00100000:3.0:1786002590.127035:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24169 00000100:00100000:0.0:1786002590.135119:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002590.135261:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531016064 00000100:00100000:3.0:1786002590.135270:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531016064 00000100:00100000:3.0:1786002590.135331:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5219 00000100:00100000:3.0:1786002590.135341:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20350:x1872758531016064:12345-192.168.203.49@tcp:35:mmap_mknod_test.0 00000100:00100000:3.0:1786002590.136028:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:20350:x1872758531016064:12345-192.168.203.49@tcp:35:mmap_mknod_test.0 Request processed in 688us (917us total) trans 4294984115 rc 0/0 00000100:00100000:3.0:1786002590.136037:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5219 00010000:00010000:3.0:1786002590.698036:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002591.091652:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561036032:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.091717:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002591.091756:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561036544:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.091781:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002591.091798:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561037056:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.091820:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002591.091835:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561037568:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.091885:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002591.091908:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1786002591.091914:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561036160:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.091937:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002591.091954:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561036672:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.091973:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002591.091987:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561037184:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002591.092030:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561036032 00000100:00100000:1.0:1786002591.092036:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561036032 00000100:00100000:1.0:1786002591.092076:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1786002591.092084:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561036032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092123:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561036032:12345-0@lo:400:kworker.0 Request processed in 39us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002591.092129:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1786002591.092156:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561036544 00000100:00100000:1.0:1786002591.092160:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561036544 00000100:00100000:1.0:1786002591.092180:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4071 00000100:00100000:1.0:1786002591.092186:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561036544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092214:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561036544:12345-0@lo:400:kworker.0 Request processed in 28us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002591.092219:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4071 00000100:00100000:1.0:1786002591.092234:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561037056 00000100:00100000:1.0:1786002591.092237:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561037056 00000100:00100000:1.0:1786002591.092262:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561037568 00000100:00100000:1.0:1786002591.092265:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561037568 00000100:00100000:1.0:1786002591.092281:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1786002591.092287:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561037056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092326:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561037056:12345-0@lo:400:kworker.0 Request processed in 39us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002591.092332:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1786002591.092343:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1786002591.092349:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561037568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092489:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561037568:12345-0@lo:400:kworker.0 Request processed in 139us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002591.092496:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1786002591.092517:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561036160 00000100:00100000:1.0:1786002591.092520:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561036160 00000100:00100000:1.0:1786002591.092550:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561036672 00000100:00100000:1.0:1786002591.092553:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561036672 00000100:00100000:1.0:1786002591.092572:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561037184 00000100:00100000:1.0:1786002591.092575:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561037184 00000100:00100000:1.0:1786002591.092592:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:1.0:1786002591.092597:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561036160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092626:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561036160:12345-0@lo:400:kworker.0 Request processed in 29us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002591.092631:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:1.0:1786002591.092641:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1786002591.092647:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561036672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092669:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561036672:12345-0@lo:400:kworker.0 Request processed in 23us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002591.092674:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1786002591.092684:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1786002591.092691:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561037184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092732:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561037184:12345-0@lo:400:kworker.0 Request processed in 41us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002591.092738:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00080000:1.0:1786002591.092764:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786002591.092768:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002591.092770:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002591.092899:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561036160:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092910:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561036672:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092918:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561037184:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092926:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561036032:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092935:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561036544:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092943:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561037056:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.092951:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561037568:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.093625:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561035904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002591.093658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002591.093931:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561036288:0@lo:400:kworker.0 00000100:00100000:0.0:1786002591.093962:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002591.093986:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561036800:0@lo:400:kworker.0 00000100:00100000:0.0:1786002591.094005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002591.094022:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561037312:0@lo:400:kworker.0 00000100:00100000:0.0:1786002591.094044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002591.094075:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561036288 00000100:00100000:0.0:1786002591.094079:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561036288 00000100:00100000:0.0:1786002591.094109:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4072 00000100:00100000:0.0:1786002591.094116:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561036288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002591.094154:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561036288:12345-0@lo:400:kworker.0 Request processed in 38us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002591.094160:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4072 00000100:00100000:0.0:1786002591.094192:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561036288:0@lo:400:kworker.0 00000100:00100000:0.0:1786002591.094353:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561036800 00000100:00100000:0.0:1786002591.094357:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561036800 00000100:00100000:1.0:1786002591.094455:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561036416:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.094479:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002591.094497:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561036928:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.094518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002591.094534:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561037440:0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.094554:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002591.094581:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561036928 00000100:00100000:1.0:1786002591.094585:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561036928 00000100:00100000:1.0:1786002591.094613:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561037440 00000100:00100000:1.0:1786002591.094616:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561037440 00000100:00100000:1.0:1786002591.094638:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1786002591.094644:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561036928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.094678:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561036928:12345-0@lo:400:kworker.0 Request processed in 34us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002591.094684:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1786002591.094696:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1786002591.094702:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561037440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.094727:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561037440:12345-0@lo:400:kworker.0 Request processed in 26us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002591.094733:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1786002591.094752:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561037312 00000100:00100000:1.0:1786002591.094756:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561037312 00000100:00100000:0.0:1786002591.097521:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561036416 00000100:00100000:0.0:1786002591.097531:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561036416 00000100:00100000:0.0:1786002591.097559:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:1.0:1786002591.098439:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:1.0:1786002591.098448:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561036416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.098522:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561036416:12345-0@lo:400:kworker.0 Request processed in 75us (4041us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002591.098528:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:1.0:1786002591.098544:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:1.0:1786002591.098550:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561037312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002591.098580:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561037312:12345-0@lo:400:kworker.0 Request processed in 31us (4536us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002591.098586:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:1.0:1786002591.098611:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561037696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002591.098645:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002591.098715:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561037312:0@lo:400:kworker.0 00000100:00100000:0.0:1786002591.099029:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561036800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002591.099067:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561036800:12345-0@lo:400:kworker.0 Request processed in 1500us (5061us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002591.099074:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1786002591.100797:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561036800:0@lo:400:kworker.0 00000100:00100000:0.0:1786002591.101900:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561036416:0@lo:400:kworker.0 00000100:00100000:0.0:1786002591.101912:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561036928:0@lo:400:kworker.0 00000100:00100000:0.0:1786002591.101923:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561037440:0@lo:400:kworker.0 00000100:00080000:0.0:1786002591.101947:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786002591.101952:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786002591.101955:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002591.105891:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561035904 00000100:00100000:2.0:1786002591.105904:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561035904 00000100:00100000:2.0:1786002591.105954:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561037696 00000100:00100000:2.0:1786002591.105956:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561037696 00000100:00100000:2.0:1786002591.105972:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1786002591.105980:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561035904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002591.106009:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002591.106083:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561035904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (12425us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002591.106090:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1786002591.106104:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1786002591.106109:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561037696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002591.106117:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002591.106136:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561037696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 27us (7491us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002591.106142:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:0.0:1786002591.106259:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561035904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002591.118141:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561037696:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1786002591.725545:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002592.631304:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561037824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002592.631374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002592.631542:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561037824 00000100:00100000:3.0:1786002592.631549:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561037824 00000100:00100000:3.0:1786002592.631607:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4073 00000100:00100000:3.0:1786002592.631625:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561037824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002592.631792:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002592.631839:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561037824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 224us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002592.631868:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4073 00000100:00100000:3.0:1786002592.631912:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561037824:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786002592.756450:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002593.772555:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002594.666134:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561037952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002594.666204:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002594.666306:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561037952 00000100:00100000:0.0:1786002594.666313:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561037952 00000100:00100000:0.0:1786002594.666377:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1786002594.666388:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561037952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786002594.666414:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1786002594.666457:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561037952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002594.666464:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00080000:0.0:1786002594.666487:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002594.666522:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561037952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002594.666975:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786002594.666986:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561038080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002594.667018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002594.667097:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561038080 00000100:00100000:3.0:1786002594.667102:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561038080 00000100:00100000:3.0:1786002594.667147:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1786002594.667153:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561038080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786002594.667164:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1786002594.667197:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561038080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002594.667204:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1786002594.667330:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561038080:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786002594.667358:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786002594.801838:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002595.160922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002595.160962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002595.161001:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002595.161024:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002595.161043:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002595.161067:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531016704 00000100:00100000:3.0:1786002595.161075:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531016704 00000100:00100000:3.0:1786002595.161124:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531016576 00000100:00100000:3.0:1786002595.161127:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531016576 00000100:00100000:3.0:1786002595.161148:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 531 00000100:00100000:3.0:1786002595.161157:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531016704:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002595.161220:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531016704:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 64us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002595.161228:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 531 00000100:00100000:3.0:1786002595.161245:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 532 00000100:00100000:3.0:1786002595.161252:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:2411:x1872758531016576:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002595.161287:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:2411:x1872758531016576:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 35us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002595.161293:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 532 00000100:00100000:3.0:1786002595.161314:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531016448 00000100:00100000:3.0:1786002595.161317:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531016448 00000100:00100000:3.0:1786002595.161348:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531016320 00000100:00100000:3.0:1786002595.161351:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531016320 00000100:00100000:3.0:1786002595.161371:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 969 00000100:00100000:3.0:1786002595.161378:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531016448:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002595.161405:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531016448:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002595.161412:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 969 00000100:00100000:3.0:1786002595.161425:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 970 00000100:00100000:3.0:1786002595.161431:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2411:x1872758531016320:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002595.161459:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2411:x1872758531016320:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002595.161468:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 970 00000100:00080000:3.0:1786002595.161488:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786002595.161491:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786002595.161494:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786002595.161496:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002595.161830:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531016192 00000100:00100000:1.0:1786002595.161835:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531016192 00000100:00100000:1.0:1786002595.161893:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 539 00000100:00100000:1.0:1786002595.161900:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758531016192:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002595.161944:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758531016192:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 45us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002595.161951:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 539 00000100:00100000:3.0:1786002595.180371:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561038208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786002595.180436:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002595.180561:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561038208 00000100:00100000:2.0:1786002595.180569:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561038208 00000100:00100000:2.0:1786002595.180640:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4074 00000100:00100000:2.0:1786002595.180651:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561038208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786002595.180682:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:2.0:1786002595.180887:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561038208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002595.180894:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4074 00000100:00100000:2.0:1786002595.180939:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561038208:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1786002595.698280:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984115 is committed 00010000:00010000:2.0:1786002595.698338:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578417076 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698351:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578417076 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698359:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578417076 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698365:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002595.698370:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578417076 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698378:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578417076 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698397:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99d161db (ffff9ed2456f9a00) 00010000:00010000:2.0:1786002595.698401:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002595.698406:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578417076 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698411:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83400/0x7cee4af578417076 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x99d161db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698437:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784170b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698443:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784170b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698448:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784170b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698452:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002595.698455:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784170b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698461:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784170b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698468:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ac:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:2.0:1786002595.698470:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002595.698473:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784170b5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002595.698478:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784170b5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002595.832582:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002596.202020:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002596.202041:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561038336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002596.202105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002596.202176:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561038336 00000100:00100000:0.0:1786002596.202184:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561038336 00000100:00100000:0.0:1786002596.202236:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1786002596.202245:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561038336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786002596.202287:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1786002596.202332:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561038336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002596.202338:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00080000:0.0:1786002596.202361:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002596.202394:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561038336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002596.202577:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561038720:0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.202620:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002596.202643:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561039232:0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.202668:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002596.202684:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561039744:0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.202704:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002596.202723:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1786002596.202729:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561038592:0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.202749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002596.202764:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561039104:0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.202785:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002596.202801:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561039616:0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.202820:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002596.202844:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561038720 00000100:00100000:2.0:1786002596.202871:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561038720 00000100:00100000:2.0:1786002596.202901:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4075 00000100:00100000:2.0:1786002596.202907:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561038720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.202946:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561038720:12345-0@lo:400:kworker.0 Request processed in 39us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002596.202951:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4075 00000100:00100000:2.0:1786002596.202970:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561039232 00000100:00100000:2.0:1786002596.202974:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561039232 00000100:00100000:2.0:1786002596.202997:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561039744 00000100:00100000:2.0:1786002596.203000:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561039744 00000100:00100000:2.0:1786002596.203013:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561038592 00000100:00100000:2.0:1786002596.203015:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561038592 00000100:00100000:2.0:1786002596.203023:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561039104 00000100:00100000:2.0:1786002596.203025:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561039104 00000100:00100000:2.0:1786002596.203035:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561039616 00000100:00100000:2.0:1786002596.203038:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561039616 00000100:00100000:2.0:1786002596.203050:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1786002596.203056:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561039232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.203086:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561039232:12345-0@lo:400:kworker.0 Request processed in 31us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002596.203092:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1786002596.203103:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1786002596.203108:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561039744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.203132:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561039744:12345-0@lo:400:kworker.0 Request processed in 24us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002596.203138:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1786002596.203148:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:2.0:1786002596.203154:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561038592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.203182:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561038592:12345-0@lo:400:kworker.0 Request processed in 28us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002596.203188:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:2.0:1786002596.203199:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:2.0:1786002596.203205:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561039104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.203230:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561039104:12345-0@lo:400:kworker.0 Request processed in 25us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002596.203235:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:2.0:1786002596.203245:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:2.0:1786002596.203251:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561039616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.203289:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561039616:12345-0@lo:400:kworker.0 Request processed in 38us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002596.203295:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:2.0:1786002596.203331:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561038592:0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.203340:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561039104:0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.203347:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561039616:0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.203355:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561038720:0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.203363:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561039232:0@lo:400:kworker.0 00000100:00100000:2.0:1786002596.203371:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561039744:0@lo:400:kworker.0 00000100:00080000:0.0:1786002596.205107:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786002596.205113:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002596.205142:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758561038464:0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.205195:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002596.205228:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561038976:0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.205264:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002596.205284:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561039488:0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.205309:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002596.205331:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1786002596.205337:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561038848:0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.205360:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002596.205378:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561039360:0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.205399:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002596.205416:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561039872:0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.205436:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002596.205462:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561038464 00000100:00100000:0.0:1786002596.205467:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561038464 00000100:00100000:0.0:1786002596.205505:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1786002596.205513:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758561038464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.205556:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758561038464:12345-0@lo:400:kworker.0 Request processed in 43us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002596.205562:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1786002596.205592:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561038976 00000100:00100000:0.0:1786002596.205596:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561038976 00000100:00100000:0.0:1786002596.205620:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4076 00000100:00100000:0.0:1786002596.205626:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561038976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.205657:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561038976:12345-0@lo:400:kworker.0 Request processed in 31us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002596.205663:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4076 00000100:00100000:0.0:1786002596.205682:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561039488 00000100:00100000:0.0:1786002596.205685:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561039488 00000100:00100000:0.0:1786002596.205715:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561039360 00000100:00100000:0.0:1786002596.205718:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561039360 00000100:00100000:0.0:1786002596.205736:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561039872 00000100:00100000:0.0:1786002596.205738:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561039872 00000100:00100000:0.0:1786002596.205757:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1786002596.205763:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561039488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.205793:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561039488:12345-0@lo:400:kworker.0 Request processed in 30us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002596.205801:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1786002596.205812:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1786002596.205819:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561039360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.205868:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561039360:12345-0@lo:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002596.205874:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1786002596.205889:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1786002596.205895:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561039872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.205922:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561039872:12345-0@lo:400:kworker.0 Request processed in 28us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002596.205928:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1786002596.205947:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561038848 00000100:00100000:0.0:1786002596.205950:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561038848 00000100:00100000:0.0:1786002596.205977:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1786002596.205983:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561038848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.206012:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561038848:12345-0@lo:400:kworker.0 Request processed in 30us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002596.206017:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00080000:0.0:1786002596.206053:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786002596.206056:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002596.206080:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561038848:0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.206091:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561039360:0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.206099:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561039872:0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.206106:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758561038464:0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.206114:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561038976:0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.206122:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561039488:0@lo:400:kworker.0 00000100:00100000:0.0:1786002596.210107:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561040000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002596.210218:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002596.210308:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561040000 00000100:00100000:2.0:1786002596.210316:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561040000 00000100:00100000:2.0:1786002596.210393:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1786002596.210403:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561040000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002596.210423:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002596.210469:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561040000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002596.210476:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1786002596.210537:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561040000:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786002596.845039:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002597.738035:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561040128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002597.738100:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002597.738225:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561040128 00000100:00100000:3.0:1786002597.738233:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561040128 00000100:00100000:3.0:1786002597.738294:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4077 00000100:00100000:3.0:1786002597.738303:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561040128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002597.738336:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002597.738380:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561040128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002597.738387:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4077 00000100:00100000:1.0:1786002597.738483:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561040128:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786002597.866086:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786002598.769020:0:22652:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63a: Verify oig_wait interruption does not crash ================================================================= 03:49:56 (1786002596) 00010000:00010000:3.0:1786002598.891254:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002598.919044:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002598.919129:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531016960 00000100:00100000:3.0:1786002598.919138:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531016960 00000100:00100000:3.0:1786002598.919202:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24170 00000100:00100000:3.0:1786002598.919212:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:20935:x1872758531016960:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1786002598.919232:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002598.919243:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786002598.919267:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417084 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b024 expref: 14 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919289:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002598.919293:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002598.919305:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784170e6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b047 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919397:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784170ed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919410:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784170ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919420:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784170ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919432:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784170f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919439:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784170f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919446:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784170f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002598.919725:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa00:0x0], index 0: 0 00010000:00010000:3.0:1786002598.919884:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af5784170fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919892:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af5784170fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919904:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af5784170fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919930:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784170ed lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919937:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784170ed lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919943:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784170ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919949:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784170ed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919955:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002598.919959:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784170ed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919965:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784170ed lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919973:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002598.919975:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002598.919979:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784170ed lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.919985:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784170ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002598.919994:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf3662c8 reply state 00000000ea84bd1a transno 4294984116 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784170f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.920003:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784170f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.920009:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed245735c00) 00010000:00010000:3.0:1786002598.920011:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002598.920013:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002598.920033:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784170e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b047 expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.920045:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af5784170fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b047 expref: 15 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002598.920053:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:3.0:1786002598.920055:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002598.920057:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83a00, rc 0) 00000100:00100000:3.0:1786002598.920106:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20935:x1872758531016960:12345-192.168.203.49@tcp:101:dd.0 Request processed in 896us (1068us total) trans 4294984116 rc 0/0 00000100:00100000:3.0:1786002598.920112:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24170 00000100:00080000:0.0:1786002598.920558:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786002598.929657:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002598.929719:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531017088 00000100:00100000:0.0:1786002598.929728:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531017088 00000100:00100000:0.0:1786002598.929790:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5347 00000100:00100000:0.0:1786002598.929801:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:20935:x1872758531017088:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002598.929819:0:14691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002598.929838:0:14691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d185ad/0x7cee4af578417109 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b04e expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002598.929880:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002598.929901:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=959s v=(0 0) 00010000:00010000:0.0:1786002598.929905:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002598.929913:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d185ad/0x7cee4af578417109 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b04e expref: 6 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002598.929931:0:14691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7d185ad/0x7cee4af578417109 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b04e expref: 6 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002598.929944:0:14691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717e00, rc 0) 00000100:00100000:0.0:1786002598.929989:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:20935:x1872758531017088:12345-192.168.203.49@tcp:101:dd.0 Request processed in 191us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002598.929995:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5347 00000100:00080000:3.0:1786002598.930169:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002599.786139:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561040256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002599.786211:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002599.788331:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561040256 00000100:00100000:0.0:1786002599.788340:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561040256 00000100:00100000:0.0:1786002599.788399:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1786002599.788409:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561040256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786002599.788437:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1786002599.788509:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561040256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002599.788516:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1786002599.788536:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002599.788545:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561040256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002599.788557:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561040384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002599.788587:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786002599.788951:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002599.789081:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561040384 00000100:00100000:2.0:1786002599.789086:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561040384 00000100:00100000:2.0:1786002599.789127:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1786002599.789135:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561040384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786002599.789147:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 67507904 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002599.789191:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561040384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002599.789197:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1786002599.790332:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561040384:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1786002599.791992:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786002599.919622:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002600.278667:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002600.278736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002600.278833:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002600.278894:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531017728 00000100:00100000:3.0:1786002600.278903:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531017728 00000100:00100000:3.0:1786002600.278975:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 536 00000100:00100000:3.0:1786002600.278986:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531017728:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002600.280341:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531017728:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 579us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002600.280352:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 536 00000100:00080000:3.0:1786002600.280387:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002600.280608:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531017472 00000100:00100000:0.0:1786002600.280615:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531017472 00000100:00100000:0.0:1786002600.280660:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 977 00000100:00100000:0.0:1786002600.280668:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531017472:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002600.280724:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531017472:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 51us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002600.280731:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 977 00000100:00080000:0.0:1786002600.280751:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002600.282150:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531017216 00000100:00100000:1.0:1786002600.282158:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531017216 00000100:00100000:1.0:1786002600.282204:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 541 00000100:00100000:1.0:1786002600.282212:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531017216:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002600.282262:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531017216:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 51us (3604us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002600.282269:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 541 00000100:00100000:0.0:1786002600.292932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002600.292990:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002600.293197:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531017344 00000100:00100000:1.0:1786002600.293207:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531017344 00000100:00100000:1.0:1786002600.293275:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 978 00000100:00100000:1.0:1786002600.293285:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2411:x1872758531017344:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002600.293355:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2411:x1872758531017344:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 71us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002600.293361:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 978 00000100:00100000:3.0:1786002600.293522:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531017600 00000100:00100000:3.0:1786002600.293527:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531017600 00000100:00100000:3.0:1786002600.293578:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 537 00000100:00100000:3.0:1786002600.293587:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531017600:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002600.293619:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531017600:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 34us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002600.293626:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 537 00000100:00080000:0.0:1786002600.294445:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786002600.294451:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786002600.298553:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561040512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002600.298642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002600.300162:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561040512 00000100:00100000:0.0:1786002600.300183:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561040512 00000100:00100000:0.0:1786002600.300245:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4078 00000100:00100000:0.0:1786002600.300254:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561040512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002600.300288:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:0.0:1786002600.304766:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561040512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4504us (6114us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002600.304786:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4078 00000100:00100000:1.0:1786002600.313503:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561040512:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1786002600.938309:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002601.322333:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561040640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786002601.322400:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002601.322498:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786002601.322505:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561040768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002601.322530:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002601.322561:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561040640 00000100:00100000:3.0:1786002601.322568:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561040640 00000100:00100000:3.0:1786002601.322611:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561040768 00000100:00100000:3.0:1786002601.322614:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561040768 00000100:00100000:3.0:1786002601.322631:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1786002601.322639:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561040640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786002601.322663:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1786002601.322704:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561040640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002601.322711:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1786002601.322727:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1786002601.322733:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561040768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786002601.322743:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1786002601.322766:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561040768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002601.322772:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1786002601.322809:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561040768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002601.322821:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561040640:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1786002601.322882:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002601.332109:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561041280:0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.332302:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002601.332346:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561041792:0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.332370:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002601.332403:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1786002601.332409:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561041152:0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.332430:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002601.332446:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561041664:0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.332463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002601.332476:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561042176:0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.332493:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002601.332519:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561041280 00000100:00100000:0.0:1786002601.332526:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561041280 00000100:00100000:0.0:1786002601.332700:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561041664 00000100:00100000:0.0:1786002601.332704:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561041664 00000100:00100000:0.0:1786002601.332730:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561042176 00000100:00100000:0.0:1786002601.332733:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561042176 00000100:00100000:0.0:1786002601.332752:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:0.0:1786002601.332760:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561041280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.332811:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561041280:12345-0@lo:400:kworker.0 Request processed in 51us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002601.332817:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:0.0:1786002601.332834:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:0.0:1786002601.332840:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561041664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.332899:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561041664:12345-0@lo:400:kworker.0 Request processed in 59us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002601.332904:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:0.0:1786002601.332915:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1786002601.332920:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561042176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.332944:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561042176:12345-0@lo:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002601.332949:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1786002601.332967:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561041792 00000100:00100000:0.0:1786002601.332971:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561041792 00000100:00100000:0.0:1786002601.332995:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1786002601.333001:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561041792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.333030:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561041792:12345-0@lo:400:kworker.0 Request processed in 29us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002601.333034:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1786002601.333201:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561041024:0@lo:400:kworker.0 00000100:00100000:2.0:1786002601.333240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002601.333267:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561041152 00000100:00100000:0.0:1786002601.333271:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561041152 00000100:00100000:0.0:1786002601.333293:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4079 00000100:00100000:0.0:1786002601.333298:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561041152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.333330:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561041152:12345-0@lo:400:kworker.0 Request processed in 31us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002601.333338:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4079 00000100:00100000:1.0:1786002601.333508:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561040896:0@lo:400:kworker.0 00000100:00100000:1.0:1786002601.333551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002601.335421:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561041536:0@lo:400:kworker.0 00000100:00100000:2.0:1786002601.335458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002601.339298:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561041152:0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.339315:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561041664:0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.339325:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561042176:0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.339335:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561041280:0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.339353:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561041792:0@lo:400:kworker.0 00000100:00100000:1.0:1786002601.339598:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561041408:0@lo:400:kworker.0 00000100:00100000:1.0:1786002601.339645:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002601.339666:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561041920:0@lo:400:kworker.0 00000100:00100000:1.0:1786002601.339684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002601.344408:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561042048:0@lo:400:kworker.0 00000100:00100000:2.0:1786002601.344471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002601.347312:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561041024 00000100:00100000:3.0:1786002601.347324:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561041024 00000100:00100000:3.0:1786002601.347388:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561041536 00000100:00100000:3.0:1786002601.347391:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561041536 00000100:00100000:3.0:1786002601.347413:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1786002601.347422:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561041024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002601.347498:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561041024:12345-0@lo:400:kworker.0 Request processed in 76us (14257us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002601.347504:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1786002601.347519:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:3.0:1786002601.347525:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561041536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002601.347573:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561041536:12345-0@lo:400:kworker.0 Request processed in 47us (12113us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002601.347579:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00080000:3.0:1786002601.347610:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786002601.347614:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786002601.347617:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786002601.347722:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561041408 00000100:00100000:3.0:1786002601.347727:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561041408 00000100:00100000:3.0:1786002601.347764:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4080 00000100:00100000:3.0:1786002601.347771:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561041408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002601.347818:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561041408:12345-0@lo:400:kworker.0 Request processed in 47us (8173us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002601.347824:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4080 00000100:00100000:3.0:1786002601.347876:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561040896 00000100:00100000:3.0:1786002601.347880:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561040896 00000100:00100000:3.0:1786002601.347905:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1786002601.347911:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561040896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002601.347942:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561040896:12345-0@lo:400:kworker.0 Request processed in 31us (14390us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002601.347947:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1786002601.347984:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561041920 00000100:00100000:3.0:1786002601.347989:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561041920 00000100:00100000:3.0:1786002601.348018:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1786002601.348025:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561041920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002601.348067:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561041920:12345-0@lo:400:kworker.0 Request processed in 42us (8381us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002601.348072:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00080000:3.0:1786002601.348086:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002601.348111:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561040896:0@lo:400:kworker.0 00000100:00100000:3.0:1786002601.348123:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561041408:0@lo:400:kworker.0 00000100:00100000:3.0:1786002601.348132:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561041920:0@lo:400:kworker.0 00000100:00100000:2.0:1786002601.356359:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561041024:0@lo:400:kworker.0 00000100:00100000:2.0:1786002601.358135:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561041536:0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.360140:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561042048 00000100:00100000:0.0:1786002601.360151:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561042048 00000100:00100000:0.0:1786002601.360373:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1786002601.360711:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561042048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.360807:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561042048:12345-0@lo:400:kworker.0 Request processed in 100us (16335us total) trans 0 rc 0/0 00000100:00080000:3.0:1786002601.364906:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002601.365032:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561042048:0@lo:400:kworker.0 00000100:00100000:0.0:1786002601.365340:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:3.0:1786002601.580701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002601.580876:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531017856 00000100:00100000:0.0:1786002601.580886:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531017856 00002000:00100000:0.0:1786002601.580932:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed37f3a1500 x1872758531017856/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:282/0 lens 488/0 e 0 to 0 dl 1786002612 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002601.580942:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a1500 with x1872758531017856 ext(0->4194303) 00002000:00010000:0.0:1786002601.580948:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f3a1500 00000100:00100000:0.0:1786002601.580978:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 20 00000100:00100000:0.0:1786002601.580987:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531017856:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002601.712569:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758531017856:12345-192.168.203.49@tcp:4:dd.0 Request processed in 131564us (131859us total) trans 4294969952 rc 0/0 00000100:00100000:3.0:1786002601.712583:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 20 00002000:00100000:3.0:1786002601.712595:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed37f3a1500 x1872758531017856/t4294969952(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:282/0 lens 488/448 e 0 to 0 dl 1786002612 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002601.712605:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a1500 with x1872758531017856 ext(0->4194303) 00002000:00010000:3.0:1786002601.712612:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f3a1500 00010000:00010000:3.0:1786002601.962131:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002602.858152:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002602.858176:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561042304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002602.858249:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002602.858435:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561042304 00000100:00100000:3.0:1786002602.858443:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561042304 00000100:00100000:3.0:1786002602.858493:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4081 00000100:00100000:3.0:1786002602.858502:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561042304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002602.858534:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002602.858723:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561042304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 221us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002602.858731:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4081 00000100:00100000:1.0:1786002602.868675:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561042304:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786002602.995775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002603.929630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002603.929924:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531018112 00000100:00100000:3.0:1786002603.929933:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531018112 00000100:00100000:3.0:1786002603.929998:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5220 00000100:00100000:3.0:1786002603.930007:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20935:x1872758531018112:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:3.0:1786002603.930218:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984117 00000100:00100000:3.0:1786002603.930326:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:20935:x1872758531018112:12345-192.168.203.49@tcp:35:dd.0 Request processed in 319us (704us total) trans 4294984118 rc 0/0 00000100:00100000:3.0:1786002603.930334:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5220 00000020:00080000:3.0:1786002603.930339:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1786002603.930433:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1786002603.939497:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984118 is committed 00010000:00010000:3.0:1786002603.942650:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784170f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002603.942673:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784170f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002603.942680:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784170f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002603.942686:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002603.942691:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784170f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002603.942698:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784170f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002603.942715:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed245735c00) 00010000:00010000:3.0:1786002603.942719:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002603.942723:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784170f4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002603.942729:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af5784170f4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002604.010056:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002604.906076:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002604.906096:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561042432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002604.906159:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002604.906276:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561042432 00000100:00100000:3.0:1786002604.906284:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561042432 00000100:00100000:3.0:1786002604.906343:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1786002604.906354:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561042432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786002604.906379:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 75945664 pending 4218880 free 3919331328 avail 3687809024 00000100:00100000:3.0:1786002604.906420:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561042432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002604.906428:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1786002604.906543:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561042432:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786002604.907263:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002604.907373:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786002604.907384:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561042560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002604.907416:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002604.907484:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561042560 00000100:00100000:3.0:1786002604.907489:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561042560 00000100:00100000:3.0:1786002604.907529:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1786002604.907537:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561042560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786002604.907549:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 75945664 pending 4218880 free 3919331328 avail 3687809024 00000100:00100000:3.0:1786002604.907593:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561042560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002604.907599:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1786002604.907815:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561042560:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1786002604.907902:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002604.985762:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002604.985834:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531018240 00000100:00100000:3.0:1786002604.985842:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531018240 00000100:00100000:3.0:1786002604.985922:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24171 00000100:00100000:3.0:1786002604.985932:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:20940:x1872758531018240:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1786002604.985953:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002604.985971:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b055 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002604.986081:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417117 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002604.986096:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002604.986108:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002604.986149:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:3.0:1786002604.986153:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786002604.986170:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002604.986203:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b055 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002604.986221:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417117 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b055 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002604.986230:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002604.986232:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786002604.986236:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83800, rc 0) 00000100:00100000:3.0:1786002604.986328:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20940:x1872758531018240:12345-192.168.203.49@tcp:101:dd.0 Request processed in 397us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002604.986336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24171 00000100:00100000:2.0:1786002605.000317:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002605.000608:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531018496 00000100:00100000:3.0:1786002605.000618:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531018496 00000100:00100000:3.0:1786002605.000746:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24172 00000100:00100000:3.0:1786002605.000757:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20940:x1872758531018496:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1786002605.000777:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002605.000780:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786002605.000806:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417117 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b055 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002605.000825:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002605.000829:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002605.000842:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af57841711e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b05c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002605.000961:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417125 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002605.000974:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417125 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002605.000984:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417125 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002605.000994:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ad:0x0]: returning size 7241728 00010000:00010000:3.0:1786002605.001108:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af57841711e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b05c expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002605.001122:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417125 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b05c expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002605.001129:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:3.0:1786002605.001132:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002605.001135:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82400, rc 0) 00000100:00100000:3.0:1786002605.001190:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20940:x1872758531018496:12345-192.168.203.49@tcp:101:dd.0 Request processed in 435us (881us total) trans 4294984119 rc 0/0 00000100:00100000:3.0:1786002605.001207:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24172 00000100:00100000:3.0:1786002605.005740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002605.010330:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002605.010399:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531018752 00000100:00100000:1.0:1786002605.010409:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531018752 00000100:00100000:1.0:1786002605.010467:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24173 00000100:00100000:1.0:1786002605.010475:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20940:x1872758531018752:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002605.010498:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002605.010515:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417133 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b063 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002605.010550:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af57841713a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002605.010563:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af57841713a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002605.010574:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af57841713a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002605.010683:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417133 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b063 expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002605.010699:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af57841713a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b063 expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002605.010713:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:1.0:1786002605.010716:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786002605.010720:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b400, rc 0) 00000100:00100000:1.0:1786002605.010765:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20940:x1872758531018752:12345-192.168.203.49@tcp:101:dd.0 Request processed in 291us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002605.010771:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24173 00000100:00080000:0.0:1786002605.014459:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002605.022014:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531018624 00000100:00100000:2.0:1786002605.022029:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531018624 00000100:00100000:2.0:1786002605.022112:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1521 00000100:00100000:2.0:1786002605.022122:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531018624:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002605.022137:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002605.022161:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417125 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b05c expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002605.022180:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002605.022185:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002605.022550:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531018624:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 428us (16818us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002605.022559:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1521 00010000:00010000:3.0:1786002605.035227:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002605.039779:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002605.039866:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531019008 00000100:00100000:0.0:1786002605.039876:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531019008 00000100:00100000:0.0:1786002605.039931:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24174 00000100:00100000:0.0:1786002605.039940:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20940:x1872758531019008:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:0.0:1786002605.039988:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002605.040159:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83a00/0x7cee4af5784170fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b047 expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002605.040177:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002605.040183:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002605.041665:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417141 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002605.041683:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002605.041693:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002605.041797:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984120 00000004:00010000:0.0:1786002605.041822:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065fdf73e reply state 00000000a558996e transno 4294984121 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002605.041834:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417141 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002605.041840:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002605.041843:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002605.041862:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002605.042006:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:20940:x1872758531019008:12345-192.168.203.49@tcp:36:dd.0 Request processed in 2057us (3151us total) trans 4294984121 rc 0/0 00000100:00100000:0.0:1786002605.042015:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24174 00000020:00080000:0.0:1786002605.042021:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002605.065789:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002605.065946:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531019136 00000100:00100000:2.0:1786002605.065956:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531019136 00000100:00100000:2.0:1786002605.066017:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24175 00000100:00100000:2.0:1786002605.066027:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:20940:x1872758531019136:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002605.066048:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002605.066066:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578417148 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b06a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002605.066120:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578417148 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15ad:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b06a expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002605.066135:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578417148 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15ad:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b06a expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002605.066152:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002605.066156:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786002605.066160:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3600, rc 0) 00000100:00100000:2.0:1786002605.066225:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20940:x1872758531019136:12345-192.168.203.49@tcp:101:dd.0 Request processed in 198us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002605.066233:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24175 00000100:00100000:1.0:1786002605.292055:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002605.292185:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531019264 00000100:00100000:2.0:1786002605.292202:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531019264 00002000:00010000:2.0:1786002605.292257:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1786002605.292262:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2465fdc00 with x1872758531019264 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002605.292273:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2465fdc00. 00000100:00100000:2.0:1786002605.292303:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 21 00000100:00100000:2.0:1786002605.292315:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758531019264:12345-192.168.203.49@tcp:10:dd.0 00000100:00080000:0.0:1786002605.293580:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1786002605.312797:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002605.312805:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 0 -> 1786002605 00002000:00010000:2.0:1786002605.312809:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002605.312811:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 0 -> 1786002605 00002000:00010000:2.0:1786002605.312814:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002605.313604:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758531019264:12345-192.168.203.49@tcp:10:dd.0 Request processed in 21284us (21551us total) trans 4294969953 rc 0/0 00000100:00100000:2.0:1786002605.313617:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 21 00002000:00010000:2.0:1786002605.313622:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1786002605.313625:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2465fdc00 with x1872758531019264 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002605.313633:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2465fdc00. 00000100:00100000:3.0:1786002605.404658:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002605.404701:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002605.404746:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002605.404783:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002605.404877:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531019392 00000100:00100000:2.0:1786002605.404886:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531019392 00000100:00100000:2.0:1786002605.404941:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 543 00000100:00100000:2.0:1786002605.404951:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531019392:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002605.405028:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531019392:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002605.405036:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 543 00000100:00100000:1.0:1786002605.405161:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531019776 00000100:00100000:1.0:1786002605.405166:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531019776 00000100:00100000:1.0:1786002605.405221:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 540 00000100:00100000:1.0:1786002605.405229:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531019776:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002605.405260:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531019776:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 33us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002605.405267:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 540 00000100:00080000:2.0:1786002605.405432:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002605.414807:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531019520 00000100:00100000:0.0:1786002605.414820:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531019520 00000100:00100000:0.0:1786002605.414913:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531019648 00000100:00100000:0.0:1786002605.414917:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531019648 00000100:00100000:0.0:1786002605.415041:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 985 00000100:00100000:0.0:1786002605.415052:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758531019520:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002605.415129:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758531019520:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 78us (10478us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002605.415137:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 985 00000100:00100000:0.0:1786002605.415155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 986 00000100:00100000:0.0:1786002605.415162:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531019648:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002605.415190:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531019648:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (10407us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002605.415206:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 986 00000100:00100000:0.0:1786002605.420160:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002605.420182:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561042688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002605.420261:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002605.420349:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561042688 00000100:00100000:0.0:1786002605.420356:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561042688 00000100:00100000:0.0:1786002605.420403:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4082 00000100:00100000:0.0:1786002605.420412:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561042688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002605.421786:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:1.0:1786002605.422436:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561042688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2022us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002605.422446:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4082 00000100:00100000:0.0:1786002605.422597:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561042688:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1786002605.426096:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1786002606.058628:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002606.442039:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561042816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002606.442104:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002606.442193:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758561043456:0@lo:400:kworker.0 00000100:00100000:3.0:1786002606.442221:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002606.442242:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561043968:0@lo:400:kworker.0 00000100:00100000:3.0:1786002606.442267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002606.442288:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561044480:0@lo:400:kworker.0 00000100:00100000:3.0:1786002606.442311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002606.442328:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561043200:0@lo:400:kworker.0 00000100:00100000:3.0:1786002606.442334:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1786002606.442343:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561043072:0@lo:400:kworker.0 00000100:00100000:1.0:1786002606.442368:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002606.442382:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002606.442393:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561043712:0@lo:400:kworker.0 00000100:00100000:3.0:1786002606.442416:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561043584:0@lo:400:kworker.0 00000100:00100000:1.0:1786002606.442424:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002606.442447:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561044224:0@lo:400:kworker.0 00000100:00100000:3.0:1786002606.442456:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002606.442483:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561042944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002606.442604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002606.442623:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1786002606.442629:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561043328:0@lo:400:kworker.0 00000100:00100000:1.0:1786002606.442651:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002606.442667:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758561043840:0@lo:400:kworker.0 00000100:00100000:1.0:1786002606.442684:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002606.442697:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758561044352:0@lo:400:kworker.0 00000100:00100000:1.0:1786002606.442712:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002606.442735:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561043456 00000100:00100000:1.0:1786002606.442742:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561043456 00000100:00100000:1.0:1786002606.442774:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561043200 00000100:00100000:1.0:1786002606.442776:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561043200 00000100:00100000:1.0:1786002606.442786:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561043712 00000100:00100000:1.0:1786002606.442788:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561043712 00000100:00100000:2.0:1786002606.445910:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561043968 00000100:00100000:2.0:1786002606.445987:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561043968 00000100:00100000:3.0:1786002606.446236:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561044096:0@lo:400:kworker.0 00000100:00100000:3.0:1786002606.446290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002606.446320:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561044480 00000100:00100000:3.0:1786002606.446324:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561044480 00000100:00100000:0.0:1786002606.453346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002606.453431:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561044224 00000100:00100000:0.0:1786002606.453440:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561044224 00000100:00100000:1.0:1786002606.453527:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561043840 00000100:00100000:1.0:1786002606.453531:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561043840 00000100:00100000:2.0:1786002606.458082:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561044096 00000100:00100000:2.0:1786002606.458096:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561044096 00000100:00100000:2.0:1786002606.458141:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1786002606.458152:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561043968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.458256:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561043968:12345-0@lo:400:kworker.0 Request processed in 106us (15988us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002606.458263:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1786002606.458278:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:2.0:1786002606.458285:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561044096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.458314:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561044096:12345-0@lo:400:kworker.0 Request processed in 30us (12024us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002606.458318:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:2.0:1786002606.458346:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561042816 00000100:00100000:2.0:1786002606.458350:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561042816 00000100:00100000:2.0:1786002606.458378:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561042944 00000100:00100000:2.0:1786002606.458381:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561042944 00000100:00100000:2.0:1786002606.458393:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1786002606.460038:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561042816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002606.460070:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002606.460128:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561042816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (18024us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002606.460135:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1786002606.460159:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:2.0:1786002606.460166:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872758561042944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002606.460181:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002606.460232:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1872758561042944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (6893us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002606.460238:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00080000:2.0:1786002606.460264:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786002606.460270:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786002606.460272:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786002606.460275:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002606.460305:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561043072 00000100:00100000:2.0:1786002606.460311:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561043072 00000100:00100000:2.0:1786002606.460339:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1786002606.460346:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561043072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.460375:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561043072:12345-0@lo:400:kworker.0 Request processed in 30us (17996us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002606.460381:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1786002606.460409:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561044352 00000100:00100000:2.0:1786002606.460413:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561044352 00000100:00080000:2.0:1786002606.460428:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786002606.460447:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:2.0:1786002606.460453:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758561043456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.460483:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758561043456:12345-0@lo:400:kworker.0 Request processed in 31us (18262us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002606.460489:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:2.0:1786002606.460501:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:2.0:1786002606.460506:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561043200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.460536:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561043200:12345-0@lo:400:kworker.0 Request processed in 30us (18169us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002606.460541:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:2.0:1786002606.460552:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:2.0:1786002606.460558:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561043712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.460584:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561043712:12345-0@lo:400:kworker.0 Request processed in 26us (18164us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002606.460589:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:2.0:1786002606.460599:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:2.0:1786002606.460604:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758561044352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.460624:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758561044352:12345-0@lo:400:kworker.0 Request processed in 20us (17911us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002606.460629:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:2.0:1786002606.460673:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561044096:0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.460684:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758561043456:0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.460694:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561043968:0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.460707:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561042816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002606.460731:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561043072:0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.460774:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561043584 00000100:00100000:2.0:1786002606.460778:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561043584 00000100:00100000:2.0:1786002606.460799:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561043328 00000100:00100000:2.0:1786002606.460802:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561043328 00000100:00100000:2.0:1786002606.460815:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4083 00000100:00100000:2.0:1786002606.460820:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561043584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.460871:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561043584:12345-0@lo:400:kworker.0 Request processed in 50us (18417us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002606.460877:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4083 00000100:00100000:2.0:1786002606.460887:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4084 00000100:00100000:2.0:1786002606.460893:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561043328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.464047:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561043328:12345-0@lo:400:kworker.0 Request processed in 3145us (21385us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002606.464060:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4084 00000100:00100000:2.0:1786002606.464147:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561043584:0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.464300:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561043328:0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.464313:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758561044352:0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.464323:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561043200:0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.464334:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561043712:0@lo:400:kworker.0 00000100:00100000:2.0:1786002606.464391:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561042944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786002606.465249:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1786002606.465261:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561044480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002606.465335:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561044480:12345-0@lo:400:kworker.0 Request processed in 78us (23023us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002606.465342:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1786002606.465375:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561044480:0@lo:400:kworker.0 00000100:00100000:0.0:1786002606.466178:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1786002606.466196:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561044224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002606.466241:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561044224:12345-0@lo:400:kworker.0 Request processed in 55us (23637us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002606.466248:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1786002606.466285:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561044224:0@lo:400:kworker.0 00000100:00100000:1.0:1786002606.466724:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1786002606.466734:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758561043840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002606.466775:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758561043840:12345-0@lo:400:kworker.0 Request processed in 44us (24089us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002606.466781:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1786002606.466806:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758561043840:0@lo:400:kworker.0 00010000:00010000:1.0:1786002607.082603:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002607.978111:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002607.978133:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561044608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786002607.978222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002607.978401:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561044608 00000100:00100000:2.0:1786002607.978409:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561044608 00000100:00100000:2.0:1786002607.978463:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4085 00000100:00100000:2.0:1786002607.978474:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561044608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786002607.978520:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:2.0:1786002607.978566:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561044608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002607.978573:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4085 00000100:00100000:3.0:1786002607.979904:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561044608:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1786002607.981767:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969953 is committed 00010000:00010000:3.0:1786002608.106076:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002609.130099:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002609.211948:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002609.212102:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531019904 00000100:00100000:1.0:1786002609.212113:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531019904 00002000:00100000:1.0:1786002609.212198:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed37f3a1c00 x1872758531019904/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:290/0 lens 488/0 e 0 to 0 dl 1786002620 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002609.212210:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a1c00 with x1872758531019904 ext(0->4194303) 00002000:00010000:1.0:1786002609.212216:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f3a1c00 00000100:00100000:1.0:1786002609.212239:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 22 00000100:00100000:1.0:1786002609.212249:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531019904:12345-192.168.203.49@tcp:4:dd.0 00000100:00080000:3.0:1786002609.212632:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002609.337794:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758531019904:12345-192.168.203.49@tcp:4:dd.0 Request processed in 125536us (125845us total) trans 4294969954 rc 0/0 00000100:00100000:1.0:1786002609.337808:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 22 00002000:00100000:1.0:1786002609.337820:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed37f3a1c00 x1872758531019904/t4294969954(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:290/0 lens 488/448 e 0 to 0 dl 1786002620 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002609.337831:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a1c00 with x1872758531019904 ext(0->4194303) 00002000:00010000:1.0:1786002609.337837:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f3a1c00 00000100:00100000:3.0:1786002609.995036:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002609.995203:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531020160 00000100:00100000:1.0:1786002609.995213:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531020160 00000100:00100000:1.0:1786002609.995290:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5221 00000100:00100000:1.0:1786002609.995302:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20940:x1872758531020160:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:1.0:1786002609.995503:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984122 00000100:00100000:1.0:1786002609.995624:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:20940:x1872758531020160:12345-192.168.203.49@tcp:35:dd.0 Request processed in 324us (596us total) trans 4294984123 rc 0/0 00000100:00100000:1.0:1786002609.995633:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5221 00000020:00080000:1.0:1786002609.995638:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1786002609.996152:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786002610.026156:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561044736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002610.026235:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002610.026424:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561044736 00000100:00100000:2.0:1786002610.026431:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561044736 00000100:00100000:2.0:1786002610.026504:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1786002610.026516:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561044736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786002610.026537:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 155648 granted 77092544 pending 4218880 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002610.026584:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561044736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002610.026591:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1786002610.026637:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561044736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002610.026934:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561044864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002610.026968:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786002610.027114:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002610.027207:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561044864 00000100:00100000:3.0:1786002610.027212:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561044864 00000100:00100000:3.0:1786002610.027264:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1786002610.027272:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561044864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786002610.027282:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 155648 granted 77092544 pending 4218880 free 3923525632 avail 3692003328 00000100:00100000:3.0:1786002610.027320:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561044864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002610.027327:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1786002610.027360:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561044864:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1786002610.027411:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786002610.154429:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002610.522457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002610.522510:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002610.522559:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002610.522708:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531020416 00000100:00100000:0.0:1786002610.522718:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531020416 00000100:00100000:0.0:1786002610.522772:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 993 00000100:00100000:0.0:1786002610.522782:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2413:x1872758531020416:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002610.522881:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2413:x1872758531020416:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 100us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002610.522889:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 993 00000100:00100000:3.0:1786002610.522959:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531020672 00000100:00100000:3.0:1786002610.522964:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531020672 00000100:00100000:3.0:1786002610.522998:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 544 00000100:00100000:3.0:1786002610.523005:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758531020672:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002610.523031:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758531020672:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002610.523039:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 544 00000100:00100000:2.0:1786002610.523233:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531020288 00000100:00100000:2.0:1786002610.523237:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531020288 00000100:00100000:2.0:1786002610.523276:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 545 00000100:00100000:2.0:1786002610.523283:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758531020288:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002610.523327:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758531020288:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 44us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002610.523333:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 545 00000100:00100000:1.0:1786002610.531519:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002610.531567:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002610.531698:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531020544 00000100:00100000:0.0:1786002610.531708:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531020544 00000100:00100000:0.0:1786002610.531782:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 994 00000100:00100000:0.0:1786002610.531794:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531020544:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002610.531908:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531020544:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 116us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002610.531916:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 994 00000100:00100000:3.0:1786002610.532033:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531020800 00000100:00100000:3.0:1786002610.532038:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531020800 00000100:00100000:3.0:1786002610.532080:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 545 00000100:00100000:3.0:1786002610.532088:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531020800:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002610.532123:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531020800:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 37us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002610.532130:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 545 00000100:00080000:1.0:1786002610.533345:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002610.533352:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786002610.538834:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002610.538885:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561044992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002610.538952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002610.539116:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561044992 00000100:00100000:1.0:1786002610.539125:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561044992 00000100:00100000:1.0:1786002610.539177:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4086 00000100:00100000:1.0:1786002610.539187:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561044992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786002610.539220:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:1.0:1786002610.539267:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561044992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002610.539273:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4086 00000100:00100000:2.0:1786002610.539547:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561044992:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1786002610.551221:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984123 is committed 00010000:00010000:0.0:1786002610.551303:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417141 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002610.551315:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417141 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002610.551323:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417141 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002610.551329:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002610.551333:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417141 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002610.551340:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417141 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002610.551356:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002610.551360:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002610.551364:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417141 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002610.551370:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417141 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002611.018408:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002611.021229:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531020928 00000100:00100000:1.0:1786002611.021243:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531020928 00000100:00100000:1.0:1786002611.021390:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24176 00000100:00100000:1.0:1786002611.021401:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20943:x1872758531020928:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002611.021427:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002611.021447:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841714f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b071 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.021513:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417156 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.021527:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.021540:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002611.021591:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:1.0:1786002611.021594:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786002611.021613:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.021637:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841714f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b071 expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.021656:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417156 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b071 expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.021665:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002611.021667:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786002611.021670:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556be00, rc 0) 00000100:00100000:1.0:1786002611.021798:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20943:x1872758531020928:12345-192.168.203.49@tcp:101:dd.0 Request processed in 398us (3398us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002611.021806:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24176 00000100:00080000:3.0:1786002611.033867:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002611.034105:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002611.034182:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531021184 00000100:00100000:1.0:1786002611.034192:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531021184 00000100:00100000:1.0:1786002611.034253:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24177 00000100:00100000:1.0:1786002611.034262:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20943:x1872758531021184:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002611.034281:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002611.034284:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786002611.034311:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417156 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b071 expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034329:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002611.034335:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002611.034347:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841715d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b078 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034459:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417164 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034472:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417164 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034482:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417164 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034496:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841716b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034503:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841716b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034509:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841716b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034564:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578417172 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034573:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578417172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034581:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578417172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002611.034591:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ad:0x0]: returning size 5275648 00010000:00010000:1.0:1786002611.034671:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417164 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034693:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417164 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034699:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417164 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034705:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417164 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034711:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002611.034715:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417164 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034723:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417164 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034732:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002611.034735:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002611.034739:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417164 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034745:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417164 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034756:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841716b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034761:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841716b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034767:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841716b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034773:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002611.034776:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841716b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034781:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841716b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034787:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed245644300) 00010000:00010000:1.0:1786002611.034790:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002611.034793:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841716b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034798:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841716b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034834:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841715d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b078 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034875:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578417172 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b078 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002611.034884:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:1.0:1786002611.034887:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002611.034889:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed382166c00, rc 0) 00000100:00100000:1.0:1786002611.034952:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20943:x1872758531021184:12345-192.168.203.49@tcp:101:dd.0 Request processed in 690us (851us total) trans 4294984124 rc 0/0 00000100:00100000:1.0:1786002611.034959:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24177 00000100:00100000:2.0:1786002611.043142:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002611.043234:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531021440 00000100:00100000:0.0:1786002611.043245:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531021440 00000100:00100000:0.0:1786002611.043299:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24178 00000100:00100000:0.0:1786002611.043310:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20943:x1872758531021440:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:0.0:1786002611.043364:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002611.043391:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578417172 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b078 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002611.043410:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002611.043415:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002611.043598:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417180 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002611.043612:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417180 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002611.043621:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417180 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002611.043661:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984125 00000004:00010000:0.0:1786002611.043695:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be766312 reply state 00000000677b331a transno 4294984126 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417180 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002611.043707:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417180 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002611.043713:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002611.043715:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002611.043718:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002611.043806:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20943:x1872758531021440:12345-192.168.203.49@tcp:36:dd.0 Request processed in 497us (673us total) trans 4294984126 rc 0/0 00000100:00100000:0.0:1786002611.043817:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24178 00000020:00080000:0.0:1786002611.043822:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002611.117831:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002611.118108:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531021568 00000100:00100000:1.0:1786002611.118119:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531021568 00002000:00010000:1.0:1786002611.118181:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:1.0:1786002611.118186:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244be4700 with x1872758531021568 ext(0->18446744073709551615) 00002000:00010000:1.0:1786002611.118197:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244be4700. 00000100:00100000:1.0:1786002611.118232:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 23 00000100:00100000:1.0:1786002611.118243:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2411:x1872758531021568:12345-192.168.203.49@tcp:10:dd.0 00000100:00080000:3.0:1786002611.121401:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1786002611.123146:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786002611.123152:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1786002605 -> 1786002611 00002000:00010000:1.0:1786002611.123163:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786002611.123166:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1786002605 -> 1786002611 00002000:00010000:1.0:1786002611.123168:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1786002611.123280:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2411:x1872758531021568:12345-192.168.203.49@tcp:10:dd.0 Request processed in 5034us (5454us total) trans 4294969955 rc 0/0 00000100:00100000:1.0:1786002611.123289:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 23 00002000:00010000:1.0:1786002611.123293:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:1.0:1786002611.123296:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244be4700 with x1872758531021568 ext(0->18446744073709551615) 00002000:00010000:1.0:1786002611.123303:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244be4700. 00010000:00010000:3.0:1786002611.178084:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002611.562200:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561045120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002611.562271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002611.562389:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561045120 00000100:00100000:3.0:1786002611.562396:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561045120 00000100:00100000:3.0:1786002611.562455:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:3.0:1786002611.562466:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561045120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786002611.562492:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1786002611.562536:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561045120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002611.562543:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00080000:2.0:1786002611.562612:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002611.562646:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561045120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002611.562888:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002611.562898:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561045248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002611.562927:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002611.562952:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561045248 00000100:00100000:0.0:1786002611.562956:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561045248 00000100:00100000:0.0:1786002611.562987:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1786002611.562994:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561045248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786002611.563006:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1786002611.563036:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561045248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002611.563042:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1786002611.563097:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561045248:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1786002611.563174:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002611.563506:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561045504:0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.563536:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002611.563554:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561046016:0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.563574:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002611.563603:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561046528:0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.563625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002611.563641:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1786002611.563646:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561045632:0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.563669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002611.563784:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561046144:0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.563807:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002611.563822:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561046656:0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.563842:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002611.563887:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561045632 00000100:00100000:2.0:1786002611.563892:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561045632 00000100:00100000:2.0:1786002611.563924:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4087 00000100:00100000:2.0:1786002611.563932:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561045632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.563974:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561045632:12345-0@lo:400:kworker.0 Request processed in 42us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002611.563982:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4087 00000100:00100000:2.0:1786002611.564005:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561045504 00000100:00100000:2.0:1786002611.564009:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561045504 00000100:00100000:2.0:1786002611.564028:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561046016 00000100:00100000:2.0:1786002611.564030:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561046016 00000100:00100000:2.0:1786002611.564048:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561046528 00000100:00100000:2.0:1786002611.564052:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561046528 00000100:00100000:2.0:1786002611.564063:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561046144 00000100:00100000:2.0:1786002611.564065:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561046144 00000100:00100000:2.0:1786002611.564075:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561046656 00000100:00100000:2.0:1786002611.564078:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561046656 00000100:00100000:2.0:1786002611.564090:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1786002611.564096:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561045504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.564124:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561045504:12345-0@lo:400:kworker.0 Request processed in 28us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002611.564131:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1786002611.564143:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1786002611.564149:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561046016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.564188:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561046016:12345-0@lo:400:kworker.0 Request processed in 40us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002611.564194:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1786002611.564206:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1786002611.564212:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561046528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.564237:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561046528:12345-0@lo:400:kworker.0 Request processed in 26us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002611.564243:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1786002611.564347:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561045376:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.564380:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002611.564405:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561045888:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.564426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002611.564442:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561046400:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.564463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002611.564480:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786002611.564486:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561045760:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.564511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002611.564522:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561046272:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.564542:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002611.564568:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561046400 00000100:00100000:1.0:1786002611.564571:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561046400 00000100:00100000:1.0:1786002611.564608:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561046272 00000100:00100000:1.0:1786002611.564611:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561046272 00000100:00100000:1.0:1786002611.564631:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1786002611.564637:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561046400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.564672:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561046400:12345-0@lo:400:kworker.0 Request processed in 35us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002611.564780:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1786002611.564794:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1786002611.564800:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561046272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.564829:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561046272:12345-0@lo:400:kworker.0 Request processed in 30us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002611.564834:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1786002611.564877:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561045888 00000100:00100000:1.0:1786002611.564881:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561045888 00000100:00100000:1.0:1786002611.564904:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4088 00000100:00100000:1.0:1786002611.564910:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561045888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.564941:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561045888:12345-0@lo:400:kworker.0 Request processed in 31us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002611.564946:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4088 00000100:00100000:1.0:1786002611.564978:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561046272:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.564988:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561045888:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.564996:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561046400:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.565043:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561045632:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.565053:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561045504:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.565061:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561046016:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.565069:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561046528:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.565093:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561045760 00000100:00100000:1.0:1786002611.565096:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561045760 00000100:00100000:3.0:1786002611.565186:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561045376 00000100:00100000:3.0:1786002611.565191:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561045376 00000100:00100000:3.0:1786002611.565221:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:3.0:1786002611.565228:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561045376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002611.565281:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561045376:12345-0@lo:400:kworker.0 Request processed in 54us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002611.565287:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00080000:3.0:1786002611.565312:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786002611.565315:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786002611.565330:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561045376:0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.566754:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1786002611.566775:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561046144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.566832:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561046144:12345-0@lo:400:kworker.0 Request processed in 66us (3023us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002611.566889:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561046144:0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.566972:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1786002611.566981:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561046656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.567020:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561046656:12345-0@lo:400:kworker.0 Request processed in 41us (3177us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002611.567025:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1786002611.567041:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1786002611.567047:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561045760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002611.567077:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561045760:12345-0@lo:400:kworker.0 Request processed in 30us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002611.567083:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1786002611.567123:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561045760:0@lo:400:kworker.0 00000100:00100000:0.0:1786002611.572534:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561046656:0@lo:400:kworker.0 00000100:00100000:2.0:1786002611.582819:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00010000:00010000:3.0:1786002612.203867:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002613.098009:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002613.098028:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561046784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002613.098087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002613.098209:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561046784 00000100:00100000:3.0:1786002613.098216:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561046784 00000100:00100000:3.0:1786002613.098265:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4089 00000100:00100000:3.0:1786002613.098274:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561046784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002613.098308:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002613.098355:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561046784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002613.098362:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4089 00000100:00100000:0.0:1786002613.098738:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561046784:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786002613.226045:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002613.843644:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002613.843816:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531021696 00000100:00100000:1.0:1786002613.843825:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531021696 00002000:00100000:1.0:1786002613.843909:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed2423f9180 x1872758531021696/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:294/0 lens 488/0 e 0 to 0 dl 1786002624 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002613.843926:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2423f9180 with x1872758531021696 ext(0->4194303) 00002000:00010000:1.0:1786002613.843931:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2423f9180 00000100:00100000:1.0:1786002613.843957:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24 00000100:00100000:1.0:1786002613.843966:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758531021696:12345-192.168.203.49@tcp:4:dd.0 00000100:00080000:3.0:1786002613.845821:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002613.949270:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758531021696:12345-192.168.203.49@tcp:4:dd.0 Request processed in 105295us (105625us total) trans 4294969956 rc 0/0 00000100:00100000:2.0:1786002613.949283:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24 00002000:00100000:2.0:1786002613.949294:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed2423f9180 x1872758531021696/t4294969956(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:294/0 lens 488/448 e 0 to 0 dl 1786002624 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002613.949303:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2423f9180 with x1872758531021696 ext(0->4194303) 00002000:00010000:2.0:1786002613.949309:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2423f9180 00010000:00010000:3.0:1786002614.251698:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786002614.640159:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969956 is committed 00000100:00100000:0.0:1786002615.146164:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561046912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002615.146230:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002615.146866:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561046912 00000100:00100000:3.0:1786002615.146875:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561046912 00000100:00100000:1.0:1786002615.146930:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786002615.146941:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561047040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786002615.146951:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1786002615.146964:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561046912:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002615.146978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1786002615.146995:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 75986624 pending 0 free 3923525632 avail 3683565568 00000100:00100000:1.0:1786002615.147022:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561047040 00000100:00100000:1.0:1786002615.147028:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561047040 00000100:00100000:3.0:1786002615.147047:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561046912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002615.147056:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1786002615.147062:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1786002615.147071:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561047040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002615.147084:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 75986624 pending 0 free 3923525632 avail 3683565568 00000100:00100000:1.0:1786002615.147135:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561047040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002615.147142:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1786002615.147272:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561047040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002615.147359:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561046912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786002615.147418:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786002615.275827:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002615.644781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002615.644834:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002615.644936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002615.644962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002615.644985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002615.645010:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531022336 00000100:00100000:0.0:1786002615.645019:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531022336 00000100:00100000:0.0:1786002615.645071:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531022208 00000100:00100000:0.0:1786002615.645074:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531022208 00000100:00100000:0.0:1786002615.645097:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 548 00000100:00100000:0.0:1786002615.645107:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531022336:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002615.645166:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531022080 00000100:00100000:1.0:1786002615.645172:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531022080 00000100:00100000:0.0:1786002615.645181:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531022336:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002615.645190:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 548 00000100:00100000:0.0:1786002615.645209:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 549 00000100:00100000:1.0:1786002615.645213:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531021952 00000100:00100000:1.0:1786002615.645219:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531021952 00000100:00100000:0.0:1786002615.645219:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531022208:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002615.645248:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531022208:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 32us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002615.645250:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1001 00000100:00100000:0.0:1786002615.645260:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 549 00000100:00100000:1.0:1786002615.645265:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531022080:12345-192.168.203.49@tcp:400:kworker.0 00000100:00080000:0.0:1786002615.645281:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786002615.645286:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786002615.645289:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786002615.645291:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002615.645305:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531022080:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 43us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002615.645319:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1002 00000100:00100000:0.0:1786002615.645428:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758531021952:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002615.645458:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758531021952:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 33us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002615.645507:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531021824 00000100:00100000:3.0:1786002615.645512:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531021824 00000100:00100000:3.0:1786002615.645540:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 547 00000100:00100000:3.0:1786002615.645548:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531021824:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002615.645573:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531021824:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 27us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002615.645580:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 547 00000100:00100000:1.0:1786002615.650914:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1001 00000100:00100000:2.0:1786002615.658536:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786002615.658557:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561047168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002615.658621:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002615.660051:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561047168 00000100:00100000:1.0:1786002615.660063:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561047168 00000100:00100000:0.0:1786002615.660157:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1002 00000100:00100000:1.0:1786002615.660233:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4090 00000100:00100000:1.0:1786002615.660243:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561047168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786002615.660281:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:1.0:1786002615.660353:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561047168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002615.660359:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4090 00000100:00100000:0.0:1786002615.660751:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561047168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002616.021500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002616.021598:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531022592 00000100:00100000:1.0:1786002616.021607:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531022592 00000100:00100000:1.0:1786002616.021670:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5222 00000100:00100000:1.0:1786002616.021681:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20943:x1872758531022592:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:1.0:1786002616.021911:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984127 00000100:00100000:1.0:1786002616.022025:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:20943:x1872758531022592:12345-192.168.203.49@tcp:35:dd.0 Request processed in 345us (533us total) trans 4294984128 rc 0/0 00000100:00100000:1.0:1786002616.022033:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5222 00000020:00080000:1.0:1786002616.022038:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786002616.298207:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002616.682201:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561047680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002616.682271:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002616.682374:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561048192:0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.682374:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561047552:0@lo:400:kworker.0 00000100:00100000:3.0:1786002616.682402:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002616.682403:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002616.682420:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561048704:0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.682420:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561048064:0@lo:400:kworker.0 00000100:00100000:3.0:1786002616.682440:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002616.682476:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786002616.682483:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561049088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002616.682485:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561047552 00000100:00100000:0.0:1786002616.682490:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561047552 00000100:00100000:3.0:1786002616.682504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002616.682567:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561047296:0@lo:400:kworker.0 00000100:00100000:1.0:1786002616.682599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002616.682621:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872758561047808:0@lo:400:kworker.0 00000100:00100000:1.0:1786002616.682639:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002616.682654:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561048320:0@lo:400:kworker.0 00000100:00100000:1.0:1786002616.682673:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002616.682688:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561048832:0@lo:400:kworker.0 00000100:00100000:1.0:1786002616.682703:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002616.682718:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1786002616.682723:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561047424:0@lo:400:kworker.0 00000100:00100000:1.0:1786002616.682741:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002616.682753:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561047936:0@lo:400:kworker.0 00000100:00100000:1.0:1786002616.682770:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002616.682786:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561048448:0@lo:400:kworker.0 00000100:00100000:1.0:1786002616.682805:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002616.682819:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561048960:0@lo:400:kworker.0 00000100:00100000:1.0:1786002616.682834:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002616.682871:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561047296 00000100:00100000:1.0:1786002616.682875:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561047296 00000100:00100000:1.0:1786002616.682906:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1786002616.682914:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561047296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002616.682957:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561047296:12345-0@lo:400:kworker.0 Request processed in 44us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002616.682964:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1786002616.682990:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561048320 00000100:00100000:1.0:1786002616.682993:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561048320 00000100:00100000:1.0:1786002616.683012:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561048832 00000100:00100000:1.0:1786002616.683015:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561048832 00000100:00100000:1.0:1786002616.683034:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561048448 00000100:00100000:1.0:1786002616.683037:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561048448 00000100:00100000:1.0:1786002616.683049:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561048960 00000100:00100000:1.0:1786002616.683052:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561048960 00000100:00100000:1.0:1786002616.683068:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1786002616.683074:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561048320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002616.683103:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561048320:12345-0@lo:400:kworker.0 Request processed in 29us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002616.683112:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1786002616.683133:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1786002616.683139:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561048832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002616.683166:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561048832:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002616.684335:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561047936 00000100:00100000:0.0:1786002616.684341:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561047936 00000100:00100000:0.0:1786002616.684367:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4091 00000100:00100000:0.0:1786002616.684373:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561047552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.684415:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561047552:12345-0@lo:400:kworker.0 Request processed in 43us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002616.684421:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4091 00000100:00100000:0.0:1786002616.684435:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4092 00000100:00100000:0.0:1786002616.684440:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561047936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.684467:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561047936:12345-0@lo:400:kworker.0 Request processed in 27us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002616.684485:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4092 00000100:00100000:1.0:1786002616.684599:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:0.0:1786002616.689266:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1786002616.689292:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561048448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.689645:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561048448:12345-0@lo:400:kworker.0 Request processed in 366us (6838us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002616.689654:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1786002616.689675:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1786002616.689682:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561048960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.689710:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561048960:12345-0@lo:400:kworker.0 Request processed in 30us (6875us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002616.689716:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00080000:0.0:1786002616.689740:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002616.689761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002616.689797:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561048576:0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.689826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002616.692677:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561047552:0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.692736:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561048192 00000100:00100000:0.0:1786002616.692742:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561048192 00000100:00080000:0.0:1786002616.692772:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002616.692810:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561048704 00000100:00100000:0.0:1786002616.692813:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561048704 00000100:00080000:0.0:1786002616.692825:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002616.692836:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561047808 00000100:00100000:0.0:1786002616.692839:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561047808 00000100:00100000:0.0:1786002616.692865:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561047424 00000100:00100000:0.0:1786002616.692868:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561047424 00000100:00100000:0.0:1786002616.692879:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561048064 00000100:00100000:0.0:1786002616.692882:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561048064 00000100:00080000:0.0:1786002616.692892:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002616.692903:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561048576 00000100:00100000:0.0:1786002616.692905:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561048576 00000100:00080000:0.0:1786002616.692914:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002616.692927:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:0.0:1786002616.692935:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561048192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.693008:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561048192:12345-0@lo:400:kworker.0 Request processed in 73us (10605us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002616.693016:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:0.0:1786002616.693033:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1786002616.693039:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561048704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.693068:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561048704:12345-0@lo:400:kworker.0 Request processed in 30us (10628us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002616.693074:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1786002616.693084:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1786002616.693090:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872758561047808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.693126:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872758561047808:12345-0@lo:400:kworker.0 Request processed in 28us (10477us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002616.693132:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1786002616.693143:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1786002616.693149:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561047424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.693177:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561047424:12345-0@lo:400:kworker.0 Request processed in 28us (10435us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002616.693182:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1786002616.693194:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1786002616.693200:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561048064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.693230:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561048064:12345-0@lo:400:kworker.0 Request processed in 31us (3468us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002616.693236:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1786002616.693260:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561048064:0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.693277:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1786002616.693283:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561048576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.693310:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561048576:12345-0@lo:400:kworker.0 Request processed in 28us (3484us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002616.693316:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1786002616.693336:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561048576:0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.693420:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561047424:0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.693432:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561047936:0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.693443:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561048448:0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.693453:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561048960:0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.693462:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561047296:0@lo:400:kworker.0 00000100:00100000:0.0:1786002616.699152:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872758561047808:0@lo:400:kworker.0 00000100:00100000:2.0:1786002616.702926:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561047680 00000100:00100000:2.0:1786002616.702950:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561047680 00000100:00100000:2.0:1786002616.703011:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561049088 00000100:00100000:2.0:1786002616.703014:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561049088 00000100:00100000:3.0:1786002616.706770:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561048192:0@lo:400:kworker.0 00000100:00100000:3.0:1786002616.706829:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561048704:0@lo:400:kworker.0 00000100:00100000:3.0:1786002616.706980:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561048320:0@lo:400:kworker.0 00000100:00100000:3.0:1786002616.706991:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561048832:0@lo:400:kworker.0 00000001:00080000:3.0:1786002616.717380:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984128 is committed 00010000:00010000:3.0:1786002616.717412:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417180 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002616.717428:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417180 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002616.717435:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417180 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002616.717459:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002616.717464:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417180 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002616.717695:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417180 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002616.717716:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:3.0:1786002616.717719:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002616.717723:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417180 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002616.717730:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af578417180 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002616.719038:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1786002616.719062:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561047680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002616.719094:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002616.719194:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561047680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (36922us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002616.719278:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561047680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002616.719283:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1786002616.719293:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561049088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786002616.719304:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1786002616.719347:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561049088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (36841us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002616.719353:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:3.0:1786002616.722083:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561049088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002616.727765:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1786002617.053143:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002617.053259:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531022720 00000100:00100000:0.0:1786002617.053269:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531022720 00000100:00100000:0.0:1786002617.053422:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24179 00000100:00100000:0.0:1786002617.053433:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20947:x1872758531022720:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002617.053453:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002617.053484:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578417187 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b07f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002617.053540:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af57841718e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002617.053557:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af57841718e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002617.053569:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af57841718e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002617.053611:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:0.0:1786002617.053614:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786002617.053631:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af57841718e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002617.053652:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578417187 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b07f expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002617.053668:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af57841718e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b07f expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002617.053676:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002617.053679:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786002617.053682:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717000, rc 0) 00000100:00100000:0.0:1786002617.053738:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20947:x1872758531022720:12345-192.168.203.49@tcp:101:dd.0 Request processed in 307us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002617.053745:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24179 00000100:00080000:2.0:1786002617.058617:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786002617.062976:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002617.063111:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531022976 00000100:00100000:1.0:1786002617.063153:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531022976 00000100:00100000:1.0:1786002617.063214:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24180 00000100:00100000:1.0:1786002617.063232:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20947:x1872758531022976:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002617.063253:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002617.063256:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786002617.063281:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af57841718e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b07f expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063302:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002617.063307:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002617.063319:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578417195 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b086 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063421:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841719c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063432:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841719c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063442:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841719c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063455:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063463:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063484:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063534:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063543:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063550:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002617.063559:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ad:0x0]: returning size 8339456 00010000:00010000:1.0:1786002617.063631:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841719c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063639:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841719c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063646:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841719c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063653:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841719c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063660:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002617.063664:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841719c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063672:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841719c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063681:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002617.063684:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002617.063688:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841719c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063694:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841719c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063705:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063711:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063718:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063723:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002617.063726:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063732:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063738:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed245644e00) 00010000:00010000:1.0:1786002617.063741:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002617.063744:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063750:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063784:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed382166c00/0x7cee4af578417195 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b086 expref: 18 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063809:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b086 expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002617.063816:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:1.0:1786002617.063819:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002617.063821:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b000, rc 0) 00000100:00100000:1.0:1786002617.063915:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20947:x1872758531022976:12345-192.168.203.49@tcp:101:dd.0 Request processed in 684us (946us total) trans 4294984129 rc 0/0 00000100:00100000:1.0:1786002617.063921:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24180 00000100:00100000:3.0:1786002617.088260:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002617.088341:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531023232 00000100:00100000:0.0:1786002617.088351:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531023232 00000100:00100000:0.0:1786002617.088408:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24181 00000100:00100000:0.0:1786002617.088418:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20947:x1872758531023232:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:0.0:1786002617.088481:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002617.088506:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b086 expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002617.088523:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002617.088528:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002617.088674:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af5784171b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002617.088688:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af5784171b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002617.088697:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af5784171b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002617.088731:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984130 00000004:00010000:0.0:1786002617.088749:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000643c8226 reply state 000000008edd3367 transno 4294984131 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af5784171b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002617.088759:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af5784171b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002617.088765:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002617.088768:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002617.088770:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002617.089049:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20947:x1872758531023232:12345-192.168.203.49@tcp:36:dd.0 Request processed in 631us (795us total) trans 4294984131 rc 0/0 00000100:00100000:0.0:1786002617.089057:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24181 00000020:00080000:0.0:1786002617.089062:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786002617.323274:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002617.400744:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002617.400842:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531023360 00000100:00100000:2.0:1786002617.400877:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531023360 00002000:00010000:2.0:1786002617.400931:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1786002617.400935:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2465fed80 with x1872758531023360 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002617.400947:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2465fed80. 00000100:00100000:2.0:1786002617.400982:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 25 00000100:00100000:2.0:1786002617.400993:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531023360:12345-192.168.203.49@tcp:10:dd.0 00002000:00010000:2.0:1786002617.403732:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002617.403739:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1786002611 -> 1786002617 00002000:00010000:2.0:1786002617.403742:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002617.403744:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1786002611 -> 1786002617 00002000:00010000:2.0:1786002617.403746:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002617.403816:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531023360:12345-192.168.203.49@tcp:10:dd.0 Request processed in 2822us (3077us total) trans 4294969957 rc 0/0 00000100:00100000:2.0:1786002617.403829:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 25 00002000:00010000:2.0:1786002617.403833:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1786002617.403836:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2465fed80 with x1872758531023360 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002617.403841:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2465fed80. 00000100:00080000:0.0:1786002617.403920:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002618.218082:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786002618.218112:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561049216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786002618.218180:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002618.218468:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561049216 00000100:00100000:3.0:1786002618.218476:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561049216 00000100:00100000:3.0:1786002618.218529:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4093 00000100:00100000:3.0:1786002618.218539:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561049216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002618.218738:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002618.218792:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561049216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 254us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002618.218799:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4093 00000100:00100000:1.0:1786002618.218890:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561049216:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786002618.346372:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002619.372029:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002620.241955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002620.242053:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531023488 00000100:00100000:2.0:1786002620.242062:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531023488 00002000:00100000:2.0:1786002620.242135:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed2423f9500 x1872758531023488/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:301/0 lens 488/0 e 0 to 0 dl 1786002631 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002620.242146:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2423f9500 with x1872758531023488 ext(0->4194303) 00002000:00010000:2.0:1786002620.242152:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2423f9500 00000100:00100000:2.0:1786002620.242181:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 26 00000100:00100000:2.0:1786002620.242191:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531023488:12345-192.168.203.49@tcp:4:dd.0 00000100:00080000:0.0:1786002620.245180:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002620.266100:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002620.266125:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561049344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002620.266200:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002620.266920:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561049344 00000100:00100000:1.0:1786002620.266929:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561049344 00000100:00100000:1.0:1786002620.266993:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00080000:0.0:1786002620.267180:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002620.267205:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561049344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786002620.267230:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 80254656 pending 4218880 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002620.267284:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561049344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 283us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002620.267295:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1786002620.267382:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561049344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002620.269955:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561049472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002620.270008:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002620.274358:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561049472 00000100:00100000:2.0:1786002620.274370:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561049472 00000100:00100000:2.0:1786002620.274435:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:2.0:1786002620.274444:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561049472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786002620.274467:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 80254656 pending 4218880 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002620.274539:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561049472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (4530us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002620.274547:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1786002620.276940:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561049472:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1786002620.287605:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002620.330595:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758531023488:12345-192.168.203.49@tcp:4:dd.0 Request processed in 88396us (88639us total) trans 4294969958 rc 0/0 00000100:00100000:0.0:1786002620.330608:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 26 00002000:00100000:0.0:1786002620.330627:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed2423f9500 x1872758531023488/t4294969958(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:301/0 lens 488/448 e 0 to 0 dl 1786002631 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002620.330637:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2423f9500 with x1872758531023488 ext(0->4194303) 00002000:00010000:0.0:1786002620.330643:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2423f9500 00010000:00010000:3.0:1786002620.394167:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002620.756602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002620.756647:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002620.756690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002620.756790:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531024000 00000100:00100000:2.0:1786002620.756799:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531024000 00000100:00100000:2.0:1786002620.756882:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 554 00000100:00100000:2.0:1786002620.756906:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531024000:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002620.756976:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531024000:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 86us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002620.756983:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 554 00000100:00100000:1.0:1786002620.757564:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531023744 00000100:00100000:1.0:1786002620.757569:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531023744 00000100:00100000:1.0:1786002620.757615:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1009 00000100:00100000:1.0:1786002620.757622:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531023744:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002620.757664:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531023744:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 42us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002620.757671:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1009 00000100:00080000:0.0:1786002620.757931:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786002620.757936:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002620.771211:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531023616 00000100:00100000:3.0:1786002620.771224:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531023616 00000100:00100000:3.0:1786002620.771289:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 549 00000100:00100000:3.0:1786002620.771299:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531023616:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002620.771508:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002620.771683:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531023616:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 384us (14990us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002620.771690:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 549 00000100:00100000:0.0:1786002620.778231:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531023872 00000100:00100000:0.0:1786002620.778245:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531023872 00000100:00100000:0.0:1786002620.778351:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1010 00000100:00100000:0.0:1786002620.778362:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531023872:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002620.778439:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531023872:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 79us (6931us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002620.778447:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1010 00000100:00080000:3.0:1786002620.779061:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002620.782510:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561049600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002620.782577:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002620.785898:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561049600 00000100:00100000:0.0:1786002620.785911:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561049600 00000100:00100000:0.0:1786002620.785967:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4094 00000100:00100000:0.0:1786002620.785976:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561049600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002620.786012:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:0.0:1786002620.786789:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561049600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 813us (4211us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002620.786798:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4094 00000100:00100000:3.0:1786002620.798796:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561049600:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1786002621.418163:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002621.802813:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002621.802834:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561049728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002621.802911:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002621.802951:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561049728 00000100:00100000:3.0:1786002621.802958:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561049728 00000100:00100000:3.0:1786002621.803005:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:3.0:1786002621.803015:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561049728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786002621.803042:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1786002621.803079:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561049728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002621.803098:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00080000:3.0:1786002621.803120:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002621.803177:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561049728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002621.803633:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561050240:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.803670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002621.803700:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561050752:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.803723:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002621.803737:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561051264:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.803752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002621.803769:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1786002621.803774:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561050112:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.803794:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002621.803808:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561050624:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.803823:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002621.803835:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561051136:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.803878:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002621.803904:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561050752 00000100:00100000:1.0:1786002621.803909:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561050752 00000100:00100000:1.0:1786002621.803936:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561051264 00000100:00100000:1.0:1786002621.803939:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561051264 00000100:00100000:1.0:1786002621.803964:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1786002621.803971:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561050752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.804006:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561050752:12345-0@lo:400:kworker.0 Request processed in 35us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002621.804012:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1786002621.804023:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1786002621.804029:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561051264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.804052:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561051264:12345-0@lo:400:kworker.0 Request processed in 23us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002621.804057:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1786002621.804093:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561050112 00000100:00100000:1.0:1786002621.804097:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561050112 00000100:00100000:1.0:1786002621.804121:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4095 00000100:00100000:1.0:1786002621.804127:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561050112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.804157:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561050112:12345-0@lo:400:kworker.0 Request processed in 31us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002621.804163:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4095 00000100:00100000:1.0:1786002621.804181:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561050240 00000100:00100000:1.0:1786002621.804185:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561050240 00000100:00100000:1.0:1786002621.804210:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561050624 00000100:00100000:1.0:1786002621.804213:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561050624 00000100:00100000:1.0:1786002621.804231:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561051136 00000100:00100000:1.0:1786002621.804233:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561051136 00000100:00100000:1.0:1786002621.804261:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1786002621.804267:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561050240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.804297:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561050240:12345-0@lo:400:kworker.0 Request processed in 30us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002621.804302:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1786002621.804313:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:1.0:1786002621.804318:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561050624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.804342:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561050624:12345-0@lo:400:kworker.0 Request processed in 24us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002621.804348:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:1.0:1786002621.804358:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1786002621.804363:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561051136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.804384:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561051136:12345-0@lo:400:kworker.0 Request processed in 22us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002621.804390:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1786002621.804573:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561050112:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.804583:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561050624:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.804590:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561051136:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.804598:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561050240:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.804605:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561050752:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.804612:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561051264:0@lo:400:kworker.0 00000100:00100000:0.0:1786002621.804626:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561049984:0@lo:400:kworker.0 00000100:00100000:0.0:1786002621.804654:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002621.804684:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561050496:0@lo:400:kworker.0 00000100:00100000:3.0:1786002621.804694:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561049856:0@lo:400:kworker.0 00000100:00100000:0.0:1786002621.804705:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002621.804721:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561051008:0@lo:400:kworker.0 00000100:00100000:3.0:1786002621.804722:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002621.804739:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002621.804745:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561050368:0@lo:400:kworker.0 00000100:00100000:0.0:1786002621.804762:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561049856 00000100:00100000:3.0:1786002621.804765:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002621.804765:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561049856 00000100:00100000:3.0:1786002621.804778:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561050880:0@lo:400:kworker.0 00000100:00100000:0.0:1786002621.804792:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:3.0:1786002621.804798:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002621.804798:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561049856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002621.804812:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561051392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002621.804825:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561049856:12345-0@lo:400:kworker.0 Request processed in 28us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002621.804829:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002621.804831:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:3.0:1786002621.804869:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561049856:0@lo:400:kworker.0 00000100:00100000:0.0:1786002621.804876:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561050880 00000100:00100000:0.0:1786002621.804879:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561050880 00000100:00100000:3.0:1786002621.804889:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561050368 00000100:00100000:3.0:1786002621.804892:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561050368 00000100:00100000:0.0:1786002621.804901:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1786002621.804907:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561050880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002621.804913:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4096 00000100:00100000:3.0:1786002621.804918:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561050368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002621.804938:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561050880:12345-0@lo:400:kworker.0 Request processed in 31us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002621.804942:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561050368:12345-0@lo:400:kworker.0 Request processed in 25us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002621.804944:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1786002621.804948:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4096 00000100:00100000:3.0:1786002621.804964:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561051392 00000100:00100000:3.0:1786002621.804968:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561051392 00000100:00100000:3.0:1786002621.804987:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1786002621.804992:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561051392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786002621.805004:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1786002621.805034:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561051392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002621.805040:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00080000:3.0:1786002621.805056:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786002621.805059:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002621.805074:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561050368:0@lo:400:kworker.0 00000100:00100000:3.0:1786002621.805094:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561050880:0@lo:400:kworker.0 00000100:00100000:3.0:1786002621.805107:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561051392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002621.805549:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561049984 00000100:00100000:1.0:1786002621.805554:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561049984 00000100:00100000:1.0:1786002621.805588:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561050496 00000100:00100000:1.0:1786002621.805591:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561050496 00000100:00100000:1.0:1786002621.805617:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561051008 00000100:00100000:1.0:1786002621.805620:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561051008 00000100:00100000:1.0:1786002621.805633:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:1.0:1786002621.805639:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561049984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.805678:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561049984:12345-0@lo:400:kworker.0 Request processed in 39us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002621.805683:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:1.0:1786002621.805695:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:1.0:1786002621.805701:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561050496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.805724:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561050496:12345-0@lo:400:kworker.0 Request processed in 24us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002621.805730:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:1.0:1786002621.805740:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1786002621.805746:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561051008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.805770:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561051008:12345-0@lo:400:kworker.0 Request processed in 24us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002621.805775:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1786002621.805808:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561049984:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.805819:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561050496:0@lo:400:kworker.0 00000100:00100000:1.0:1786002621.805828:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561051008:0@lo:400:kworker.0 00000100:00080000:3.0:1786002621.805919:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002622.075452:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002622.075979:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531024256 00000100:00100000:3.0:1786002622.075989:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531024256 00000100:00100000:3.0:1786002622.076059:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5223 00000100:00100000:3.0:1786002622.076070:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20947:x1872758531024256:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:3.0:1786002622.076294:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984132 00000100:00100000:3.0:1786002622.076389:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:20947:x1872758531024256:12345-192.168.203.49@tcp:35:dd.0 Request processed in 321us (946us total) trans 4294984133 rc 0/0 00000100:00100000:3.0:1786002622.076397:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5223 00000020:00080000:3.0:1786002622.076401:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1786002622.076471:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1786002622.083381:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984133 is committed 00010000:00010000:0.0:1786002622.083460:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af5784171b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002622.083473:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af5784171b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002622.083481:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af5784171b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002622.083488:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002622.083493:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af5784171b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002622.083500:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af5784171b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002622.083526:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002622.083530:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002622.083534:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af5784171b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002622.083541:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af5784171b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002622.443510:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786002622.827489:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969958 is committed 00000100:00100000:0.0:1786002623.114784:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002623.114875:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531024384 00000100:00100000:1.0:1786002623.114891:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531024384 00000100:00100000:1.0:1786002623.114951:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24182 00000100:00100000:1.0:1786002623.114960:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20951:x1872758531024384:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002623.114981:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002623.115000:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784171bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b08d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.115053:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784171c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.115065:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784171c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.115087:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784171c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002623.115126:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:1.0:1786002623.115130:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786002623.115146:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784171c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.115167:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784171bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b08d expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.115182:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784171c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b08d expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.115190:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002623.115193:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786002623.115196:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a800, rc 0) 00000100:00100000:1.0:1786002623.115254:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20951:x1872758531024384:12345-192.168.203.49@tcp:101:dd.0 Request processed in 295us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002623.115261:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24182 00000100:00100000:2.0:1786002623.134739:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002623.141085:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531024640 00000100:00100000:1.0:1786002623.141104:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531024640 00000100:00100000:1.0:1786002623.141179:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24183 00000100:00100000:1.0:1786002623.141188:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20951:x1872758531024640:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002623.141206:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002623.141209:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786002623.141231:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784171c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b08d expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.141249:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002623.141253:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002623.141272:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784171cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b094 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.141652:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.141667:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.141676:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.141703:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.141711:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.141718:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.141769:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af5784171e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.141778:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af5784171e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.141785:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af5784171e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002623.141795:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ad:0x0]: returning size 6881280 00010000:00010000:1.0:1786002623.142005:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171d4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142013:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171d4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142020:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142027:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142033:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002623.142038:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142045:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171d4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142055:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002623.142058:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002623.142062:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171d4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142068:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784171d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142090:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142105:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142111:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142116:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002623.142118:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142123:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142129:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed245644e00) 00010000:00010000:1.0:1786002623.142135:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002623.142138:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142143:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784171db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142185:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af5784171cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b094 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142200:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af5784171e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b094 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002623.142212:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:1.0:1786002623.142214:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002623.142216:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556be00, rc 0) 00000100:00100000:1.0:1786002623.142283:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20951:x1872758531024640:12345-192.168.203.49@tcp:101:dd.0 Request processed in 1095us (7551us total) trans 4294984134 rc 0/0 00000100:00100000:1.0:1786002623.143037:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24183 00000100:00100000:3.0:1786002623.152496:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002623.152576:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531024896 00000100:00100000:2.0:1786002623.152585:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531024896 00000100:00100000:2.0:1786002623.152637:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24184 00000100:00100000:2.0:1786002623.152647:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20951:x1872758531024896:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:2.0:1786002623.152706:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002623.152730:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af5784171e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b094 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002623.152749:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002623.152753:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002623.153275:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784171f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002623.153389:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784171f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002623.153402:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784171f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002623.153452:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984135 00000004:00010000:2.0:1786002623.153477:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f2fa609 reply state 00000000c2eb098e transno 4294984136 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784171f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002623.153490:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784171f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002623.153498:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002623.153500:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002623.153503:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002623.153587:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20951:x1872758531024896:12345-192.168.203.49@tcp:36:dd.0 Request processed in 940us (1097us total) trans 4294984136 rc 0/0 00000100:00100000:2.0:1786002623.153594:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24184 00000020:00080000:2.0:1786002623.153599:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002623.340239:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561051520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002623.340305:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002623.340501:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561051520 00000100:00100000:2.0:1786002623.340510:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561051520 00000100:00100000:2.0:1786002623.340556:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4097 00000100:00100000:2.0:1786002623.340565:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561051520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786002623.340594:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:2.0:1786002623.340650:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561051520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002623.340658:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4097 00000100:00100000:1.0:1786002623.340827:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561051520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786002623.375260:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002623.375441:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531025024 00000100:00100000:2.0:1786002623.375450:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531025024 00002000:00010000:2.0:1786002623.375510:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1786002623.375515:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455f0700 with x1872758531025024 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002623.375526:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2455f0700. 00000100:00100000:2.0:1786002623.375557:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 27 00000100:00100000:2.0:1786002623.375569:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531025024:12345-192.168.203.49@tcp:10:dd.0 00000100:00080000:0.0:1786002623.378673:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1786002623.393212:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002623.393222:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1786002617 -> 1786002623 00002000:00010000:2.0:1786002623.393225:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002623.393227:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1786002617 -> 1786002623 00002000:00010000:2.0:1786002623.393229:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002623.394267:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531025024:12345-192.168.203.49@tcp:10:dd.0 Request processed in 18693us (19010us total) trans 4294969959 rc 0/0 00000100:00100000:2.0:1786002623.394278:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 27 00002000:00010000:2.0:1786002623.395380:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1786002623.395387:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455f0700 with x1872758531025024 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002623.395396:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2455f0700. 00010000:00010000:3.0:1786002623.469134:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002624.490088:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002625.386088:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002625.386110:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561051648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002625.386185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002625.386217:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561051648 00000100:00100000:2.0:1786002625.386225:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561051648 00000100:00100000:2.0:1786002625.386293:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1786002625.386303:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561051648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786002625.386328:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 76035776 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002625.386376:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561051648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002625.386383:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00080000:2.0:1786002625.386404:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002625.386436:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561051648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002625.394538:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561051776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786002625.394605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002625.394759:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561051776 00000100:00100000:1.0:1786002625.394766:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561051776 00000100:00100000:1.0:1786002625.394824:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1786002625.394833:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37c0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561051776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002625.394880:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 188416 granted 76035776 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002625.394924:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37c0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561051776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002625.394932:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1786002625.395162:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561051776:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1786002625.397753:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786002625.514103:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002625.877140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002625.877186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002625.877222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002625.877304:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531025664 00000100:00100000:1.0:1786002625.877308:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531025152 00000100:00100000:0.0:1786002625.877313:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531025664 00000100:00100000:1.0:1786002625.877315:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531025152 00000100:00100000:1.0:1786002625.877367:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 551 00000100:00100000:0.0:1786002625.877374:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 558 00000100:00100000:1.0:1786002625.877380:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531025152:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002625.877389:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531025664:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002625.877452:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531025664:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 68us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002625.877461:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 558 00000100:00100000:2.0:1786002625.877473:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531025408 00000100:00100000:2.0:1786002625.877478:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531025408 00000100:00100000:2.0:1786002625.877522:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1017 00000100:00100000:2.0:1786002625.877531:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531025408:12345-192.168.203.49@tcp:400:kworker.0 00000100:00080000:3.0:1786002625.877596:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786002625.877601:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002625.882326:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531025152:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 4940us (5183us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002625.882340:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 551 00000100:00100000:2.0:1786002625.890023:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531025408:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 12482us (12825us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002625.890036:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1017 00000100:00100000:1.0:1786002625.893743:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002625.893829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002625.895830:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531025536 00000100:00100000:3.0:1786002625.895840:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531025536 00000100:00100000:3.0:1786002625.895944:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 559 00000100:00100000:3.0:1786002625.895955:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531025536:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002625.896022:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531025536:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 68us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002625.896030:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 559 00000100:00080000:0.0:1786002625.896421:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002625.898030:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786002625.898045:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561051904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002625.898108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002625.898201:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561051904 00000100:00100000:3.0:1786002625.898207:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561051904 00000100:00100000:3.0:1786002625.898242:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4098 00000100:00100000:3.0:1786002625.898249:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561051904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786002625.898275:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:3.0:1786002625.898316:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561051904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002625.898323:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4098 00000100:00100000:3.0:1786002625.898358:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561051904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002625.898773:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531025280 00000100:00100000:2.0:1786002625.898778:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531025280 00000100:00100000:2.0:1786002625.898875:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1018 00000100:00100000:2.0:1786002625.898884:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531025280:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002625.898940:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531025280:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 58us (5204us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002625.898947:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1018 00000100:00080000:0.0:1786002625.903559:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786002626.542460:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002626.831769:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002626.831841:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531025792 00000100:00100000:0.0:1786002626.831888:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531025792 00002000:00100000:0.0:1786002626.831937:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed243e17800 x1872758531025792/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:307/0 lens 488/0 e 0 to 0 dl 1786002637 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002626.831948:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed243e17800 with x1872758531025792 ext(0->4194303) 00002000:00010000:0.0:1786002626.831954:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed243e17800 00000100:00100000:0.0:1786002626.831985:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 28 00000100:00100000:0.0:1786002626.831993:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531025792:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:0.0:1786002626.922188:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561052288:0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.922253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002626.922303:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561052800:0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.922324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002626.922345:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561053312:0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.922362:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002626.922384:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1786002626.922390:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561052160:0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.922409:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002626.922424:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561052672:0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.922443:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002626.922470:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561053184:0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.922490:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002626.922521:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561052288 00000100:00100000:0.0:1786002626.922528:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561052288 00000100:00100000:0.0:1786002626.922587:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4099 00000100:00100000:0.0:1786002626.922596:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561052288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.922648:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561052288:12345-0@lo:400:kworker.0 Request processed in 53us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002626.922654:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4099 00000100:00100000:0.0:1786002626.922676:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561052800 00000100:00100000:0.0:1786002626.922679:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561052800 00000100:00100000:0.0:1786002626.922704:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561053312 00000100:00100000:0.0:1786002626.922706:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561053312 00000100:00100000:0.0:1786002626.922718:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561052160 00000100:00100000:0.0:1786002626.922720:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561052160 00000100:00100000:0.0:1786002626.922728:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561052672 00000100:00100000:0.0:1786002626.922730:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561052672 00000100:00100000:0.0:1786002626.922739:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561053184 00000100:00100000:0.0:1786002626.922741:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561053184 00000100:00100000:0.0:1786002626.922751:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:0.0:1786002626.922756:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561052800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.922783:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561052800:12345-0@lo:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002626.922788:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:0.0:1786002626.922798:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1786002626.922805:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561053312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.922827:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561053312:12345-0@lo:400:kworker.0 Request processed in 23us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002626.922832:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1786002626.922843:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1786002626.922871:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561052160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.922897:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561052160:12345-0@lo:400:kworker.0 Request processed in 49us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002626.922903:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1786002626.922915:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1786002626.922921:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561052672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.922945:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561052672:12345-0@lo:400:kworker.0 Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002626.922951:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1786002626.922961:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1786002626.922967:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561053184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.922988:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561053184:12345-0@lo:400:kworker.0 Request processed in 22us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002626.922993:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00080000:0.0:1786002626.923017:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786002626.923020:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002626.923059:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561052160:0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.923069:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561052672:0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.923076:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561053184:0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.923083:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561052288:0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.923090:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561052800:0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.923097:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561053312:0@lo:400:kworker.0 00000100:00100000:1.0:1786002626.924582:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872758561052416:0@lo:400:kworker.0 00000100:00100000:1.0:1786002626.924632:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002626.924634:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002626.924646:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561053696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002626.924669:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561052928:0@lo:400:kworker.0 00000100:00100000:2.0:1786002626.924695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002626.924706:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002626.924735:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561053440:0@lo:400:kworker.0 00000100:00100000:2.0:1786002626.924743:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561053696 00000100:00100000:2.0:1786002626.924748:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561053696 00000100:00100000:1.0:1786002626.924756:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002626.924779:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1786002626.924786:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561052032:0@lo:400:kworker.0 00000100:00100000:2.0:1786002626.924798:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1786002626.924809:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561053696:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002626.924817:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1786002626.924836:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1786002626.924845:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561052544:0@lo:400:kworker.0 00000100:00100000:2.0:1786002626.924906:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561053696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002626.924907:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002626.924917:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00080000:2.0:1786002626.924940:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002626.924963:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561053696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002626.925124:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561052928 00000100:00100000:0.0:1786002626.925128:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561052928 00000100:00100000:0.0:1786002626.925150:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561053440 00000100:00100000:0.0:1786002626.925153:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561053440 00000100:00100000:0.0:1786002626.925171:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1786002626.925177:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561052928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.925209:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561052928:12345-0@lo:400:kworker.0 Request processed in 32us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002626.925215:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1786002626.925226:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1786002626.925232:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561053440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.925253:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561053440:12345-0@lo:400:kworker.0 Request processed in 22us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002626.925258:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1786002626.925274:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561052416 00000100:00100000:0.0:1786002626.925277:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561052416 00000100:00100000:0.0:1786002626.925298:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1786002626.925303:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872758561052416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.928523:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872758561052416:12345-0@lo:400:kworker.0 Request processed in 3214us (3887us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002626.928532:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1786002626.928596:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561052032 00000100:00100000:0.0:1786002626.928604:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561052032 00000100:00100000:0.0:1786002626.928641:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1786002626.928649:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561052032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.928693:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561052032:12345-0@lo:400:kworker.0 Request processed in 44us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002626.928699:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1786002626.930212:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561053056:0@lo:400:kworker.0 00000100:00100000:1.0:1786002626.930250:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002626.930270:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561053568:0@lo:400:kworker.0 00000100:00100000:1.0:1786002626.930294:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002626.930319:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561053056 00000100:00100000:1.0:1786002626.930325:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561053056 00000100:00100000:1.0:1786002626.930354:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561053568 00000100:00100000:1.0:1786002626.930357:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561053568 00000100:00100000:1.0:1786002626.930377:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1786002626.930384:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561053056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002626.930420:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561053056:12345-0@lo:400:kworker.0 Request processed in 37us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002626.930426:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1786002626.930440:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1786002626.930446:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561053568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002626.930471:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561053568:12345-0@lo:400:kworker.0 Request processed in 25us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002626.930477:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1786002626.931558:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561053568:0@lo:400:kworker.0 00000100:00100000:1.0:1786002626.931650:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872758561052416:0@lo:400:kworker.0 00000100:00100000:1.0:1786002626.931662:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561052928:0@lo:400:kworker.0 00000100:00100000:1.0:1786002626.931676:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561053440:0@lo:400:kworker.0 00000100:00100000:1.0:1786002626.931704:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561052032:0@lo:400:kworker.0 00000100:00100000:1.0:1786002626.931714:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561053056:0@lo:400:kworker.0 00000100:00080000:2.0:1786002626.932091:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002626.932106:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561053824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002626.932142:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002626.932176:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561053824 00000100:00100000:2.0:1786002626.932181:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561053824 00000100:00100000:2.0:1786002626.932209:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1786002626.932215:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561053824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002626.932233:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002626.932270:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561053824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002626.932276:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1786002626.932319:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561053824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002626.932349:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561052544 00000100:00100000:2.0:1786002626.932353:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561052544 00000100:00100000:2.0:1786002626.932380:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4100 00000100:00100000:2.0:1786002626.932386:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561052544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002626.932424:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561052544:12345-0@lo:400:kworker.0 Request processed in 38us (7521us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002626.932430:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4100 00000100:00100000:1.0:1786002626.934785:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561052544:0@lo:400:kworker.0 00000100:00100000:0.0:1786002626.946324:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758531025792:12345-192.168.203.49@tcp:4:dd.0 Request processed in 114313us (114544us total) trans 4294969960 rc 0/0 00000100:00100000:0.0:1786002626.946338:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 28 00002000:00100000:0.0:1786002626.946349:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed243e17800 x1872758531025792/t4294969960(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:307/0 lens 488/448 e 0 to 0 dl 1786002637 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002626.946360:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed243e17800 with x1872758531025792 ext(0->4194303) 00002000:00010000:0.0:1786002626.946366:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed243e17800 00010000:00010000:3.0:1786002627.563279:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002628.118453:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002628.119754:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531026048 00000100:00100000:3.0:1786002628.119766:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531026048 00000100:00080000:2.0:1786002628.119935:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786002628.119979:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5224 00000100:00100000:3.0:1786002628.119992:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7ff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20951:x1872758531026048:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:3.0:1786002628.120197:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984137 00000100:00100000:3.0:1786002628.120308:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7ff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:20951:x1872758531026048:12345-192.168.203.49@tcp:35:dd.0 Request processed in 318us (1864us total) trans 4294984138 rc 0/0 00000100:00100000:3.0:1786002628.129113:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5224 00000020:00080000:3.0:1786002628.129124:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002628.458167:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561053952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002628.458230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002628.475001:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561053952 00000100:00100000:2.0:1786002628.475015:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561053952 00000100:00100000:2.0:1786002628.475091:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4101 00000100:00100000:2.0:1786002628.475101:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561053952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786002628.475133:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:2.0:1786002628.475213:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561053952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (16982us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002628.475220:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4101 00000100:00100000:1.0:1786002628.475391:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561053952:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786002628.586505:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786002628.972616:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984138 is committed 00010000:00010000:0.0:1786002628.972736:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784171f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002628.972748:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784171f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002628.972755:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784171f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002628.972762:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002628.972767:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784171f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002628.972775:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784171f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002628.972792:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002628.972795:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002628.972799:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784171f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002628.972804:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784171f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002628.974098:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969960 is committed 00000100:00100000:2.0:1786002629.155241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002629.155332:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531026176 00000100:00100000:0.0:1786002629.155341:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531026176 00000100:00100000:0.0:1786002629.155404:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24185 00000100:00100000:0.0:1786002629.155413:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20955:x1872758531026176:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002629.155435:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002629.155454:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af5784171f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b09b expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.155519:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784171fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.155532:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784171fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.155542:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784171fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002629.155583:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:0.0:1786002629.155586:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786002629.155604:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784171fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.155625:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af5784171f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b09b expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.155652:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784171fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b09b expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.155660:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002629.155663:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786002629.155666:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717200, rc 0) 00000100:00100000:0.0:1786002629.155727:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20955:x1872758531026176:12345-192.168.203.49@tcp:101:dd.0 Request processed in 316us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002629.155734:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24185 00000100:00100000:2.0:1786002629.177347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002629.177482:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531026432 00000100:00100000:0.0:1786002629.177493:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531026432 00000100:00100000:0.0:1786002629.177552:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24186 00000100:00100000:0.0:1786002629.177561:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20955:x1872758531026432:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002629.177580:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002629.177583:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786002629.177605:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af5784171fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b09b expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.177624:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002629.177629:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002629.177649:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417205 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0a2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.177753:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af57841720c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.177765:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af57841720c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.177774:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af57841720c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.177787:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417213 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.177795:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417213 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.177802:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417213 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.177903:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af57841721a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.177912:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af57841721a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.177920:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af57841721a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002629.177929:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ad:0x0]: returning size 6721536 00010000:00010000:0.0:1786002629.178023:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af57841720c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178040:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af57841720c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178047:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af57841720c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178053:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af57841720c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178304:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002629.178308:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af57841720c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178316:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af57841720c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178326:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002629.178329:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002629.178333:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af57841720c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178339:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af57841720c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178350:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417213 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178355:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417213 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178361:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417213 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178366:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002629.178369:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417213 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178384:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417213 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178391:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed2456aef00) 00010000:00010000:0.0:1786002629.178393:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002629.178395:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417213 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178401:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417213 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178434:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417205 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0a2 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178445:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af57841721a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0a2 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002629.178452:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002629.178454:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002629.178465:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717c00, rc 0) 00000100:00100000:0.0:1786002629.178521:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20955:x1872758531026432:12345-192.168.203.49@tcp:101:dd.0 Request processed in 960us (1182us total) trans 4294984139 rc 0/0 00000100:00100000:0.0:1786002629.178529:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24186 00000100:00100000:1.0:1786002629.181997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002629.182586:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531026688 00000100:00100000:0.0:1786002629.182596:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531026688 00000100:00100000:1.0:1786002629.182732:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24187 00000100:00100000:1.0:1786002629.182743:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20955:x1872758531026688:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:1.0:1786002629.182796:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002629.182820:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af57841721a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0a2 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002629.182837:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:1.0:1786002629.182842:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002629.183043:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417228 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002629.183058:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417228 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002629.183067:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417228 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002629.183117:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984140 00000004:00010000:1.0:1786002629.183143:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbfafa41 reply state 00000000b48846a4 transno 4294984141 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417228 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002629.183154:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417228 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002629.183161:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:1.0:1786002629.183164:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002629.183166:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002629.183439:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20955:x1872758531026688:12345-192.168.203.49@tcp:36:dd.0 Request processed in 696us (1448us total) trans 4294984141 rc 0/0 00000100:00100000:1.0:1786002629.183447:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24187 00000020:00080000:1.0:1786002629.183452:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002629.446082:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002629.446179:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531026816 00000100:00100000:2.0:1786002629.446190:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531026816 00002000:00010000:2.0:1786002629.446252:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1786002629.446257:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed243e16d80 with x1872758531026816 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002629.446268:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed243e16d80. 00000100:00080000:0.0:1786002629.446353:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002629.446442:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 29 00000100:00100000:2.0:1786002629.446454:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531026816:12345-192.168.203.49@tcp:10:dd.0 00002000:00010000:3.0:1786002629.478233:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786002629.478248:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1786002623 -> 1786002629 00002000:00010000:3.0:1786002629.478252:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786002629.478254:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1786002623 -> 1786002629 00002000:00010000:3.0:1786002629.478256:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1786002629.478331:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531026816:12345-192.168.203.49@tcp:10:dd.0 Request processed in 31876us (32255us total) trans 4294969961 rc 0/0 00000100:00100000:3.0:1786002629.478341:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 29 00002000:00010000:3.0:1786002629.478345:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:3.0:1786002629.478348:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed243e16d80 with x1872758531026816 ext(0->18446744073709551615) 00002000:00010000:3.0:1786002629.478355:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed243e16d80. 00010000:00010000:3.0:1786002629.610130:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002630.506159:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002630.506183:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561054080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002630.506246:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002630.506376:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002630.506385:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561054208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786002630.506411:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002630.506439:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561054080 00000100:00100000:2.0:1786002630.506446:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561054080 00000100:00100000:2.0:1786002630.506502:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561054208 00000100:00100000:2.0:1786002630.506506:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561054208 00000100:00100000:2.0:1786002630.506524:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1786002630.506533:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561054080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786002630.506560:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 180224 granted 77543104 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002630.506600:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561054080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002630.506606:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1786002630.506622:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:2.0:1786002630.506628:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561054208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786002630.506638:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 180224 granted 77543104 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002630.506666:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561054208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002630.506675:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:2.0:1786002630.506713:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561054208:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1786002630.506780:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002630.506914:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561054080:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786002630.635665:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002630.997502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002630.997740:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531026944 00000100:00100000:0.0:1786002630.997750:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531026944 00000100:00100000:0.0:1786002630.997810:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 553 00000100:00100000:0.0:1786002630.997820:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531026944:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002630.997912:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531026944:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 92us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002630.997919:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 553 00000100:00100000:1.0:1786002631.018682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002631.018723:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002631.018761:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002631.018796:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002631.018879:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531027200 00000100:00100000:0.0:1786002631.018879:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531027456 00000100:00100000:2.0:1786002631.018891:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531027200 00000100:00100000:0.0:1786002631.018891:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531027456 00000100:00100000:3.0:1786002631.018979:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531027072 00000100:00100000:3.0:1786002631.018985:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531027072 00000100:00100000:0.0:1786002631.019621:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531027328 00000100:00100000:0.0:1786002631.019625:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531027328 00000100:00100000:2.0:1786002631.021747:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1025 00000100:00100000:2.0:1786002631.021759:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531027200:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002631.021830:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531027200:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 74us (3159us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002631.021837:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1025 00000100:00100000:2.0:1786002631.021938:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561054336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002631.021981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002631.022051:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561054336 00000100:00100000:2.0:1786002631.022057:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561054336 00000100:00100000:2.0:1786002631.022087:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4102 00000100:00100000:2.0:1786002631.022093:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561054336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786002631.022116:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:2.0:1786002631.022150:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561054336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002631.022157:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4102 00000100:00100000:2.0:1786002631.022190:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561054336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002631.022215:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 564 00000100:00100000:2.0:1786002631.022223:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531027456:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002631.022248:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531027456:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (3525us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002631.022255:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 564 00000100:00100000:3.0:1786002631.026391:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1026 00000100:00100000:3.0:1786002631.026406:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531027072:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002631.026500:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531027072:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 98us (7737us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002631.026508:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1026 00000100:00080000:1.0:1786002631.028228:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786002631.028249:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786002631.028252:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786002631.028254:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002631.032352:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 565 00000100:00100000:0.0:1786002631.032372:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531027328:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002631.032763:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531027328:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 394us (13964us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002631.032772:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 565 00010000:00010000:1.0:1786002631.658399:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002631.950214:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002631.950351:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531027584 00000100:00100000:0.0:1786002631.950361:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531027584 00002000:00100000:0.0:1786002631.950411:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed37bad3b80 x1872758531027584/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:312/0 lens 488/0 e 0 to 0 dl 1786002642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002631.950423:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37bad3b80 with x1872758531027584 ext(0->4194303) 00002000:00010000:0.0:1786002631.950429:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37bad3b80 00000100:00100000:0.0:1786002631.950471:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 30 00000100:00100000:0.0:1786002631.950482:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531027584:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:2.0:1786002632.022813:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2410:x1872758531027584:12345-192.168.203.49@tcp:4:dd.0 Request processed in 72324us (72609us total) trans 4294969962 rc 0/0 00000100:00100000:2.0:1786002632.022827:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 30 00002000:00100000:2.0:1786002632.022839:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed37bad3b80 x1872758531027584/t4294969962(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:312/0 lens 488/448 e 0 to 0 dl 1786002642 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002632.023335:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37bad3b80 with x1872758531027584 ext(0->4194303) 00002000:00010000:2.0:1786002632.023342:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37bad3b80 00000100:00100000:0.0:1786002632.042117:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561054848:0@lo:400:kworker.0 00000100:00100000:0.0:1786002632.042182:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002632.042234:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561055360:0@lo:400:kworker.0 00000100:00100000:0.0:1786002632.042258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002632.042369:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561054592:0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.042398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002632.042416:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561055104:0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.042434:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002632.042449:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561055616:0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.042466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002632.042487:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1786002632.042493:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561054464:0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.042519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002632.042550:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561054976:0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.042573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002632.042589:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561055488:0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.042607:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002632.042621:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561056000:0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.042640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002632.042667:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561054848 00000100:00100000:3.0:1786002632.042673:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561054848 00000100:00100000:3.0:1786002632.042712:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561054592 00000100:00100000:3.0:1786002632.042715:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561054592 00000100:00100000:3.0:1786002632.042726:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561055104 00000100:00100000:3.0:1786002632.042728:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561055104 00000100:00100000:3.0:1786002632.042744:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561055616 00000100:00100000:3.0:1786002632.042747:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561055616 00000100:00100000:3.0:1786002632.042762:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1786002632.042770:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561054848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.042814:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561054848:12345-0@lo:400:kworker.0 Request processed in 44us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002632.042821:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1786002632.042837:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1786002632.042843:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561054592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.042892:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561054592:12345-0@lo:400:kworker.0 Request processed in 49us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002632.042899:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1786002632.042910:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1786002632.042916:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561055104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.042942:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561055104:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002632.042948:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1786002632.042958:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:3.0:1786002632.042963:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561055616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.042988:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561055616:12345-0@lo:400:kworker.0 Request processed in 25us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002632.042995:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:3.0:1786002632.043031:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561054976 00000100:00100000:3.0:1786002632.043036:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561054976 00000100:00100000:3.0:1786002632.043060:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4103 00000100:00100000:3.0:1786002632.043066:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561054976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.043095:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561054976:12345-0@lo:400:kworker.0 Request processed in 30us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002632.043101:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4103 00000100:00100000:3.0:1786002632.043131:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561054976:0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.043142:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561054592:0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.043150:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561055104:0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.043158:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561055616:0@lo:400:kworker.0 00000100:00080000:1.0:1786002632.043387:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786002632.043414:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561054464 00000100:00100000:1.0:1786002632.043417:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561054464 00000100:00100000:1.0:1786002632.043453:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1786002632.043460:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561054464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002632.043498:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561054464:12345-0@lo:400:kworker.0 Request processed in 39us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002632.043505:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1786002632.043531:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561055360 00000100:00100000:1.0:1786002632.043545:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561055360 00000100:00100000:1.0:1786002632.043571:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561055488 00000100:00100000:1.0:1786002632.043574:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561055488 00000100:00100000:1.0:1786002632.043588:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561056000 00000100:00100000:1.0:1786002632.043590:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561056000 00000100:00100000:1.0:1786002632.043607:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1786002632.043612:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561055360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002632.043641:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561055360:12345-0@lo:400:kworker.0 Request processed in 29us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002632.043648:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1786002632.043659:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1786002632.043665:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561055488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002632.043687:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561055488:12345-0@lo:400:kworker.0 Request processed in 23us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002632.043693:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1786002632.043703:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1786002632.043708:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561056000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002632.043730:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561056000:12345-0@lo:400:kworker.0 Request processed in 23us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002632.043736:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1786002632.043766:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561054464:0@lo:400:kworker.0 00000100:00100000:1.0:1786002632.043776:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561055488:0@lo:400:kworker.0 00000100:00100000:1.0:1786002632.043784:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561056000:0@lo:400:kworker.0 00000100:00080000:1.0:1786002632.043804:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002632.043806:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002632.043987:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561055360:0@lo:400:kworker.0 00000100:00100000:2.0:1786002632.044117:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786002632.044126:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561056128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002632.044157:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002632.044180:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561056128 00000100:00100000:2.0:1786002632.044183:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561056128 00000100:00100000:2.0:1786002632.044204:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:2.0:1786002632.044210:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561056128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002632.044227:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002632.044254:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561056128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002632.044260:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:2.0:1786002632.044298:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561056128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002632.044314:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561054720:0@lo:400:kworker.0 00000100:00100000:2.0:1786002632.044335:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002632.044454:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561055232:0@lo:400:kworker.0 00000100:00100000:2.0:1786002632.044477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002632.044490:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561055744:0@lo:400:kworker.0 00000100:00100000:2.0:1786002632.044506:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002632.044528:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561054720 00000100:00100000:2.0:1786002632.044531:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561054720 00000100:00100000:2.0:1786002632.044563:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4104 00000100:00100000:2.0:1786002632.044570:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561054720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002632.044599:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561054720:12345-0@lo:400:kworker.0 Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002632.044604:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4104 00000100:00100000:2.0:1786002632.044626:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561054720:0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.044798:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561055232 00000100:00100000:3.0:1786002632.044802:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561055232 00000100:00100000:1.0:1786002632.044860:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561055872:0@lo:400:kworker.0 00000100:00100000:1.0:1786002632.044886:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002632.044911:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561054848:0@lo:400:kworker.0 00000100:00100000:1.0:1786002632.044917:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786002632.044922:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561056256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002632.044939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002632.044963:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561055872 00000100:00100000:1.0:1786002632.044966:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561055872 00000100:00100000:3.0:1786002632.047100:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561055744 00000100:00100000:3.0:1786002632.047107:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561055744 00000100:00100000:2.0:1786002632.047256:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1786002632.047267:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561055232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002632.047325:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561055232:12345-0@lo:400:kworker.0 Request processed in 60us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002632.047332:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1786002632.047389:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561055232:0@lo:400:kworker.0 00000100:00080000:0.0:1786002632.050275:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786002632.050284:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002632.050306:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561056256 00000100:00100000:0.0:1786002632.050313:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561056256 00000100:00100000:0.0:1786002632.050366:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1786002632.050374:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872758561056256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786002632.050394:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1786002632.050453:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1872758561056256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (5513us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002632.050459:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1786002632.050496:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561056256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002632.060117:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1786002632.060130:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561055872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002632.060211:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561055872:12345-0@lo:400:kworker.0 Request processed in 85us (15324us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002632.060218:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:0.0:1786002632.063166:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561055872:0@lo:400:kworker.0 00000100:00100000:2.0:1786002632.069470:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1786002632.069484:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561055744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002632.069624:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561055744:12345-0@lo:400:kworker.0 Request processed in 143us (25115us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002632.069631:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1786002632.075183:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561055744:0@lo:400:kworker.0 00000100:00100000:3.0:1786002632.589077:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002632.592086:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531027712 00000100:00100000:1.0:1786002632.592098:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531027712 00002000:00100000:1.0:1786002632.592154:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->5545983) req@ffff9ed244ecdc00 x1872758531027712/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:313/0 lens 488/0 e 0 to 0 dl 1786002643 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002632.592166:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ecdc00 with x1872758531027712 ext(4194304->5545983) 00002000:00010000:1.0:1786002632.592172:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244ecdc00 00000100:00100000:1.0:1786002632.592207:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 31 00000100:00100000:1.0:1786002632.592217:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758531027712:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002632.633198:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758531027712:12345-192.168.203.49@tcp:4:dd.0 Request processed in 40971us (44117us total) trans 4294969963 rc 0/0 00000100:00100000:1.0:1786002632.633215:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 31 00002000:00100000:1.0:1786002632.633229:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->5545983) req@ffff9ed244ecdc00 x1872758531027712/t4294969963(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:313/0 lens 488/448 e 0 to 0 dl 1786002643 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002632.633239:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ecdc00 with x1872758531027712 ext(4194304->5545983) 00002000:00010000:1.0:1786002632.633245:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244ecdc00 00010000:00010000:3.0:1786002632.682049:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002633.578554:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786002633.578575:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561056384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002633.578643:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002633.578835:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561056384 00000100:00100000:3.0:1786002633.578843:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561056384 00000100:00100000:3.0:1786002633.578908:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4105 00000100:00100000:3.0:1786002633.578918:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561056384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002633.578949:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002633.579012:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561056384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002633.579019:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4105 00000100:00100000:2.0:1786002633.579100:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561056384:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786002633.713303:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002634.160373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002634.160658:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531027968 00000100:00100000:1.0:1786002634.160668:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531027968 00000100:00100000:1.0:1786002634.160737:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5225 00000100:00100000:1.0:1786002634.160747:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20955:x1872758531027968:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:1.0:1786002634.160956:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984142 00000100:00100000:1.0:1786002634.161069:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:20955:x1872758531027968:12345-192.168.203.49@tcp:35:dd.0 Request processed in 322us (703us total) trans 4294984143 rc 0/0 00000100:00100000:1.0:1786002634.161085:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5225 00000020:00080000:1.0:1786002634.161090:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1786002634.161156:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1786002634.606275:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969963 is committed 00000001:00080000:3.0:1786002634.608513:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984143 is committed 00010000:00010000:0.0:1786002634.608593:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417228 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002634.608606:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417228 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002634.608618:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417228 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002634.608624:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002634.608629:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417228 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002634.608638:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417228 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002634.608655:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002634.608658:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002634.608662:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417228 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002634.608667:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417228 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002634.730117:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002635.185876:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002635.185951:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531028096 00000100:00100000:1.0:1786002635.185961:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531028096 00000100:00100000:1.0:1786002635.186031:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24188 00000100:00100000:1.0:1786002635.186041:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20959:x1872758531028096:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002635.186065:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002635.186084:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841722f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0a9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.186147:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417236 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.186161:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.186172:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002635.186212:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:1.0:1786002635.186217:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786002635.186236:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.186259:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841722f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0a9 expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.186276:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417236 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0a9 expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.186285:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002635.186287:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786002635.186291:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b000, rc 0) 00000100:00100000:1.0:1786002635.186350:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20959:x1872758531028096:12345-192.168.203.49@tcp:101:dd.0 Request processed in 310us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002635.186357:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24188 00000100:00100000:2.0:1786002635.194653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002635.198641:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531028352 00000100:00100000:1.0:1786002635.198656:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531028352 00000100:00100000:1.0:1786002635.198773:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24189 00000100:00100000:1.0:1786002635.198784:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20959:x1872758531028352:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002635.198812:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002635.198816:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786002635.198840:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417236 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0a9 expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.198873:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002635.198878:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002635.198890:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841723d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0b0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199004:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417244 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199016:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199025:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199039:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841724b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199045:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841724b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199051:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841724b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199098:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578417252 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199106:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578417252 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199116:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578417252 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002635.199124:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ad:0x0]: returning size 8011776 00010000:00010000:1.0:1786002635.199200:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417244 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199207:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417244 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199214:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417244 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199220:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417244 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199226:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002635.199229:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417244 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199236:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417244 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199244:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002635.199247:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002635.199250:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417244 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199257:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af578417244 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199265:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841724b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199271:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841724b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199277:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841724b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199281:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002635.199284:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841724b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199289:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841724b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199294:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed245644b00) 00010000:00010000:1.0:1786002635.199296:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002635.199299:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841724b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199304:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841724b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199351:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af57841723d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0b0 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199364:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578417252 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0b0 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002635.199371:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:1.0:1786002635.199374:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002635.199386:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a800, rc 0) 00000100:00100000:1.0:1786002635.200807:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20959:x1872758531028352:12345-192.168.203.49@tcp:101:dd.0 Request processed in 2023us (6160us total) trans 4294984144 rc 0/0 00000100:00100000:1.0:1786002635.200816:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24189 00000100:00100000:3.0:1786002635.206423:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002635.206520:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531028608 00000100:00100000:0.0:1786002635.206530:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531028608 00000100:00100000:0.0:1786002635.206597:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24190 00000100:00100000:0.0:1786002635.206607:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20959:x1872758531028608:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:0.0:1786002635.206659:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002635.206683:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af578417252 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0b0 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002635.206700:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002635.206705:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002635.206880:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417260 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002635.206893:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417260 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002635.206903:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417260 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002635.206938:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984145 00000004:00010000:0.0:1786002635.206955:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051105fca reply state 0000000094a4231c transno 4294984146 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417260 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002635.206967:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417260 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002635.206973:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002635.206976:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002635.206979:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002635.207067:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20959:x1872758531028608:12345-192.168.203.49@tcp:36:dd.0 Request processed in 460us (651us total) trans 4294984146 rc 0/0 00000100:00100000:0.0:1786002635.207074:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24190 00000020:00080000:0.0:1786002635.207079:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002635.383166:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002635.383389:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531028736 00000100:00100000:2.0:1786002635.383398:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531028736 00000100:00080000:0.0:1786002635.383612:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1786002635.383724:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1786002635.383729:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed366d6f100 with x1872758531028736 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002635.383740:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed366d6f100. 00000100:00100000:2.0:1786002635.383769:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 32 00000100:00100000:2.0:1786002635.383780:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531028736:12345-192.168.203.49@tcp:10:dd.0 00002000:00010000:2.0:1786002635.393172:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002635.393180:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1786002629 -> 1786002635 00002000:00010000:2.0:1786002635.393183:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002635.393186:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1786002629 -> 1786002635 00002000:00010000:2.0:1786002635.393188:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002635.393296:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531028736:12345-192.168.203.49@tcp:10:dd.0 Request processed in 9514us (10135us total) trans 4294969964 rc 0/0 00000100:00100000:2.0:1786002635.393307:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 32 00002000:00010000:2.0:1786002635.393312:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1786002635.393315:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed366d6f100 with x1872758531028736 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002635.393322:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed366d6f100. 00000100:00100000:2.0:1786002635.626037:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002635.626059:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561056512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786002635.626126:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002635.626145:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786002635.626160:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561056640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786002635.626198:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002635.626261:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561056512 00000100:00100000:1.0:1786002635.626268:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561056512 00000100:00100000:1.0:1786002635.626335:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1786002635.626344:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561056512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002635.626369:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 77824 granted 86271680 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002635.626411:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561056512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002635.626417:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1786002635.626431:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561056640 00000100:00100000:1.0:1786002635.626435:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561056640 00000100:00100000:1.0:1786002635.626448:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1786002635.626453:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561056640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786002635.626472:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 77824 granted 86271680 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002635.626498:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561056640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002635.626504:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1786002635.626537:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561056512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786002635.626707:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561056640:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786002635.626802:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786002635.759416:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002636.117187:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002636.117288:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531028864 00000100:00100000:0.0:1786002636.117297:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531028864 00000100:00100000:0.0:1786002636.117357:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 555 00000100:00100000:0.0:1786002636.117367:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758531028864:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002636.117528:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758531028864:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 162us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002636.117536:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 555 00000100:00100000:0.0:1786002636.119362:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002636.120751:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531028992 00000100:00100000:2.0:1786002636.120758:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531028992 00000100:00100000:2.0:1786002636.120827:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1033 00000100:00100000:2.0:1786002636.120838:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531028992:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002636.120942:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531028992:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 106us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002636.120950:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1033 00000100:00080000:0.0:1786002636.122660:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786002636.126183:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002636.126214:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002636.126293:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531029120 00000100:00100000:0.0:1786002636.126302:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531029120 00000100:00100000:0.0:1786002636.126382:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1034 00000100:00100000:0.0:1786002636.126392:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531029120:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002636.126453:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531029120:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002636.126461:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1034 00000100:00080000:1.0:1786002636.126725:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786002636.127559:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531029248 00000100:00100000:2.0:1786002636.127565:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531029248 00000100:00100000:2.0:1786002636.127621:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 570 00000100:00100000:2.0:1786002636.127629:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531029248:12345-192.168.203.49@tcp:400:kworker.0 00000100:00080000:0.0:1786002636.127710:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002636.127752:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531029248:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 123us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002636.127760:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 570 00000100:00100000:0.0:1786002636.138235:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561056768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002636.138314:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002636.138651:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561056768 00000100:00100000:2.0:1786002636.138658:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561056768 00000100:00100000:2.0:1786002636.138706:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4106 00000100:00100000:2.0:1786002636.138733:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561056768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786002636.138762:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:2.0:1786002636.138962:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561056768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 231us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002636.138970:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4106 00000100:00100000:1.0:1786002636.142666:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561056768:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1786002636.779709:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002636.939609:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002636.939820:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531029376 00000100:00100000:1.0:1786002636.939830:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531029376 00002000:00100000:1.0:1786002636.939907:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed244ecca80 x1872758531029376/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:317/0 lens 488/0 e 0 to 0 dl 1786002647 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002636.939925:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ecca80 with x1872758531029376 ext(0->4194303) 00002000:00010000:1.0:1786002636.939931:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244ecca80 00000100:00100000:1.0:1786002636.939962:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 33 00000100:00100000:1.0:1786002636.939972:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531029376:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002637.163944:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561056896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002637.164020:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002637.165088:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561056896 00000100:00100000:2.0:1786002637.165095:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561056896 00000100:00100000:2.0:1786002637.166908:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1786002637.166921:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561056896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002637.166955:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002637.167030:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561056896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (3009us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002637.167037:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1786002637.167087:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561056896:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1786002637.167859:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002637.186999:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561057408:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002637.187113:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561057920:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002637.187155:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561058432:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187174:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002637.187199:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1786002637.187206:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561057280:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187229:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002637.187247:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561057792:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002637.187280:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561058304:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187298:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002637.187323:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561057920 00000100:00100000:2.0:1786002637.187329:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561057920 00000100:00100000:2.0:1786002637.187369:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561058432 00000100:00100000:2.0:1786002637.187372:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561058432 00000100:00100000:2.0:1786002637.187393:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1786002637.187401:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561057920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187447:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561057920:12345-0@lo:400:kworker.0 Request processed in 46us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002637.187455:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1786002637.187469:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1786002637.187475:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561058432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187501:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561058432:12345-0@lo:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002637.187506:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1786002637.187524:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561057408 00000100:00100000:2.0:1786002637.187528:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561057408 00000100:00100000:2.0:1786002637.187549:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561057792 00000100:00100000:2.0:1786002637.187552:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561057792 00000100:00100000:2.0:1786002637.187568:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561058304 00000100:00100000:2.0:1786002637.187571:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561058304 00000100:00100000:2.0:1786002637.187585:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:2.0:1786002637.187590:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561057408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187617:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561057408:12345-0@lo:400:kworker.0 Request processed in 27us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002637.187623:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:2.0:1786002637.187633:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1786002637.187639:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561057792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187660:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561057792:12345-0@lo:400:kworker.0 Request processed in 22us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002637.187666:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1786002637.187675:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1786002637.187680:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561058304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187701:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561058304:12345-0@lo:400:kworker.0 Request processed in 21us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002637.187710:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1786002637.187746:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561057792:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187756:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561058304:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.187764:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561057408:0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.187894:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561057152:0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.187922:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002637.187942:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561057664:0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.187961:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002637.187986:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561058176:0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188006:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002637.188023:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1786002637.188029:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561057024:0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002637.188074:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561057536:0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188095:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002637.188110:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561058048:0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188130:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002637.188145:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561058560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002637.188164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002637.188187:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561057152 00000100:00100000:1.0:1786002637.188191:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561057152 00000100:00100000:1.0:1786002637.188209:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561057664 00000100:00100000:1.0:1786002637.188212:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561057664 00000100:00100000:1.0:1786002637.188223:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561058176 00000100:00100000:1.0:1786002637.188226:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561058176 00000100:00100000:1.0:1786002637.188240:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1786002637.188245:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561057152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188279:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561057152:12345-0@lo:400:kworker.0 Request processed in 33us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002637.188285:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1786002637.188297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1786002637.188303:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561057664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188327:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561057664:12345-0@lo:400:kworker.0 Request processed in 25us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002637.188333:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1786002637.188344:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1786002637.188351:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561058176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188375:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561058176:12345-0@lo:400:kworker.0 Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002637.188381:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1786002637.188396:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561058048 00000100:00100000:1.0:1786002637.188399:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561058048 00000100:00100000:1.0:1786002637.188422:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1786002637.188428:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561058048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188455:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561058048:12345-0@lo:400:kworker.0 Request processed in 28us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002637.188464:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1786002637.188485:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561057024 00000100:00100000:1.0:1786002637.188489:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561057024 00000100:00100000:1.0:1786002637.188510:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1786002637.188516:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561057024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188542:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561057024:12345-0@lo:400:kworker.0 Request processed in 26us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002637.188548:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1786002637.188572:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561057280 00000100:00100000:1.0:1786002637.188575:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561057280 00000100:00100000:1.0:1786002637.188594:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561057536 00000100:00100000:1.0:1786002637.188597:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561057536 00000100:00100000:1.0:1786002637.188612:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4107 00000100:00100000:1.0:1786002637.188619:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561057280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188648:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561057280:12345-0@lo:400:kworker.0 Request processed in 30us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002637.188653:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4107 00000100:00100000:1.0:1786002637.188664:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4108 00000100:00100000:1.0:1786002637.188669:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561057536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188693:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561057536:12345-0@lo:400:kworker.0 Request processed in 24us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002637.188698:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4108 00000100:00100000:1.0:1786002637.188734:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561057024:0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188743:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561057536:0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188751:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561058048:0@lo:400:kworker.0 00000100:00100000:1.0:1786002637.188760:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561057152:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.188867:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561057920:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.188875:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561058432:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.188897:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561057280:0@lo:400:kworker.0 00000100:00080000:2.0:1786002637.188911:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786002637.188916:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786002637.188918:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786002637.188920:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002637.189030:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561058560 00000100:00100000:0.0:1786002637.189034:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561058560 00000100:00100000:0.0:1786002637.189067:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1786002637.189074:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561058560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786002637.189088:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1786002637.189119:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561058560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002637.189124:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:1.0:1786002637.189224:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561057664:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.189294:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561058176:0@lo:400:kworker.0 00000100:00100000:2.0:1786002637.189322:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561058560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786002637.246996:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758531029376:12345-192.168.203.49@tcp:4:dd.0 Request processed in 307005us (307376us total) trans 4294969965 rc 0/0 00000100:00100000:3.0:1786002637.247011:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 33 00002000:00100000:3.0:1786002637.247023:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed244ecca80 x1872758531029376/t4294969965(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:317/0 lens 488/448 e 0 to 0 dl 1786002647 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002637.247033:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ecca80 with x1872758531029376 ext(0->4194303) 00002000:00010000:3.0:1786002637.247040:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244ecca80 00000100:00100000:2.0:1786002637.742834:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002637.742917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002637.743000:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531029504 00000100:00100000:3.0:1786002637.743009:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531029504 00002000:00100000:3.0:1786002637.743075:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->6676479) req@ffff9ed37f537480 x1872758531029504/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:318/0 lens 488/0 e 0 to 0 dl 1786002648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002637.743086:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f537480 with x1872758531029504 ext(4194304->6676479) 00002000:00010000:3.0:1786002637.743092:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f537480 00000100:00100000:3.0:1786002637.743127:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531029632 00000100:00100000:3.0:1786002637.743131:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531029632 00002000:00100000:3.0:1786002637.743147:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (6676480->6758399) req@ffff9ed37f534700 x1872758531029632/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:318/0 lens 488/0 e 0 to 0 dl 1786002648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002637.743154:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f534700 with x1872758531029632 ext(6676480->6758399) 00002000:00010000:3.0:1786002637.743158:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f534700 00000100:00100000:3.0:1786002637.743170:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 34 00000100:00100000:3.0:1786002637.743179:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2410:x1872758531029504:12345-192.168.203.49@tcp:4:dd.0 00000100:00080000:2.0:1786002637.746824:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786002637.804426:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002637.826278:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2410:x1872758531029504:12345-192.168.203.49@tcp:4:dd.0 Request processed in 83091us (83445us total) trans 4294969966 rc 0/0 00000100:00100000:3.0:1786002637.826296:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 34 00002000:00100000:3.0:1786002637.826318:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (4194304->6676479) req@ffff9ed37f537480 x1872758531029504/t4294969966(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:318/0 lens 488/448 e 0 to 0 dl 1786002648 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002637.826328:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f537480 with x1872758531029504 ext(4194304->6676479) 00002000:00010000:3.0:1786002637.826334:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f537480 00000100:00100000:3.0:1786002637.826362:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 35 00000100:00100000:3.0:1786002637.826374:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2410:x1872758531029632:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002637.845599:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2410:x1872758531029632:12345-192.168.203.49@tcp:4:dd.0 Request processed in 19220us (102673us total) trans 4294969967 rc 0/0 00000100:00100000:3.0:1786002637.845614:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 35 00002000:00100000:3.0:1786002637.845625:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (6676480->6758399) req@ffff9ed37f534700 x1872758531029632/t4294969967(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:318/0 lens 488/448 e 0 to 0 dl 1786002648 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002637.845635:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f534700 with x1872758531029632 ext(6676480->6758399) 00002000:00010000:3.0:1786002637.845641:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f534700 00000100:00100000:2.0:1786002638.698529:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561058688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002638.698596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002638.698765:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561058688 00000100:00100000:1.0:1786002638.698782:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561058688 00000100:00100000:1.0:1786002638.698832:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4109 00000100:00100000:1.0:1786002638.698841:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561058688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786002638.698893:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:1.0:1786002638.698948:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561058688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002638.698956:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4109 00000100:00100000:3.0:1786002638.699011:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561058688:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786002638.826284:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002639.850740:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002640.182129:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002640.182210:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531029888 00000100:00100000:3.0:1786002640.182219:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531029888 00000100:00100000:3.0:1786002640.182280:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5226 00000100:00100000:3.0:1786002640.182292:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20959:x1872758531029888:12345-192.168.203.49@tcp:35:dd.0 00000100:00080000:2.0:1786002640.182292:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1786002640.182765:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984147 00000100:00100000:3.0:1786002640.182913:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:20959:x1872758531029888:12345-192.168.203.49@tcp:35:dd.0 Request processed in 623us (792us total) trans 4294984148 rc 0/0 00000100:00100000:3.0:1786002640.182923:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5226 00000020:00080000:3.0:1786002640.182927:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002640.747742:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561058816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002640.747814:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002640.748007:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561058816 00000100:00100000:2.0:1786002640.748015:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561058816 00000100:00100000:2.0:1786002640.748075:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:2.0:1786002640.748086:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561058816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786002640.748111:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2506752 granted 109094592 pending 6832128 free 3916767232 avail 3685244928 00000100:00100000:2.0:1786002640.748157:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561058816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002640.748165:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:2.0:1786002640.748211:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561058816:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1786002640.748279:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002640.748569:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786002640.748579:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561058944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002640.748606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002640.748688:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561058944 00000100:00100000:3.0:1786002640.748693:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561058944 00000100:00100000:3.0:1786002640.748737:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1786002640.748745:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561058944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786002640.748756:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 2506752 granted 109094592 pending 6832128 free 3916767232 avail 3685244928 00000100:00100000:3.0:1786002640.748792:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561058944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002640.748798:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1786002640.748826:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561058944:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786002640.748892:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1786002640.752139:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969967 is committed 00000001:00080000:2.0:1786002640.759521:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984148 is committed 00010000:00010000:0.0:1786002640.759616:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417260 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002640.759630:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417260 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002640.759638:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417260 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002640.759645:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002640.759650:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417260 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002640.759657:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417260 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002640.759674:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002640.759678:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002640.759682:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417260 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002640.759688:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af578417260 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002640.874229:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002641.207093:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002641.207199:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531030016 00000100:00100000:1.0:1786002641.207209:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531030016 00000100:00100000:1.0:1786002641.207276:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24191 00000100:00100000:1.0:1786002641.207287:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20963:x1872758531030016:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002641.207309:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002641.207330:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.207394:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841726e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.207407:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841726e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.207423:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841726e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002641.207464:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:1.0:1786002641.207468:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786002641.207487:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841726e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.207510:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0b7 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.207529:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841726e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0b7 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.207537:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002641.207540:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786002641.207544:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a200, rc 0) 00000100:00100000:1.0:1786002641.207607:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20963:x1872758531030016:12345-192.168.203.49@tcp:101:dd.0 Request processed in 322us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002641.207614:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24191 00000100:00100000:0.0:1786002641.225361:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002641.225560:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531030272 00000100:00100000:1.0:1786002641.225570:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531030272 00000100:00100000:1.0:1786002641.225637:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24192 00000100:00100000:1.0:1786002641.225647:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20963:x1872758531030272:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002641.225668:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002641.225671:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786002641.225696:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841726e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0b7 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.225717:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002641.225722:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002641.225735:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417275 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0be expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.225896:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841727c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.225909:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841727c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.225919:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841727c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.225935:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417283 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.225943:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417283 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.225958:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417283 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226012:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841728a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226021:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841728a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226039:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841728a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002641.226049:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ad:0x0]: returning size 10362880 00010000:00010000:1.0:1786002641.226403:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841727c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226411:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841727c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226418:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841727c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226425:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841727c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226431:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556aa00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002641.226435:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841727c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226442:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841727c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226450:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002641.226453:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002641.226456:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841727c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226462:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af57841727c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226564:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417283 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226578:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417283 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226584:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417283 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226589:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002641.226592:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417283 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226598:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417283 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226606:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed245644e00) 00010000:00010000:1.0:1786002641.226608:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002641.226610:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417283 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226615:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417283 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226653:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417275 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0be expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226665:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841728a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0be expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002641.226672:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:1.0:1786002641.226674:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002641.226677:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a800, rc 0) 00000100:00100000:1.0:1786002641.226738:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20963:x1872758531030272:12345-192.168.203.49@tcp:101:dd.0 Request processed in 1093us (1385us total) trans 4294984149 rc 0/0 00000100:00100000:1.0:1786002641.226746:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24192 00000100:00100000:3.0:1786002641.234665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002641.234876:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531030400 00000100:00100000:1.0:1786002641.234885:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531030400 00000100:00100000:1.0:1786002641.234941:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 557 00000100:00100000:1.0:1786002641.234960:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531030400:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002641.235023:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531030400:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 72us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002641.235040:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 557 00000100:00100000:0.0:1786002641.239697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002641.244424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002641.244466:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002641.244526:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531030656 00000100:00100000:1.0:1786002641.244535:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531030656 00000100:00100000:1.0:1786002641.244609:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 574 00000100:00100000:1.0:1786002641.244620:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531030656:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002641.244684:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531030656:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 67us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002641.244693:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 574 00000100:00080000:0.0:1786002641.247516:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002641.253192:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002641.253459:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531030784 00000100:00100000:0.0:1786002641.253469:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531030784 00000100:00100000:0.0:1786002641.253541:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 575 00000100:00100000:0.0:1786002641.253552:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531030784:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002641.253620:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531030784:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 70us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002641.253627:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 575 00000100:00080000:3.0:1786002641.254037:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002641.254860:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531031040 00000100:00100000:2.0:1786002641.254867:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531031040 00000100:00100000:2.0:1786002641.254913:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531030528 00000100:00100000:2.0:1786002641.254917:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531030528 00000100:00100000:2.0:1786002641.254947:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1041 00000100:00100000:2.0:1786002641.254965:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531030528:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002641.255009:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531030528:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 47us (10543us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002641.255016:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1041 00000100:00100000:2.0:1786002641.255042:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24193 00000100:00100000:2.0:1786002641.255050:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20963:x1872758531031040:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:2.0:1786002641.255093:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1786002641.255580:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1786002641.255998:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841728a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0be expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002641.256018:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002641.256032:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002641.256361:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417298 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002641.256375:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417298 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002641.256385:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417298 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002641.256422:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984150 00000004:00010000:2.0:1786002641.256444:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a16a186 reply state 00000000d3b2d508 transno 4294984151 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417298 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002641.256456:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417298 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002641.256462:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002641.256465:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002641.256467:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002641.256644:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20963:x1872758531031040:12345-192.168.203.49@tcp:36:dd.0 Request processed in 1594us (16955us total) trans 4294984151 rc 0/0 00000100:00100000:2.0:1786002641.256652:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24193 00000020:00080000:2.0:1786002641.256656:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002641.275893:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561059072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002641.275971:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002641.276366:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561059072 00000100:00100000:2.0:1786002641.276374:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561059072 00000100:00100000:2.0:1786002641.276419:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4110 00000100:00100000:2.0:1786002641.276426:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561059072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786002641.276457:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:3.0:1786002641.290179:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561059072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 13742us (14196us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002641.290194:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4110 00000100:00100000:0.0:1786002641.290496:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561059072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002641.581664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002641.581750:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531031168 00000100:00100000:2.0:1786002641.581768:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531031168 00002000:00010000:2.0:1786002641.581807:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:2.0:1786002641.581812:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed366d6f480 with x1872758531031168 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002641.581823:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed366d6f480. 00000100:00100000:2.0:1786002641.581886:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 36 00000100:00100000:2.0:1786002641.581895:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531031168:12345-192.168.203.49@tcp:10:dd.0 00002000:00010000:3.0:1786002641.604698:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786002641.604706:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1786002635 -> 1786002641 00002000:00010000:3.0:1786002641.604710:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786002641.604712:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1786002635 -> 1786002641 00002000:00010000:3.0:1786002641.604715:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1786002641.607069:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531031168:12345-192.168.203.49@tcp:10:dd.0 Request processed in 25164us (25401us total) trans 4294969968 rc 0/0 00000100:00100000:3.0:1786002641.607088:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 36 00002000:00010000:3.0:1786002641.607094:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:3.0:1786002641.607098:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed366d6f480 with x1872758531031168 ext(0->18446744073709551615) 00002000:00010000:3.0:1786002641.607108:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed366d6f480. 00010000:00010000:3.0:1786002641.898475:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002642.282120:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561059200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002642.282196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002642.282359:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561059200 00000100:00100000:2.0:1786002642.282367:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561059200 00000100:00100000:1.0:1786002642.282420:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786002642.282423:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1786002642.282429:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561059328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002642.282434:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561059200:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002642.282456:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1786002642.282459:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002642.282498:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561059200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002642.282505:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1786002642.282507:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561059328 00000100:00100000:1.0:1786002642.282510:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561059328 00000100:00100000:1.0:1786002642.282534:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:1.0:1786002642.282541:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561059328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786002642.282551:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00080000:3.0:1786002642.282581:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002642.282592:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561059328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002642.282598:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1786002642.282621:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561059200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002642.282715:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561059328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002642.282728:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758561059456:0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.282754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002642.282779:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561059968:0@lo:400:kworker.0 00000100:00100000:0.0:1786002642.282783:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561059584:0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.282801:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002642.282808:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002642.282817:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561060480:0@lo:400:kworker.0 00000100:00100000:0.0:1786002642.282823:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561060096:0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.282838:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002642.282839:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002642.282870:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786002642.282876:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561060608:0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.282877:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561059840:0@lo:400:kworker.0 00000100:00100000:0.0:1786002642.282897:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002642.282917:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1786002642.282918:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561059584 00000100:00100000:2.0:1786002642.282922:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561059584 00000100:00100000:0.0:1786002642.282922:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561059712:0@lo:400:kworker.0 00000100:00100000:0.0:1786002642.282951:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002642.282958:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561060096 00000100:00100000:2.0:1786002642.282962:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561060096 00000100:00100000:0.0:1786002642.282967:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758561060224:0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.282981:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561060608 00000100:00100000:2.0:1786002642.282984:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561060608 00000100:00100000:0.0:1786002642.282986:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002642.282996:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758561060736:0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.282997:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561060224 00000100:00100000:2.0:1786002642.282999:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561060224 00000100:00100000:2.0:1786002642.283013:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:0.0:1786002642.283013:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002642.283018:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561059584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002642.283032:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561059456 00000100:00100000:0.0:1786002642.283035:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561059456 00000100:00100000:2.0:1786002642.283054:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561059584:12345-0@lo:400:kworker.0 Request processed in 35us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002642.283059:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:0.0:1786002642.283059:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1786002642.283065:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758561059456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.283070:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561060736 00000100:00100000:2.0:1786002642.283073:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561060736 00000100:00100000:2.0:1786002642.283086:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1786002642.283092:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561060096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002642.283093:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758561059456:12345-0@lo:400:kworker.0 Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002642.283098:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:2.0:1786002642.283114:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561060096:12345-0@lo:400:kworker.0 Request processed in 23us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002642.283119:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1786002642.283126:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1786002642.283130:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1786002642.283132:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561060608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.283135:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758561060224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.283156:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758561060224:12345-0@lo:400:kworker.0 Request processed in 20us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002642.283161:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1786002642.283171:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:2.0:1786002642.283177:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758561060736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.283200:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758561060736:12345-0@lo:400:kworker.0 Request processed in 25us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002642.283206:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:2.0:1786002642.283224:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561059968 00000100:00100000:2.0:1786002642.283227:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561059968 00000100:00100000:2.0:1786002642.283247:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561059712 00000100:00100000:3.0:1786002642.283249:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561060480 00000100:00100000:2.0:1786002642.283249:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561059712 00000100:00100000:3.0:1786002642.283252:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561060480 00000100:00100000:3.0:1786002642.283278:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1786002642.283278:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4111 00000100:00100000:3.0:1786002642.283284:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561060480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.283293:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561059968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002642.283314:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561060480:12345-0@lo:400:kworker.0 Request processed in 30us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002642.283318:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561059968:12345-0@lo:400:kworker.0 Request processed in 36us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002642.283320:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1786002642.283324:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4111 00000100:00100000:2.0:1786002642.283333:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4112 00000100:00080000:3.0:1786002642.283337:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002642.283339:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561059712:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786002642.283340:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786002642.283341:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002642.283363:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561059712:12345-0@lo:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002642.283368:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4112 00000100:00100000:3.0:1786002642.283370:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002642.283385:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561060352:0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.283391:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561059712:0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.283400:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758561060224:0@lo:400:kworker.0 00000100:00100000:3.0:1786002642.283407:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002642.283408:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758561060736:0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.283416:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561059584:0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.283423:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561060096:0@lo:400:kworker.0 00000100:00100000:3.0:1786002642.283424:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561059968:0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.283431:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561060608:0@lo:400:kworker.0 00000100:00100000:3.0:1786002642.283432:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561060480:0@lo:400:kworker.0 00000100:00100000:3.0:1786002642.283438:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758561059456:0@lo:400:kworker.0 00000100:00100000:2.0:1786002642.283455:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561059840 00000100:00100000:2.0:1786002642.283458:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561059840 00000100:00100000:2.0:1786002642.283490:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1786002642.283496:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561059840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002642.283522:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561060608:12345-0@lo:400:kworker.0 Request processed in 24us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002642.283530:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1786002642.283539:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561059840:12345-0@lo:400:kworker.0 Request processed in 44us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002642.283544:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1786002642.283784:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561059840:0@lo:400:kworker.0 00000100:00100000:1.0:1786002642.284432:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561060352 00000100:00100000:1.0:1786002642.284437:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561060352 00000100:00100000:1.0:1786002642.284505:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1786002642.284513:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561060352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002642.284571:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561060352:12345-0@lo:400:kworker.0 Request processed in 59us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002642.284577:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00080000:3.0:1786002642.284686:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002642.284752:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561060352:0@lo:400:kworker.0 00010000:00010000:3.0:1786002642.922148:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002643.818044:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786002643.818065:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561060864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002643.818130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002643.818416:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561060864 00000100:00100000:3.0:1786002643.818424:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561060864 00000100:00100000:3.0:1786002643.818474:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4113 00000100:00100000:3.0:1786002643.818483:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561060864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002643.818515:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002643.818568:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561060864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002643.818575:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4113 00000100:00100000:0.0:1786002643.818654:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561060864:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786002643.945996:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002644.812987:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002644.813081:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531031296 00000100:00100000:3.0:1786002644.813090:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531031296 00002000:00100000:3.0:1786002644.813158:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed245c43100 x1872758531031296/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:325/0 lens 488/0 e 0 to 0 dl 1786002655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002644.813168:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245c43100 with x1872758531031296 ext(0->4194303) 00002000:00010000:3.0:1786002644.813173:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed245c43100 00000100:00100000:3.0:1786002644.813208:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 37 00000100:00100000:3.0:1786002644.813216:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531031296:12345-192.168.203.49@tcp:4:dd.0 00000100:00080000:0.0:1786002644.813547:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002644.911642:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758531031296:12345-192.168.203.49@tcp:4:dd.0 Request processed in 98416us (98652us total) trans 4294969969 rc 0/0 00000100:00100000:2.0:1786002644.911657:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 37 00002000:00100000:2.0:1786002644.911669:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed245c43100 x1872758531031296/t4294969969(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:325/0 lens 488/448 e 0 to 0 dl 1786002655 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002644.911679:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245c43100 with x1872758531031296 ext(0->4194303) 00002000:00010000:2.0:1786002644.911685:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed245c43100 00010000:00010000:3.0:1786002644.970525:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002645.867652:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002645.867674:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2467f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561060992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786002645.867735:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002645.867883:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561060992 00000100:00100000:1.0:1786002645.867892:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561060992 00000100:00100000:1.0:1786002645.867964:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1786002645.867974:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561060992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002645.868001:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 155648 granted 107046592 pending 4218880 free 3919331328 avail 3687809024 00000100:00080000:3.0:1786002645.868320:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002645.868577:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561061120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002645.868605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002645.868766:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561061120 00000100:00100000:3.0:1786002645.868771:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561061120 00000100:00100000:3.0:1786002645.868808:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1786002645.868815:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561061120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786002645.868825:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 155648 granted 107046592 pending 4218880 free 3919331328 avail 3687809024 00000100:00080000:0.0:1786002645.868886:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002645.869128:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561060992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1156us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002645.869190:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1786002645.869246:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2467f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561060992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786002645.875640:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561061120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6815us (7023us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002645.875709:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:2.0:1786002645.875821:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561061120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786002645.994404:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002646.242197:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002646.243432:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531031552 00000100:00100000:3.0:1786002646.243443:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531031552 00000100:00100000:3.0:1786002646.243524:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5227 00000100:00100000:3.0:1786002646.243535:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20963:x1872758531031552:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:3.0:1786002646.243755:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984152 00000100:00080000:0.0:1786002646.243979:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786002646.244027:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:20963:x1872758531031552:12345-192.168.203.49@tcp:35:dd.0 Request processed in 493us (1837us total) trans 4294984153 rc 0/0 00000100:00100000:3.0:1786002646.244314:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5227 00000020:00080000:3.0:1786002646.244319:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1786002646.246637:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984153 is committed 00010000:00010000:0.0:1786002646.246728:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417298 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002646.246740:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417298 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002646.246748:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417298 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002646.246754:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002646.246759:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417298 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002646.246765:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417298 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002646.246781:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002646.246784:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002646.246788:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417298 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002646.246794:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417298 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002646.373058:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002646.373115:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002646.373188:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531031936 00000100:00100000:2.0:1786002646.373198:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531031936 00000100:00100000:3.0:1786002646.373211:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531031680 00000100:00100000:3.0:1786002646.373218:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531031680 00000100:00100000:2.0:1786002646.373282:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 578 00000100:00100000:3.0:1786002646.373297:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 559 00000100:00100000:2.0:1786002646.373298:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758531031936:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002646.373308:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758531031680:12345-192.168.203.49@tcp:400:kworker.0 00000100:00080000:0.0:1786002646.373395:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002646.373490:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758531031936:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 198us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002646.373499:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 578 00000100:00100000:3.0:1786002646.374800:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758531031680:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 1490us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002646.374808:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 559 00000100:00100000:0.0:1786002646.376559:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002646.376601:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002646.376700:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531031808 00000100:00100000:3.0:1786002646.376709:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531031808 00000100:00080000:3.0:1786002646.376736:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786002646.376780:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1048 00000100:00100000:3.0:1786002646.376791:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531031808:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002646.385564:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531032064 00000100:00100000:2.0:1786002646.385578:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531032064 00000100:00100000:0.0:1786002646.385749:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561061248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002646.385811:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002646.385898:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561061248 00000100:00100000:0.0:1786002646.385903:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561061248 00000100:00100000:0.0:1786002646.385953:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4114 00000100:00100000:0.0:1786002646.385963:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561061248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002646.385993:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:0.0:1786002646.386050:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561061248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002646.386058:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4114 00000100:00100000:0.0:1786002646.386103:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561061248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786002646.400748:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531031808:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 56us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002646.400773:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1048 00000100:00100000:2.0:1786002646.406686:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 579 00000100:00100000:2.0:1786002646.406703:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531032064:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002646.406801:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531032064:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 103us (30198us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002646.406820:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 579 00000100:00080000:3.0:1786002646.408659:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786002647.018671:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002647.251336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002647.251460:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531032192 00000100:00100000:0.0:1786002647.251469:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531032192 00000100:00100000:0.0:1786002647.251531:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24194 00000100:00100000:0.0:1786002647.251541:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20967:x1872758531032192:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002647.251569:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002647.251587:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af57841729f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0c5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002647.251647:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af5784172a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002647.251659:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af5784172a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002647.251670:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af5784172a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002647.251709:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:0.0:1786002647.251713:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786002647.251731:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af5784172a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002647.251754:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716000/0x7cee4af57841729f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0c5 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002647.251771:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af5784172a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0c5 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002647.251780:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002647.251783:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786002647.251786:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717a00, rc 0) 00000100:00100000:0.0:1786002647.252110:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20967:x1872758531032192:12345-192.168.203.49@tcp:101:dd.0 Request processed in 568us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002647.252116:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24194 00000100:00100000:0.0:1786002647.264610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002647.264711:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531032448 00000100:00100000:1.0:1786002647.264719:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531032448 00000100:00100000:1.0:1786002647.264776:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24195 00000100:00100000:1.0:1786002647.264786:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20967:x1872758531032448:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002647.264814:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002647.264817:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786002647.264841:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717a00/0x7cee4af5784172a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0c5 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.264895:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002647.264899:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002647.264920:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af5784172ad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0cc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265197:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784172b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265210:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784172b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265219:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784172b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265231:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784172bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265237:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784172bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265257:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784172bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265313:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784172c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265321:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784172c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265328:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784172c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002647.265337:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ad:0x0]: returning size 6275072 00010000:00010000:1.0:1786002647.265417:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784172b4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265425:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784172b4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265537:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784172b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265547:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784172b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265552:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002647.265557:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784172b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265564:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784172b4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265576:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002647.265579:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002647.265583:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784172b4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265589:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af5784172b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265599:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784172bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265605:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784172bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265610:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784172bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265614:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002647.265617:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784172bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265622:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784172bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265629:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed245644e00) 00010000:00010000:1.0:1786002647.265631:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002647.265634:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784172bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265639:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af5784172bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265677:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af5784172ad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0cc expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265688:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784172c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0cc expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002647.265694:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:1.0:1786002647.265697:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002647.265699:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556aa00, rc 0) 00000100:00100000:1.0:1786002647.265888:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20967:x1872758531032448:12345-192.168.203.49@tcp:101:dd.0 Request processed in 1102us (1284us total) trans 4294984154 rc 0/0 00000100:00100000:1.0:1786002647.265896:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24195 00000100:00100000:1.0:1786002647.279679:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002647.283042:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531032704 00000100:00100000:3.0:1786002647.283056:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531032704 00000100:00100000:3.0:1786002647.283124:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24196 00000100:00100000:3.0:1786002647.283135:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20967:x1872758531032704:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:3.0:1786002647.283188:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002647.283211:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af5784172c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0cc expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002647.283260:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:3.0:1786002647.283265:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002647.283415:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784172d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002647.283428:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784172d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002647.283448:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784172d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002647.283482:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984155 00000004:00010000:3.0:1786002647.283498:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072790627 reply state 000000004a889232 transno 4294984156 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784172d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002647.283510:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784172d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002647.283517:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:3.0:1786002647.283520:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002647.283522:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002647.283612:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20967:x1872758531032704:12345-192.168.203.49@tcp:36:dd.0 Request processed in 478us (3940us total) trans 4294984156 rc 0/0 00000100:00100000:3.0:1786002647.283619:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24196 00000020:00080000:3.0:1786002647.283623:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002647.402114:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561061376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002647.402179:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002647.402238:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561061504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002647.402274:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002647.402328:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561061632:0@lo:400:kworker.0 00000100:00100000:0.0:1786002647.402366:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002647.402398:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561062144:0@lo:400:kworker.0 00000100:00100000:1.0:1786002647.402425:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561061760:0@lo:400:kworker.0 00000100:00100000:0.0:1786002647.402425:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002647.402444:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561062656:0@lo:400:kworker.0 00000100:00100000:1.0:1786002647.402465:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002647.402476:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002647.402490:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561062272:0@lo:400:kworker.0 00000100:00100000:0.0:1786002647.402514:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561062016:0@lo:400:kworker.0 00000100:00100000:1.0:1786002647.402522:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002647.402544:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561062784:0@lo:400:kworker.0 00000100:00100000:0.0:1786002647.402551:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002647.402573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002647.402579:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561062528:0@lo:400:kworker.0 00000100:00100000:1.0:1786002647.402608:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561062656 00000100:00100000:0.0:1786002647.402608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002647.402617:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561062656 00000100:00100000:0.0:1786002647.402633:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1786002647.402639:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561061888:0@lo:400:kworker.0 00000100:00100000:0.0:1786002647.402665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002647.402666:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561062528 00000100:00100000:1.0:1786002647.402671:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561062528 00000100:00100000:0.0:1786002647.402687:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561062400:0@lo:400:kworker.0 00000100:00100000:0.0:1786002647.402704:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002647.402715:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561062912:0@lo:400:kworker.0 00000100:00100000:0.0:1786002647.402729:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002647.402751:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1786002647.402760:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561062656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.402787:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561061376 00000100:00100000:2.0:1786002647.402792:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561061376 00000100:00100000:0.0:1786002647.402808:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561062656:12345-0@lo:400:kworker.0 Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002647.402821:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561061504 00000100:00100000:2.0:1786002647.402825:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561061504 00000100:00100000:2.0:1786002647.402842:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1786002647.402869:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561061376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002647.402874:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1786002647.402885:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561061504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002647.402895:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00002000:00000024:3.0:1786002647.402898:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002647.402948:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561061376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002647.402956:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1786002647.402960:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561061504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002647.402968:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1786002647.402984:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561061760 00000100:00100000:2.0:1786002647.402989:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561061760 00000100:00080000:3.0:1786002647.403001:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786002647.403006:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002647.403012:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561062272 00000100:00100000:2.0:1786002647.403016:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561062272 00000100:00100000:2.0:1786002647.403044:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561062016 00000100:00100000:2.0:1786002647.403047:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561062016 00000100:00100000:2.0:1786002647.403058:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561062784 00000100:00100000:2.0:1786002647.403060:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561062784 00000100:00100000:2.0:1786002647.403070:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561062400 00000100:00100000:2.0:1786002647.403072:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561062400 00000100:00100000:2.0:1786002647.403082:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561062912 00000100:00100000:2.0:1786002647.403084:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561062912 00000100:00100000:2.0:1786002647.403096:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1786002647.403102:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561061760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.403138:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561061760:12345-0@lo:400:kworker.0 Request processed in 36us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002647.403147:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1786002647.403159:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1786002647.403165:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561062272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.403187:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561062272:12345-0@lo:400:kworker.0 Request processed in 24us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002647.403193:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1786002647.403203:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1786002647.403209:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561062016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.403233:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561062016:12345-0@lo:400:kworker.0 Request processed in 25us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002647.403239:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1786002647.403249:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1786002647.403254:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561062784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.403278:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561062784:12345-0@lo:400:kworker.0 Request processed in 24us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002647.403283:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1786002647.403294:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1786002647.403300:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561062400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.403325:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561062400:12345-0@lo:400:kworker.0 Request processed in 25us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002647.403330:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1786002647.403341:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1786002647.403347:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561062912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.403368:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561062912:12345-0@lo:400:kworker.0 Request processed in 22us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002647.403374:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00080000:2.0:1786002647.403386:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786002647.403388:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002647.403410:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561061760:0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.403420:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561062272:0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.403427:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561062784:0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.403477:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561061376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002647.403495:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561061632 00000100:00100000:2.0:1786002647.403498:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561061632 00000100:00100000:2.0:1786002647.403521:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1786002647.403527:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561061632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.403554:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561061632:12345-0@lo:400:kworker.0 Request processed in 28us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002647.403561:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1786002647.403585:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561062144 00000100:00100000:2.0:1786002647.403589:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561062144 00000100:00100000:2.0:1786002647.403608:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4115 00000100:00100000:2.0:1786002647.403614:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561062144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.403643:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561062144:12345-0@lo:400:kworker.0 Request processed in 29us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002647.403648:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4115 00000100:00100000:2.0:1786002647.403657:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561061888 00000100:00100000:2.0:1786002647.403660:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561061888 00000100:00100000:2.0:1786002647.403678:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4116 00000100:00100000:2.0:1786002647.403683:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b57b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561061888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.405467:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b57b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561061888:12345-0@lo:400:kworker.0 Request processed in 1778us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002647.405476:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4116 00000100:00100000:2.0:1786002647.405837:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561061888:0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.405865:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561062400:0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.405885:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561062912:0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.405895:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561062016:0@lo:400:kworker.0 00000100:00100000:2.0:1786002647.405921:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561061504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002647.417177:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1786002647.417203:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561062528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002647.417306:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561062528:12345-0@lo:400:kworker.0 Request processed in 117us (14697us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002647.417314:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1786002647.417375:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561062528:0@lo:400:kworker.0 00000100:00100000:1.0:1786002647.417435:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561062144:0@lo:400:kworker.0 00000100:00100000:1.0:1786002647.417447:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561062656:0@lo:400:kworker.0 00000100:00100000:1.0:1786002647.417455:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561061632:0@lo:400:kworker.0 00000100:00100000:0.0:1786002647.420206:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1786002647.438378:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002647.438467:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531032832 00000100:00100000:3.0:1786002647.438476:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531032832 00002000:00010000:3.0:1786002647.438514:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:3.0:1786002647.438518:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f570000 with x1872758531032832 ext(0->18446744073709551615) 00002000:00010000:3.0:1786002647.438529:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f570000. 00000100:00100000:3.0:1786002647.438561:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 38 00000100:00100000:3.0:1786002647.438572:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2410:x1872758531032832:12345-192.168.203.49@tcp:10:dd.0 00002000:00010000:3.0:1786002647.445613:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786002647.445622:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1786002641 -> 1786002647 00002000:00010000:3.0:1786002647.445626:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786002647.445628:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1786002641 -> 1786002647 00002000:00010000:3.0:1786002647.445631:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1786002647.449981:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2410:x1872758531032832:12345-192.168.203.49@tcp:10:dd.0 Request processed in 11399us (11601us total) trans 4294969970 rc 0/0 00000100:00100000:3.0:1786002647.449996:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 38 00002000:00010000:3.0:1786002647.450003:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:3.0:1786002647.450006:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f570000 with x1872758531032832 ext(0->18446744073709551615) 00002000:00010000:3.0:1786002647.450017:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f570000. 00000001:00080000:1.0:1786002647.464229:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969970 is committed 00010000:00010000:3.0:1786002648.042119:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002648.938093:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786002648.938115:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561063040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002648.938175:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002648.938287:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561063040 00000100:00100000:3.0:1786002648.938295:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561063040 00000100:00100000:3.0:1786002648.938343:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4117 00000100:00100000:3.0:1786002648.938352:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561063040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002648.938382:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002648.938426:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561063040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002648.938433:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4117 00000100:00100000:0.0:1786002648.938519:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561063040:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786002649.066056:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786002650.090151:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002650.986411:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002650.986432:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561063168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002650.986496:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002650.986599:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561063168 00000100:00100000:0.0:1786002650.986606:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561063168 00000100:00100000:0.0:1786002650.986664:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1786002650.986672:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561063168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786002650.986695:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 155648 granted 102827712 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1786002650.986735:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561063168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002650.986741:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00080000:2.0:1786002650.986830:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002650.986872:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561063168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002650.987925:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002650.987936:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561063296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002650.987967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002650.988044:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561063296 00000100:00100000:2.0:1786002650.988049:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561063296 00000100:00100000:2.0:1786002650.988092:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1786002650.988099:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561063296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786002650.988110:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 155648 granted 102827712 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002650.988138:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561063296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002650.988153:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00080000:0.0:1786002650.988294:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002650.988347:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561063296:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1786002651.114949:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002651.477313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002651.477355:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002651.477391:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002651.477521:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531032960 00000100:00100000:3.0:1786002651.477531:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531032960 00000100:00100000:3.0:1786002651.477586:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 561 00000100:00100000:3.0:1786002651.477597:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758531032960:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002651.477666:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758531032960:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 71us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002651.477674:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 561 00000100:00100000:2.0:1786002651.477824:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531033216 00000100:00100000:2.0:1786002651.477829:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531033216 00000100:00100000:2.0:1786002651.477920:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1055 00000100:00100000:2.0:1786002651.477929:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531033216:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002651.477958:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531033216:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 32us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002651.477965:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1055 00000100:00080000:0.0:1786002651.478160:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002651.478442:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531033472 00000100:00100000:1.0:1786002651.478448:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531033472 00000100:00100000:1.0:1786002651.478498:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 582 00000100:00100000:1.0:1786002651.478506:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531033472:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002651.478536:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531033472:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 32us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002651.478543:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 582 00000100:00080000:0.0:1786002651.478786:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002651.482105:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002651.482147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002651.483166:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531033344 00000100:00100000:2.0:1786002651.483174:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531033344 00000100:00100000:2.0:1786002651.483238:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 583 00000100:00100000:2.0:1786002651.483247:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531033344:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002651.483307:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531033344:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 61us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002651.483315:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 583 00000100:00100000:1.0:1786002651.485078:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531033088 00000100:00100000:1.0:1786002651.485085:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531033088 00000100:00100000:1.0:1786002651.485149:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1056 00000100:00100000:1.0:1786002651.485158:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531033088:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002651.485226:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531033088:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 63us (3122us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002651.485234:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1056 00000100:00080000:0.0:1786002651.485718:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786002651.485723:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002651.498414:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561063424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002651.498489:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002651.498646:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561063424 00000100:00100000:0.0:1786002651.498654:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561063424 00000100:00100000:0.0:1786002651.498703:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4118 00000100:00100000:0.0:1786002651.498712:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561063424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002651.498744:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:0.0:1786002651.498787:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561063424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002651.498797:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4118 00000100:00100000:0.0:1786002651.498833:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561063424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002651.528259:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002651.528446:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531033600 00000100:00100000:2.0:1786002651.528455:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531033600 00002000:00100000:2.0:1786002651.528512:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed244bbb100 x1872758531033600/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:332/0 lens 488/0 e 0 to 0 dl 1786002662 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002651.528523:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244bbb100 with x1872758531033600 ext(0->4194303) 00002000:00010000:2.0:1786002651.528529:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244bbb100 00000100:00100000:2.0:1786002651.528559:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 39 00000100:00100000:2.0:1786002651.528569:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531033600:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:2.0:1786002651.709317:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758531033600:12345-192.168.203.49@tcp:4:dd.0 Request processed in 180741us (181058us total) trans 4294969971 rc 0/0 00000100:00100000:2.0:1786002651.709331:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 39 00002000:00100000:2.0:1786002651.709343:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed244bbb100 x1872758531033600/t4294969971(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:332/0 lens 488/448 e 0 to 0 dl 1786002662 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002651.709354:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244bbb100 with x1872758531033600 ext(0->4194303) 00002000:00010000:2.0:1786002651.709360:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244bbb100 00010000:00010000:3.0:1786002652.138055:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002652.255039:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002652.255126:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531033856 00000100:00100000:1.0:1786002652.255136:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531033856 00000100:00100000:1.0:1786002652.255199:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5228 00000100:00100000:1.0:1786002652.255210:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20967:x1872758531033856:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:1.0:1786002652.255668:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984157 00000100:00100000:1.0:1786002652.255943:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:20967:x1872758531033856:12345-192.168.203.49@tcp:35:dd.0 Request processed in 734us (910us total) trans 4294984158 rc 0/0 00000100:00100000:1.0:1786002652.255951:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5228 00000020:00080000:1.0:1786002652.255956:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002652.522076:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561063680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002652.522149:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002652.522230:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561064064:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.522259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002652.522277:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561064576:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.522299:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002652.522820:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561065088:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.522864:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002652.522892:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1786002652.522899:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561063936:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.522923:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002652.522939:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561064448:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.522970:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002652.522988:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561064960:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.523008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002652.523140:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561064064 00000100:00100000:3.0:1786002652.523146:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561064064 00000100:00100000:3.0:1786002652.523188:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4119 00000100:00100000:3.0:1786002652.523196:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561064064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002652.523247:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561064064:12345-0@lo:400:kworker.0 Request processed in 51us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002652.523255:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4119 00000100:00100000:3.0:1786002652.523299:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561064576 00000100:00100000:3.0:1786002652.523304:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561064576 00000100:00100000:0.0:1786002652.529538:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561063808:0@lo:400:kworker.0 00000100:00100000:0.0:1786002652.529612:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002652.529657:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561064320:0@lo:400:kworker.0 00000100:00100000:0.0:1786002652.529681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002652.529698:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561064832:0@lo:400:kworker.0 00000100:00100000:0.0:1786002652.529719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002652.529745:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561065344:0@lo:400:kworker.0 00000100:00100000:0.0:1786002652.529766:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002652.529791:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1786002652.529798:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561063552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002652.529820:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002652.529837:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561064192:0@lo:400:kworker.0 00000100:00100000:0.0:1786002652.529884:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002652.529897:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561064704:0@lo:400:kworker.0 00000100:00100000:0.0:1786002652.529917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002652.529934:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561065216:0@lo:400:kworker.0 00000100:00100000:0.0:1786002652.529954:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002652.530001:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561064320 00000100:00100000:0.0:1786002652.530008:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561064320 00000100:00100000:0.0:1786002652.530051:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4120 00000100:00100000:0.0:1786002652.530059:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561064320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002652.530115:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561064320:12345-0@lo:400:kworker.0 Request processed in 55us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002652.530121:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4120 00000100:00100000:0.0:1786002652.530146:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561064832 00000100:00100000:0.0:1786002652.530149:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561064832 00000100:00100000:0.0:1786002652.530174:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561065344 00000100:00100000:0.0:1786002652.530177:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561065344 00000100:00100000:0.0:1786002652.530199:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561064704 00000100:00100000:0.0:1786002652.530202:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561064704 00000100:00100000:0.0:1786002652.530409:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561065216 00000100:00100000:0.0:1786002652.530413:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561065216 00000100:00100000:0.0:1786002652.530437:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:0.0:1786002652.530444:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561064832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.532006:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1786002652.532109:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561065344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002652.532186:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561063808 00000100:00100000:1.0:1786002652.532192:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561063808 00000100:00100000:1.0:1786002652.532243:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1786002652.532251:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561063808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.536795:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561065344:12345-0@lo:400:kworker.0 Request processed in 4689us (7021us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002652.536808:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1786002652.536840:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1786002652.536870:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561064704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.536925:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561064704:12345-0@lo:400:kworker.0 Request processed in 77us (7007us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002652.536931:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1786002652.536944:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1786002652.537533:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561065216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.537569:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561065216:12345-0@lo:400:kworker.0 Request processed in 40us (7614us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002652.537574:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1786002652.537604:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561063680 00000100:00100000:2.0:1786002652.537611:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561063680 00000100:00100000:2.0:1786002652.537656:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561063552 00000100:00100000:2.0:1786002652.537659:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561063552 00000100:00100000:2.0:1786002652.538515:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1786002652.538523:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561063680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002652.538546:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002652.538583:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561063680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (16435us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002652.538589:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1786002652.538600:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1786002652.538606:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561063552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002652.538614:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002652.538648:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561063552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (8827us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002652.538654:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1786002652.539644:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561065088 00000100:00100000:2.0:1786002652.539651:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561065088 00000100:00080000:3.0:1786002652.540346:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786002652.540351:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786002652.540355:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786002652.540370:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561063936 00000100:00100000:3.0:1786002652.540375:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561063936 00000100:00100000:1.0:1786002652.544443:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561063808:12345-0@lo:400:kworker.0 Request processed in 12186us (14823us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002652.544456:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1786002652.544515:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561064448 00000100:00100000:1.0:1786002652.544524:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561064448 00000100:00100000:2.0:1786002652.550737:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561064960 00000100:00100000:2.0:1786002652.550750:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561064960 00000100:00100000:2.0:1786002652.550805:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561064192 00000100:00100000:2.0:1786002652.550808:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561064192 00000100:00100000:2.0:1786002652.550826:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1786002652.550836:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561064576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.550945:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561064576:12345-0@lo:400:kworker.0 Request processed in 111us (28645us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002652.550953:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1786002652.550971:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1786002652.550978:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561065088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.551008:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561065088:12345-0@lo:400:kworker.0 Request processed in 31us (28161us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002652.551021:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1786002652.551034:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1786002652.551040:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561064960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.551067:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561064960:12345-0@lo:400:kworker.0 Request processed in 27us (28058us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002652.551073:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1786002652.551085:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1786002652.551091:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561064192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.551119:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561064192:12345-0@lo:400:kworker.0 Request processed in 28us (21245us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002652.551125:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1786002652.551180:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561064960:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.551193:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561064064:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.551203:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561064576:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.551212:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561065088:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.551230:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561063680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002652.551479:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561063552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002652.551490:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561064192:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.551501:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561064704:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.551509:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561065216:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.551519:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561063808:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.551530:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561064320:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.551538:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561065344:0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.555405:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561064832:0@lo:400:kworker.0 00000100:00100000:0.0:1786002652.555537:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561064832:12345-0@lo:400:kworker.0 Request processed in 25091us (25813us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002652.555549:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00080000:0.0:1786002652.555590:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1786002652.558644:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984158 is committed 00000100:00100000:3.0:1786002652.558803:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1786002652.558817:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561063936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002652.558927:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561063936:12345-0@lo:400:kworker.0 Request processed in 116us (36003us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002652.558935:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1786002652.558975:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561063936:0@lo:400:kworker.0 00010000:00010000:0.0:1786002652.560233:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784172d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002652.560247:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784172d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002652.560254:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784172d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002652.560261:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002652.560266:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784172d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002652.560278:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784172d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002652.560293:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002652.560296:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002652.560301:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784172d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002652.560308:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784172d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002652.562768:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1786002652.562790:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561064448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002652.562930:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561064448:12345-0@lo:400:kworker.0 Request processed in 151us (39957us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002652.562938:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1786002652.563033:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561064448:0@lo:400:kworker.0 00010000:00010000:1.0:1786002653.165400:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002653.284346:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002653.284471:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531033984 00000100:00100000:2.0:1786002653.284484:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531033984 00000100:00100000:2.0:1786002653.284569:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24197 00000100:00100000:2.0:1786002653.284581:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20971:x1872758531033984:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002653.284602:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002653.284620:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784172d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0d3 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.284678:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784172de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.284692:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784172de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.284703:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784172de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002653.284746:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:2.0:1786002653.284750:0:10360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786002653.284770:0:10360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784172de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.284792:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784172d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0d3 expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.284810:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784172de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0d3 expref: 16 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.284819:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002653.284822:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786002653.284826:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3a00, rc 0) 00000100:00100000:2.0:1786002653.284956:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20971:x1872758531033984:12345-192.168.203.49@tcp:101:dd.0 Request processed in 377us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002653.284964:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24197 00000100:00080000:0.0:1786002653.285420:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002653.315628:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002653.315724:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531034240 00000100:00100000:2.0:1786002653.315733:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531034240 00000100:00100000:2.0:1786002653.315795:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24198 00000100:00100000:2.0:1786002653.315806:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20971:x1872758531034240:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002653.315825:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002653.315827:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786002653.315884:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784172de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0d3 expref: 16 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.315903:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002653.315907:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002653.315919:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784172e5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0da expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316029:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784172ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316040:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784172ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316050:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784172ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316063:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af5784172f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316069:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af5784172f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316075:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af5784172f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316122:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af5784172fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316130:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af5784172fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316136:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af5784172fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002653.316144:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ad:0x0]: returning size 5160960 00010000:00010000:2.0:1786002653.316219:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784172ec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316236:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784172ec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316243:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784172ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316249:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784172ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316345:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002653.316351:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784172ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316360:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784172ec lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316369:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002653.316372:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002653.316376:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784172ec lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316383:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784172ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316393:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af5784172f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316400:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af5784172f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316407:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af5784172f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316412:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002653.316415:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af5784172f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316421:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af5784172f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316427:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed243d0ba00) 00010000:00010000:2.0:1786002653.316429:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002653.316432:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af5784172f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316438:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af5784172f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316471:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af5784172e5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0da expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316483:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af5784172fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0da expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.316489:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002653.316491:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002653.316494:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed2400, rc 0) 00000100:00100000:2.0:1786002653.316550:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20971:x1872758531034240:12345-192.168.203.49@tcp:101:dd.0 Request processed in 745us (932us total) trans 4294984159 rc 0/0 00000100:00100000:2.0:1786002653.316558:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24198 00000100:00100000:1.0:1786002653.330411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002653.330506:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531034496 00000100:00100000:2.0:1786002653.330516:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531034496 00000100:00100000:2.0:1786002653.330576:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24199 00000100:00100000:2.0:1786002653.330587:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20971:x1872758531034496:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:2.0:1786002653.330637:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002653.330659:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2400/0x7cee4af5784172fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0da expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.330678:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002653.330683:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002653.330842:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417308 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.330899:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.330909:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002653.330948:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984160 00000004:00010000:2.0:1786002653.330971:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdb957a9 reply state 0000000012e7f845 transno 4294984161 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.330983:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002653.330989:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002653.330991:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002653.330994:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002653.331081:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20971:x1872758531034496:12345-192.168.203.49@tcp:36:dd.0 Request processed in 494us (677us total) trans 4294984161 rc 0/0 00000100:00100000:2.0:1786002653.331089:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24199 00000020:00080000:2.0:1786002653.331093:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002653.422513:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002653.422583:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531034624 00000100:00100000:0.0:1786002653.422593:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531034624 00002000:00010000:0.0:1786002653.422652:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:0.0:1786002653.422657:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a3b80 with x1872758531034624 ext(0->18446744073709551615) 00002000:00010000:0.0:1786002653.422668:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f3a3b80. 00000100:00100000:0.0:1786002653.422699:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 40 00000100:00100000:0.0:1786002653.422709:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2410:x1872758531034624:12345-192.168.203.49@tcp:10:dd.0 00000100:00080000:3.0:1786002653.426036:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1786002653.434516:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786002653.434525:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb mtime from disk: 1786002647 -> 1786002653 00002000:00010000:0.0:1786002653.434528:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786002653.434530:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb ctime from disk: 1786002647 -> 1786002653 00002000:00010000:0.0:1786002653.434532:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa00:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1786002653.434611:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2410:x1872758531034624:12345-192.168.203.49@tcp:10:dd.0 Request processed in 11897us (12101us total) trans 4294969972 rc 0/0 00000100:00100000:0.0:1786002653.434626:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 40 00002000:00010000:0.0:1786002653.434630:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2560 (0->18446744073709551615) 00002000:00100000:0.0:1786002653.434634:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a3b80 with x1872758531034624 ext(0->18446744073709551615) 00002000:00010000:0.0:1786002653.434641:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f3a3b80. 00000100:00100000:0.0:1786002654.058124:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561065472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786002654.058192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002654.058331:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561065472 00000100:00100000:3.0:1786002654.058339:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561065472 00000100:00100000:3.0:1786002654.058391:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4121 00000100:00100000:3.0:1786002654.058401:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561065472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002654.058431:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002654.058478:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561065472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002654.058485:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4121 00000100:00100000:1.0:1786002654.058653:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561065472:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786002654.186093:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002655.210061:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002656.106113:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561065600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002656.106189:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002656.106510:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561065600 00000100:00100000:3.0:1786002656.106520:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561065600 00000100:00100000:3.0:1786002656.106583:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1786002656.106594:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561065600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786002656.106622:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 204800 granted 109160128 pending 4218880 free 3923525632 avail 3692003328 00000100:00100000:3.0:1786002656.106694:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561065600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002656.106703:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1786002656.106752:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561065600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786002656.106904:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002656.106917:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561065728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002656.106946:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002656.107033:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561065728 00000100:00100000:1.0:1786002656.107037:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561065728 00000100:00100000:1.0:1786002656.107080:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1786002656.107088:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561065728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002656.107099:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 204800 granted 109160128 pending 4218880 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002656.107134:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561065728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002656.107141:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1786002656.107169:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561065728:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1786002656.107265:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786002656.234123:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002656.595356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002656.595403:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002656.595432:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002656.595457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002656.595480:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002656.595504:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531035008 00000100:00100000:0.0:1786002656.595512:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531035008 00000100:00100000:0.0:1786002656.595561:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531034880 00000100:00100000:0.0:1786002656.595564:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531034880 00000100:00100000:0.0:1786002656.595582:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1063 00000100:00100000:0.0:1786002656.595591:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531035008:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002656.595654:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531035008:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 64us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002656.595661:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1063 00000100:00100000:0.0:1786002656.595677:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1064 00000100:00100000:0.0:1786002656.595683:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531034880:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002656.595711:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531034880:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002656.595717:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1064 00000100:00100000:0.0:1786002656.595735:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531035264 00000100:00100000:0.0:1786002656.595739:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531035264 00000100:00100000:1.0:1786002656.595744:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531035136 00000100:00100000:1.0:1786002656.595751:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531035136 00000100:00100000:0.0:1786002656.595780:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 588 00000100:00100000:0.0:1786002656.595791:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531035264:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002656.595796:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 589 00000100:00100000:1.0:1786002656.595809:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2411:x1872758531035136:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002656.595822:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531035264:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 33us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002656.595829:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 588 00000100:00080000:0.0:1786002656.595898:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786002656.595903:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002656.595904:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2411:x1872758531035136:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 42us (365us total) trans 0 rc 0/0 00000100:00080000:0.0:1786002656.595907:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786002656.595912:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002656.595916:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 589 00000100:00100000:2.0:1786002656.596276:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531034752 00000100:00100000:2.0:1786002656.596281:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531034752 00000100:00100000:2.0:1786002656.596315:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 563 00000100:00100000:2.0:1786002656.596323:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758531034752:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002656.596358:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758531034752:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 36us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002656.596364:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 563 00000100:00100000:0.0:1786002656.626036:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561065856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002656.626107:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002656.626234:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561065856 00000100:00100000:2.0:1786002656.626242:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561065856 00000100:00100000:2.0:1786002656.626291:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4122 00000100:00100000:2.0:1786002656.626300:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561065856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786002656.626332:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:2.0:1786002656.626384:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561065856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002656.626391:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4122 00000100:00100000:0.0:1786002656.626636:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561065856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002656.654937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002656.655055:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531035392 00000100:00100000:2.0:1786002656.655064:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531035392 00002000:00100000:2.0:1786002656.655112:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed2454c9880 x1872758531035392/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:337/0 lens 488/0 e 0 to 0 dl 1786002667 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002656.655123:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2454c9880 with x1872758531035392 ext(0->4194303) 00002000:00010000:2.0:1786002656.655129:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2454c9880 00000100:00100000:2.0:1786002656.655159:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 41 00000100:00100000:2.0:1786002656.655168:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758531035392:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:2.0:1786002656.736312:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758531035392:12345-192.168.203.49@tcp:4:dd.0 Request processed in 81134us (81374us total) trans 4294969973 rc 0/0 00000100:00100000:2.0:1786002656.736326:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 41 00002000:00100000:2.0:1786002656.736339:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xa00:0x0] (0->4194303) req@ffff9ed2454c9880 x1872758531035392/t4294969973(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:337/0 lens 488/448 e 0 to 0 dl 1786002667 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002656.736350:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2454c9880 with x1872758531035392 ext(0->4194303) 00002000:00010000:2.0:1786002656.736357:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2454c9880 00000001:00080000:0.0:1786002656.739583:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969973 is committed 00010000:00010000:3.0:1786002657.258424:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002657.642135:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed370e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561065984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002657.642204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002657.642253:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561066240:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.642271:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758561066496:0@lo:400:kworker.0 00000100:00100000:1.0:1786002657.642289:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002657.642316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002657.642318:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24322f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561066752:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.642341:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561067008:0@lo:400:kworker.0 00000100:00100000:1.0:1786002657.642352:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002657.642369:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002657.642399:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561067264:0@lo:400:kworker.0 00000100:00100000:0.0:1786002657.642449:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561066368:0@lo:400:kworker.0 00000100:00100000:2.0:1786002657.642490:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561065984 00000100:00100000:2.0:1786002657.642497:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561065984 00000100:00100000:2.0:1786002657.642543:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1786002657.642552:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561065984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002657.642576:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1786002657.651470:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561067520:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.651536:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002657.651583:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1786002657.651591:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561066112:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.651619:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002657.651643:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24322e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561066624:0@lo:400:kworker.0 00000100:00100000:1.0:1786002657.654139:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002657.654214:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561066240 00000100:00100000:1.0:1786002657.654222:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561066240 00000100:00100000:1.0:1786002657.654268:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561066496 00000100:00100000:1.0:1786002657.654272:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561066496 00000100:00100000:1.0:1786002657.654285:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561066752 00000100:00100000:1.0:1786002657.654288:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561066752 00000100:00100000:1.0:1786002657.654304:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561067264 00000100:00100000:1.0:1786002657.654306:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561067264 00000100:00100000:1.0:1786002657.654323:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1786002657.654332:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561066240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002657.654946:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561066240:12345-0@lo:400:kworker.0 Request processed in 612us (12654us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002657.654954:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1786002657.654974:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1786002657.654981:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758561066496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002657.655075:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758561066496:12345-0@lo:400:kworker.0 Request processed in 94us (12759us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002657.655082:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1786002657.655094:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1786002657.655101:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561066752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002657.655129:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561066752:12345-0@lo:400:kworker.0 Request processed in 29us (12777us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002657.655135:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1786002657.655147:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1786002657.655153:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561067264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002657.655177:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561067264:12345-0@lo:400:kworker.0 Request processed in 25us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002657.655183:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1786002657.655476:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561067008 00000100:00100000:3.0:1786002657.655481:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561067008 00000100:00100000:3.0:1786002657.655510:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561067520 00000100:00100000:3.0:1786002657.655514:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561067520 00000100:00100000:3.0:1786002657.655533:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1786002657.655539:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561067008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.655575:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561067008:12345-0@lo:400:kworker.0 Request processed in 37us (13206us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002657.655581:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1786002657.655596:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:3.0:1786002657.655604:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561067520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002657.655632:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561066240:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.655638:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561067520:12345-0@lo:400:kworker.0 Request processed in 34us (4100us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002657.655651:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24322f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561066752:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.655658:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:1.0:1786002657.655664:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561067264:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.655690:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561066112 00000100:00100000:3.0:1786002657.655695:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561066112 00000100:00100000:1.0:1786002657.655751:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561067776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002657.655782:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786002657.655818:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786002657.657081:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002657.657119:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561067776 00000100:00100000:1.0:1786002657.657125:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561067776 00000100:00100000:1.0:1786002657.657152:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1786002657.657159:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561067776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786002657.657176:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1786002657.657219:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561067776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002657.657226:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1786002657.657260:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561067776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786002657.657423:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1786002657.657432:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561066112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.657469:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561066112:12345-0@lo:400:kworker.0 Request processed in 40us (5849us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002657.657475:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1786002657.657525:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002657.657550:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561066624 00000100:00100000:3.0:1786002657.657553:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561066624 00000100:00100000:3.0:1786002657.657579:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4123 00000100:00100000:3.0:1786002657.657586:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561066624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.657620:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561066624:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002657.657625:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4123 00000100:00100000:3.0:1786002657.657653:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24322e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561066624:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.657662:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561067136:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.657810:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002657.657830:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561067648:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.657878:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002657.657904:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758561066496:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.657922:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561067008:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.657933:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561067520:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.657959:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561066112:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.657994:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561067136 00000100:00100000:3.0:1786002657.657998:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561067136 00000100:00100000:3.0:1786002657.658035:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561067648 00000100:00100000:3.0:1786002657.658039:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561067648 00000100:00100000:0.0:1786002657.658043:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1786002657.658055:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561067136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.658063:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1786002657.658073:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3646:x1872758561067648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002657.658113:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561067136:12345-0@lo:400:kworker.0 Request processed in 61us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002657.658116:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3646:x1872758561067648:12345-0@lo:400:kworker.0 Request processed in 45us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002657.658126:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1786002657.658135:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1786002657.658165:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002657.658183:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561067136:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.658198:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561067648:0@lo:400:kworker.0 00000100:00100000:0.0:1786002657.658201:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24322f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561066880:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.658232:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561066368 00000100:00100000:3.0:1786002657.658237:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561066368 00000100:00100000:0.0:1786002657.658239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002657.658269:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561066880 00000100:00100000:3.0:1786002657.658273:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4124 00000100:00100000:0.0:1786002657.658274:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561066880 00000100:00100000:0.0:1786002657.658310:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1786002657.658316:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561066880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002657.658344:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561066880:12345-0@lo:400:kworker.0 Request processed in 28us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002657.658349:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00080000:0.0:1786002657.658365:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002657.658382:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24322f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561066880:0@lo:400:kworker.0 00000100:00100000:0.0:1786002657.658389:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561067392:0@lo:400:kworker.0 00000100:00100000:0.0:1786002657.658411:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002657.659814:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561066368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.659896:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561066368:12345-0@lo:400:kworker.0 Request processed in 1615us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002657.659905:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4124 00000100:00100000:3.0:1786002657.659937:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561067392 00000100:00100000:3.0:1786002657.659942:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561067392 00000100:00100000:3.0:1786002657.659979:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1786002657.659985:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561067392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.660014:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561067392:12345-0@lo:400:kworker.0 Request processed in 29us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002657.660020:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00080000:0.0:1786002657.660314:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002657.660345:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561066368:0@lo:400:kworker.0 00000100:00100000:0.0:1786002657.660356:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561067392:0@lo:400:kworker.0 00000100:00100000:3.0:1786002657.678912:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561065984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36354us (36700us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002657.678926:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:0.0:1786002657.679064:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed370e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561065984:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786002658.282380:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002658.294312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002658.294496:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531035648 00000100:00100000:3.0:1786002658.294506:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531035648 00000100:00100000:3.0:1786002658.294575:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5229 00000100:00100000:3.0:1786002658.294586:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:20971:x1872758531035648:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:3.0:1786002658.294799:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984162 00000100:00100000:3.0:1786002658.294962:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:20971:x1872758531035648:12345-192.168.203.49@tcp:35:dd.0 Request processed in 376us (657us total) trans 4294984163 rc 0/0 00000100:00100000:3.0:1786002658.294970:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5229 00000020:00080000:3.0:1786002658.294975:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1786002658.295283:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1786002658.668585:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984163 is committed 00010000:00010000:2.0:1786002658.668726:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002658.668739:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417308 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002658.668746:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002658.668752:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002658.668756:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002658.668763:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417308 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002658.668778:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002658.668781:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002658.668785:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417308 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002658.668792:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417308 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x15ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002659.178173:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f3a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561067904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786002659.178247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002659.178397:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561067904 00000100:00100000:3.0:1786002659.178405:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561067904 00000100:00100000:3.0:1786002659.178455:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4125 00000100:00100000:3.0:1786002659.178464:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561067904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002659.178495:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002659.180949:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561067904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2480us (2695us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002659.180965:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4125 00000100:00100000:1.0:1786002659.183960:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f3a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561067904:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1786002659.306392:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002659.306479:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002659.306552:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531035776 00000100:00100000:1.0:1786002659.306560:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531035776 00000100:00100000:1.0:1786002659.306618:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24200 00000100:00100000:1.0:1786002659.306627:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20975:x1872758531035776:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:1.0:1786002659.306649:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002659.306665:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841730f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0e1 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002659.306738:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417316 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002659.306748:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002659.306757:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002659.306797:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:1.0:1786002659.306801:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786002659.306837:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002659.306875:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a800/0x7cee4af57841730f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0e1 expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002659.306891:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417316 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0e1 expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002659.306899:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002659.306902:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786002659.306906:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556be00, rc 0) 00000100:00100000:1.0:1786002659.306963:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20975:x1872758531035776:12345-192.168.203.49@tcp:101:rm.0 Request processed in 337us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002659.306969:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24200 00000100:00100000:2.0:1786002659.324137:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002659.324197:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531035904 00000100:00100000:0.0:1786002659.324207:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531035904 00000100:00100000:0.0:1786002659.324265:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24201 00000100:00100000:0.0:1786002659.324276:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:20975:x1872758531035904:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:0.0:1786002659.324296:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002659.324315:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af57841731d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324374:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417324 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324388:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417324 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324398:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417324 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324411:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af57841732b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324419:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af57841732b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324425:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af57841732b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324484:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578417332 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324492:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578417332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324498:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578417332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002659.324536:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x15ad:0x0]: returning size 7372800 00000004:00200000:0.0:1786002659.324541:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786002659.324558:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578417332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324570:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578417332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324579:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417324 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324586:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417324 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324592:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417324 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324598:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417324 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324604:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002659.324608:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417324 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324615:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417324 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324628:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002659.324631:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002659.324637:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417324 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324643:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417324 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324661:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af57841732b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324667:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af57841732b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324673:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af57841732b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324679:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002659.324682:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af57841732b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324688:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af57841732b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324695:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed2456ae600) 00010000:00010000:0.0:1786002659.324697:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002659.324700:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af57841732b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324705:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af57841732b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324732:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af57841731d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0e8 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324746:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578417332 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0e8 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.324759:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002659.324761:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002659.324764:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245716a00, rc 0) 00000100:00100000:0.0:1786002659.324841:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20975:x1872758531035904:12345-192.168.203.49@tcp:101:rm.0 Request processed in 566us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002659.324893:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24201 00000100:00100000:3.0:1786002659.355261:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002659.355363:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531036160 00000100:00100000:0.0:1786002659.355373:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531036160 00000100:00100000:0.0:1786002659.355433:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24202 00000100:00100000:0.0:1786002659.355443:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:20975:x1872758531036160:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:0.0:1786002659.355493:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1786002659.355521:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3600/0x7cee4af578417148 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x15ad:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b06a expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.355542:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716a00/0x7cee4af578417332 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0e8 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.355555:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af57841713a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ad:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b063 expref: 15 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.355565:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002659.355579:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417316 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0e1 expref: 14 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.355586:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002659.355590:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002659.355607:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417339 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.355617:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417339 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.355624:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417339 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.355635:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417340 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.355641:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417340 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.355647:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417340 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.355712:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417347 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.355720:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417347 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.355726:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417347 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786002659.355993:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].51, 64 off11456 00000004:00080000:0.0:1786002659.356003:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1019537154783ns, next at 1020537152706ns, rc = 0 00010000:00010000:0.0:1786002659.356057:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af57841734e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356071:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af57841734e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356079:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af57841734e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356086:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af57841734e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356092:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af57841734e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356099:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af57841734e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356121:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786002659.356138:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417347 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15ad:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356144:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417347 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15ad:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356149:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417347 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15ad:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356155:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002659.356159:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417347 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15ad:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356166:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417347 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15ad:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356177:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed2456aec00) 00010000:00010000:0.0:1786002659.356179:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786002659.356182:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417347 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15ad:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356187:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717c00/0x7cee4af578417347 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15ad:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356203:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417339 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356209:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417339 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356215:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417339 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356220:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417339 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356224:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002659.356226:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417339 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356232:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417339 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356238:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002659.356241:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002659.356243:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417339 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356252:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716c00/0x7cee4af578417339 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002659.356260:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d2056b1 reply state 00000000a6c67c23 transno 4294984164 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417340 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356269:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417340 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002659.356274:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed2456ae600) 00010000:00010000:0.0:1786002659.356276:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002659.356278:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002659.356344:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:20975:x1872758531036160:12345-192.168.203.49@tcp:36:rm.0 Request processed in 901us (1090us total) trans 4294984164 rc 0/0 00000100:00100000:0.0:1786002659.356351:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24202 00010000:00010000:3.0:1786002659.356840:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002659.356880:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af57841734e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002659.356888:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717200 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002659.356891:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af57841734e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002659.356898:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af57841734e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002659.356908:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ad:0x0].0x0 (ffff9ed2456aec00) 00010000:00010000:3.0:1786002659.356911:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002659.356914:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af57841734e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002659.356922:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717200/0x7cee4af57841734e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15ad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002659.356935:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002659.356937:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002659.356938:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002660.331216:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002661.228080:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786002661.228101:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561068032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786002661.228165:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002661.228229:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561068032 00000100:00100000:3.0:1786002661.228237:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561068032 00000100:00100000:3.0:1786002661.228401:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1786002661.228410:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561068032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786002661.228438:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3919331328 avail 3687809024 00000100:00100000:3.0:1786002661.228482:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561068032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002661.228489:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00080000:3.0:1786002661.228510:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002661.228542:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561068032:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1786002661.228718:0:8759:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1021409869103ns, next at 1022409866434ns, rc = 0 00000100:00100000:0.0:1786002661.228736:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786002661.228744:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561068160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002661.228770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002661.228935:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561068160 00000100:00100000:3.0:1786002661.228940:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561068160 00000100:00100000:3.0:1786002661.228973:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1786002661.228979:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561068160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786002661.228989:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3919331328 avail 3687809024 00000100:00100000:3.0:1786002661.229019:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561068160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002661.229026:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1786002661.229052:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561068160:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786002661.229095:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786002661.354096:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002661.717754:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002661.717880:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531036416 00000100:00100000:1.0:1786002661.717890:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531036416 00000100:00100000:1.0:1786002661.717950:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1071 00000100:00100000:1.0:1786002661.717961:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2413:x1872758531036416:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002661.718037:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2413:x1872758531036416:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 77us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002661.718045:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1071 00000100:00080000:0.0:1786002661.718184:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002661.721887:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002661.721926:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002661.722012:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531036672 00000100:00100000:1.0:1786002661.722021:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531036672 00000100:00100000:1.0:1786002661.722075:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 594 00000100:00100000:1.0:1786002661.722084:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531036672:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002661.722146:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531036672:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 63us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002661.722165:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 594 00000100:00080000:1.0:1786002661.722202:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002661.722698:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002661.722732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002661.722754:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531036800 00000100:00100000:2.0:1786002661.722758:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531036800 00000100:00100000:2.0:1786002661.722791:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 595 00000100:00100000:2.0:1786002661.722799:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531036800:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002661.722844:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531036800:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 46us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002661.722869:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 595 00000100:00100000:1.0:1786002661.723409:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531036544 00000100:00100000:1.0:1786002661.723414:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531036544 00000100:00100000:1.0:1786002661.723461:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1072 00000100:00100000:1.0:1786002661.723469:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531036544:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002661.723501:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2413:x1872758531036544:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 34us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002661.723508:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1072 00000100:00080000:1.0:1786002661.723525:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786002661.723529:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002661.726440:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531036288 00000100:00100000:0.0:1786002661.726451:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531036288 00000100:00100000:1.0:1786002661.728710:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 565 00000100:00100000:1.0:1786002661.728725:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531036288:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002661.728792:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531036288:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 72us (6866us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002661.728800:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 565 00000100:00100000:0.0:1786002661.738048:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002661.738071:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561068288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002661.738136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002661.738244:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561068288 00000100:00100000:2.0:1786002661.738341:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561068288 00000100:00100000:2.0:1786002661.738397:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4126 00000100:00100000:2.0:1786002661.738407:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561068288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786002661.738439:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:2.0:1786002661.738483:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561068288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002661.738490:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4126 00000100:00100000:2.0:1786002661.738528:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561068288:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1786002662.380254:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002662.763360:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561068416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002662.763441:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002662.763631:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561068416 00000100:00100000:2.0:1786002662.763638:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561068416 00000100:00100000:2.0:1786002662.763696:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1786002662.763706:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561068416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002662.763732:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002662.763794:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561068416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002662.763802:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1786002662.763876:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561068416:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786002662.764074:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002662.764463:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002662.764473:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561068544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002662.764504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002662.764532:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561068544 00000100:00100000:0.0:1786002662.764536:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561068544 00000100:00100000:0.0:1786002662.764564:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1786002662.764571:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561068544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786002662.764581:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1786002662.764618:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561068544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002662.764625:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00080000:0.0:1786002662.764639:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002662.764657:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561068544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002662.765897:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002662.765907:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561068800:0@lo:400:kworker.0 00000100:00100000:2.0:1786002662.765954:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002662.766016:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561068928:0@lo:400:kworker.0 00000100:00100000:2.0:1786002662.766052:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002662.766092:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002662.766096:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561069312:0@lo:400:kworker.0 00000100:00100000:2.0:1786002662.766128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002662.766173:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561069440:0@lo:400:kworker.0 00000100:00100000:2.0:1786002662.766198:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002662.766239:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786002662.766426:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786002662.766435:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758561069952:0@lo:400:kworker.0 00000100:00100000:3.0:1786002662.766460:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002662.766552:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561069824:0@lo:400:kworker.0 00000100:00100000:2.0:1786002662.766579:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002662.766713:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561068800 00000100:00100000:1.0:1786002662.766718:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561068800 00000100:00100000:1.0:1786002662.766756:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561069312 00000100:00100000:1.0:1786002662.766761:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561069312 00000100:00100000:1.0:1786002662.766790:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561069440 00000100:00100000:1.0:1786002662.766794:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561069440 00000100:00100000:1.0:1786002662.766817:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561069952 00000100:00100000:1.0:1786002662.766820:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561069952 00000100:00100000:1.0:1786002662.766831:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561069824 00000100:00100000:1.0:1786002662.766833:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561069824 00000100:00100000:1.0:1786002662.766864:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:1.0:1786002662.766873:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561068800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.766915:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561068800:12345-0@lo:400:kworker.0 Request processed in 44us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002662.766922:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:1.0:1786002662.766935:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1786002662.766940:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561069312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.766963:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561069312:12345-0@lo:400:kworker.0 Request processed in 23us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002662.766968:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1786002662.766978:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1786002662.766994:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561069440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.767018:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561069440:12345-0@lo:400:kworker.0 Request processed in 35us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002662.767024:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1786002662.767034:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1786002662.767039:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758561069952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.767065:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758561069952:12345-0@lo:400:kworker.0 Request processed in 25us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002662.767071:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1786002662.767082:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1786002662.767088:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561069824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.767112:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561069824:12345-0@lo:400:kworker.0 Request processed in 25us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002662.767117:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1786002662.767319:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758561069056:0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.767350:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002662.767369:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561069568:0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.767392:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002662.767411:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1786002662.767479:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561068672:0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.767508:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002662.767535:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561069184:0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.767556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002662.767574:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561069696:0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.767596:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002662.767698:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561069056 00000100:00100000:3.0:1786002662.767702:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561069056 00000100:00100000:3.0:1786002662.767731:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1786002662.767737:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758561069056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002662.767784:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1872758561069056:12345-0@lo:400:kworker.0 Request processed in 47us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002662.767790:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1786002662.767839:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561068672 00000100:00100000:3.0:1786002662.767843:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561068672 00000100:00100000:3.0:1786002662.767884:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1786002662.767891:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561068672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002662.767920:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561068672:12345-0@lo:400:kworker.0 Request processed in 29us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002662.767926:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1786002662.767952:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561069568 00000100:00100000:3.0:1786002662.767956:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561069568 00000100:00100000:3.0:1786002662.767979:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561069696 00000100:00100000:3.0:1786002662.767982:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561069696 00000100:00100000:3.0:1786002662.768014:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:3.0:1786002662.768020:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561069568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002662.768049:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561069568:12345-0@lo:400:kworker.0 Request processed in 29us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002662.768054:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:3.0:1786002662.768064:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:3.0:1786002662.768070:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561069696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002662.768096:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561069696:12345-0@lo:400:kworker.0 Request processed in 27us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002662.768102:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:3.0:1786002662.768132:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758561069952:0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.768502:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561069696:0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.768511:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1872758561069056:0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.768518:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561069568:0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.768536:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561068672:0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.768554:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561068928 00000100:00100000:1.0:1786002662.768558:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561068928 00000100:00100000:1.0:1786002662.768580:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561069184 00000100:00100000:1.0:1786002662.768582:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561069184 00000100:00100000:1.0:1786002662.768596:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4127 00000100:00100000:1.0:1786002662.768601:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561068928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002662.768702:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561069824:0@lo:400:kworker.0 00000100:00100000:3.0:1786002662.768712:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561069440:0@lo:400:kworker.0 00000100:00100000:3.0:1786002662.768720:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561069312:0@lo:400:kworker.0 00000100:00100000:3.0:1786002662.768729:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561068800:0@lo:400:kworker.0 00000100:00100000:1.0:1786002662.769107:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561068928:12345-0@lo:400:kworker.0 Request processed in 504us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002662.769113:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4127 00000100:00100000:1.0:1786002662.769125:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4128 00000100:00100000:1.0:1786002662.769131:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561069184:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786002662.769232:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786002662.769237:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786002662.769346:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561069184:12345-0@lo:400:kworker.0 Request processed in 215us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002662.769352:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4128 00000100:00100000:2.0:1786002662.769710:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561069184:0@lo:400:kworker.0 00000100:00100000:3.0:1786002662.770078:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561068928:0@lo:400:kworker.0 00000100:00100000:2.0:1786002662.815352:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002662.815547:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531036928 00000100:00100000:1.0:1786002662.815557:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531036928 00000100:00100000:1.0:1786002662.815655:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24203 00000100:00100000:1.0:1786002662.815666:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:21147:x1872758531036928:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002662.815691:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002662.815711:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0ef expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002662.815772:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841735c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002662.815785:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841735c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002662.815797:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841735c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002662.815869:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:1.0:1786002662.815873:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786002662.815890:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841735c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002662.815912:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b000/0x7cee4af578417355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0ef expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002662.815929:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841735c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0ef expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002662.815937:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002662.815940:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786002662.815943:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a200, rc 0) 00000100:00100000:1.0:1786002662.816015:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:21147:x1872758531036928:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 351us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002662.816021:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24203 00000100:00100000:0.0:1786002662.830790:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002662.830919:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531037056 00000100:00100000:3.0:1786002662.830927:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531037056 00000100:00100000:3.0:1786002662.830994:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24204 00000100:00100000:3.0:1786002662.831003:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:21147:x1872758531037056:12345-192.168.203.49@tcp:41:lfs.0 00000004:00000024:3.0:1786002662.831036:0:10360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:3.0:1786002662.831098:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:21147:x1872758531037056:12345-192.168.203.49@tcp:41:lfs.0 Request processed in 96us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002662.831107:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24204 00000100:00100000:2.0:1786002662.836467:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002662.840109:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531037184 00000100:00100000:0.0:1786002662.840121:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531037184 00000100:00100000:0.0:1786002662.840190:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24205 00000100:00100000:0.0:1786002662.840201:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:21147:x1872758531037184:12345-192.168.203.49@tcp:41:lfs.0 00000004:00000024:0.0:1786002662.840238:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:0.0:1786002662.841318:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:21147:x1872758531037184:12345-192.168.203.49@tcp:41:lfs.0 Request processed in 1115us (4914us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002662.841327:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24205 00000100:00100000:2.0:1786002662.861571:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002662.861646:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531037312 00000100:00100000:0.0:1786002662.861655:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531037312 00000100:00100000:0.0:1786002662.861714:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 582 00000100:00100000:0.0:1786002662.861724:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:21147:x1872758531037312:12345-192.168.203.49@tcp:13:lfs.0 00002000:00000024:0.0:1786002662.861761:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3919331328 avail 3687809024 00000100:00100000:0.0:1786002662.861844:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:21147:x1872758531037312:12345-192.168.203.49@tcp:13:lfs.0 Request processed in 121us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002662.861877:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 582 00000100:00100000:1.0:1786002662.866227:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002662.866308:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531037440 00000100:00100000:3.0:1786002662.866316:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531037440 00000100:00100000:3.0:1786002662.866373:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 583 00000100:00100000:3.0:1786002662.866382:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:21147:x1872758531037440:12345-192.168.203.49@tcp:13:lfs.0 00002000:00000024:3.0:1786002662.866404:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1786002662.866467:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:21147:x1872758531037440:12345-192.168.203.49@tcp:13:lfs.0 Request processed in 86us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002662.866475:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 583 00010000:00010000:3.0:1786002663.402218:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002664.303464:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561070080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002664.303532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002664.304253:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561070080 00000100:00100000:0.0:1786002664.304262:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561070080 00000100:00100000:0.0:1786002664.304321:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4129 00000100:00100000:0.0:1786002664.304331:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561070080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1786002664.304361:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:0.0:1786002664.307277:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561070080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2940us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002664.307288:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4129 00000100:00100000:1.0:1786002664.314995:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561070080:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786002664.426021:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786002664.817290:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 95 committed 00000001:00080000:0.0:1786002664.817338:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984164 is committed 00000004:00080000:0.0:1786002664.817343:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 94 committed 00010000:00010000:3.0:1786002664.817407:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417340 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002664.817419:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417340 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002664.817427:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417340 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002664.817434:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002664.817439:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417340 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002664.817447:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417340 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002664.817462:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x549e6bcb (ffff9ed2456ae600) 00010000:00010000:3.0:1786002664.817466:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002664.817471:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417340 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002664.817477:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716e00/0x7cee4af578417340 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x549e6bcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002664.817667:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002664.817685:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561070208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786002664.817748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002664.817878:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561070208 00000100:00100000:0.0:1786002664.817885:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561070208 00000100:00100000:0.0:1786002664.817941:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5348 00000100:00100000:0.0:1786002664.817961:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561070208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1786002664.817985:0:14691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2560 count 1 00010000:00010000:0.0:1786002664.818006:0:14691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002664.818025:0:14691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7d185ad/0x7cee4af578417109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b04e expref: 5 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002664.818034:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xa00:0x0].0x0 since=65s v=(0 0) 00010000:00010000:0.0:1786002664.818039:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786002664.818044:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 4/0,1 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002664.818070:0:14691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7d185ad/0x7cee4af578417109 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b04e expref: 5 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002664.818084:0:14691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7d185ad/0x7cee4af578417109 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b04e expref: 5 pid: 14691 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002664.818096:0:14691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14691:1872758561070336:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002664.818159:0:14691:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d3f600 going to sleep for 11 seconds 00000100:00080000:2.0:1786002664.818535:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002664.827407:0:14691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:14691:1872758561070336:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002664.827434:0:14691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002664.832495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002664.832586:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531037568 00000100:00100000:3.0:1786002664.832595:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531037568 00010000:00010000:3.0:1786002664.832642:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d185ad/0x7cee4af578417109 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b04e expref: 6 pid: 14691 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002664.832681:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1699 00000100:00100000:3.0:1786002664.832690:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531037568:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002664.832703:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002664.832709:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000d7d185ad/0x7cee4af578417109 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b04e expref: 6 pid: 14691 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002664.832723:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7d185ad/0x7cee4af578417109 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b04e expref: 6 pid: 14691 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002664.832749:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d185ad/0x7cee4af578417109 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b04e expref: 6 pid: 14691 timeout: 1124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002664.832766:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1786002664.832772:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786002664.832778:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002664.832787:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002664.832832:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002664.832915:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:2413:x1872758531037568:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 225us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002664.832922:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1699 00010000:00010000:1.0:1786002664.833023:0:14691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002664.833040:0:14691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786002664.833049:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786002664.833051:0:14691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002664.833060:0:14691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002664.833085:0:14691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786002664.833242:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3646:x1872758561070208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15292us (15493us total) trans 4294969974 rc 0/0 00000100:00100000:1.0:1786002664.833251:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5348 00010000:00010000:2.0:1786002664.833306:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786002664.833314:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002664.833322:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:2.0:1786002664.833326:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002664.833335:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002664.833347:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002664.833354:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d3020e2/0x7cee4af578417363 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002664.833369:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002664.833371:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002664.833373:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786002664.838247:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed37136c380/2, rc 0, transno 4294969974 00000100:00100000:3.0:1786002664.838260:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561070208:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1786002665.458972:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002666.346011:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786002666.346032:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2465fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561070464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002666.346796:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786002666.346809:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561070592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1786002666.346890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002666.346933:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561070592 00000100:00100000:0.0:1786002666.346941:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561070592 00000100:00100000:0.0:1786002666.347011:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:0.0:1786002666.347021:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561070592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786002666.347047:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1786002666.347093:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561070592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002666.347100:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00080000:0.0:1786002666.347262:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002666.347301:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561070592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786002666.347619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002666.347642:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561070464 00000100:00100000:0.0:1786002666.347647:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561070464 00000100:00100000:0.0:1786002666.347695:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:0.0:1786002666.347702:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1872758561070464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786002666.347714:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1786002666.347744:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1872758561070464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002666.347749:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:3.0:1786002666.347825:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2465fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561070464:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786002666.348934:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786002666.473977:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002666.851571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002666.851611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002666.851644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002666.851666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002666.851701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002666.851727:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531038208 00000100:00100000:1.0:1786002666.851736:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531038208 00000100:00100000:1.0:1786002666.851797:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531038080 00000100:00100000:1.0:1786002666.851800:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531038080 00000100:00100000:1.0:1786002666.851822:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 598 00000100:00100000:1.0:1786002666.851830:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531038208:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002666.851917:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531038208:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 87us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002666.851925:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 598 00000100:00100000:1.0:1786002666.851940:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 599 00000100:00100000:1.0:1786002666.851946:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:2412:x1872758531038080:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002666.851968:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:2412:x1872758531038080:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002666.851974:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 599 00000100:00080000:1.0:1786002666.851990:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786002666.851993:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002666.852423:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531037952 00000100:00100000:2.0:1786002666.852428:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531037952 00000100:00100000:2.0:1786002666.852473:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531037824 00000100:00100000:2.0:1786002666.852477:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531037824 00000100:00100000:2.0:1786002666.852499:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1079 00000100:00100000:2.0:1786002666.852508:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531037952:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002666.852544:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531037952:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 38us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002666.852551:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1079 00000100:00100000:2.0:1786002666.852564:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1080 00000100:00100000:2.0:1786002666.852570:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2412:x1872758531037824:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002666.852593:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2412:x1872758531037824:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002666.852599:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1080 00000100:00100000:3.0:1786002666.852705:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531037696 00000100:00100000:3.0:1786002666.852709:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531037696 00000100:00100000:3.0:1786002666.852748:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 567 00000100:00100000:3.0:1786002666.852756:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758531037696:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002666.852794:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758531037696:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 39us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002666.852801:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 567 00000100:00080000:1.0:1786002666.854520:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786002666.854525:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002666.858131:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786002666.858153:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561070720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1786002666.858223:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002666.858419:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561070720 00000100:00100000:1.0:1786002666.858427:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561070720 00000100:00100000:1.0:1786002666.858480:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4130 00000100:00100000:1.0:1786002666.858489:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561070720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786002666.858524:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:1.0:1786002666.858572:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561070720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002666.858579:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4130 00000100:00100000:2.0:1786002666.858905:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561070720:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1786002667.498061:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002667.882227:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758561070848:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882304:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882344:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561071360:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882380:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561071872:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882397:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882409:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561072384:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882422:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882442:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1786002667.882446:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561071232:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882476:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561071744:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882490:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882503:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561072256:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882540:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561071104:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882557:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882572:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561071616:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882592:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882608:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561072128:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882629:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882647:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1786002667.882652:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561070976:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882674:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882690:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed366d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561071488:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882736:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561072000:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882754:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.882788:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561070848 00000100:00100000:2.0:1786002667.882794:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561070848 00000100:00100000:2.0:1786002667.882867:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1786002667.882876:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758561070848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.882919:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758561070848:12345-0@lo:400:kworker.0 Request processed in 44us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.882925:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1786002667.882968:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561071360 00000100:00100000:2.0:1786002667.882971:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561071360 00000100:00100000:2.0:1786002667.883004:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561071104 00000100:00100000:2.0:1786002667.883006:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561071104 00000100:00100000:2.0:1786002667.883036:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4131 00000100:00100000:2.0:1786002667.883041:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561071360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883068:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561071360:12345-0@lo:400:kworker.0 Request processed in 27us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.883073:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4131 00000100:00100000:2.0:1786002667.883097:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4132 00000100:00100000:2.0:1786002667.883101:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561071104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883129:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561071104:12345-0@lo:400:kworker.0 Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.883135:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4132 00000100:00100000:2.0:1786002667.883152:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561071872 00000100:00100000:2.0:1786002667.883156:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561071872 00000100:00100000:2.0:1786002667.883178:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561072384 00000100:00100000:2.0:1786002667.883180:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561072384 00000100:00100000:2.0:1786002667.883202:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561071744 00000100:00100000:2.0:1786002667.883205:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561071744 00000100:00100000:2.0:1786002667.883221:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561072256 00000100:00100000:2.0:1786002667.883224:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561072256 00000100:00100000:2.0:1786002667.883239:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1786002667.883245:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1872758561071872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883275:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1872758561071872:12345-0@lo:400:kworker.0 Request processed in 30us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.883281:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1786002667.883292:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:2.0:1786002667.883298:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561072384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883324:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561072384:12345-0@lo:400:kworker.0 Request processed in 26us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.883332:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:2.0:1786002667.883343:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1786002667.883349:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561071744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883373:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561071744:12345-0@lo:400:kworker.0 Request processed in 25us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.883379:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1786002667.883388:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1786002667.883394:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561072256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883418:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561072256:12345-0@lo:400:kworker.0 Request processed in 24us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.883423:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1786002667.883448:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561071232 00000100:00100000:2.0:1786002667.883452:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561071232 00000100:00100000:2.0:1786002667.883471:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561071616 00000100:00100000:2.0:1786002667.883473:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561071616 00000100:00100000:2.0:1786002667.883485:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561072128 00000100:00100000:2.0:1786002667.883488:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561072128 00000100:00100000:2.0:1786002667.883500:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561070976 00000100:00100000:2.0:1786002667.883502:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561070976 00000100:00100000:2.0:1786002667.883511:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561071488 00000100:00100000:2.0:1786002667.883513:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561071488 00000100:00100000:2.0:1786002667.883537:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561072000 00000100:00100000:2.0:1786002667.883539:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561072000 00000100:00100000:2.0:1786002667.883556:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1786002667.883561:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561071232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883589:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561071232:12345-0@lo:400:kworker.0 Request processed in 28us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.883595:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1786002667.883607:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1786002667.883613:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561071616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883640:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561071616:12345-0@lo:400:kworker.0 Request processed in 28us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.883646:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1786002667.883657:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1786002667.883663:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561072128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883688:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561072128:12345-0@lo:400:kworker.0 Request processed in 26us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.883694:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1786002667.883704:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1786002667.883709:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561070976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883730:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561070976:12345-0@lo:400:kworker.0 Request processed in 21us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.883735:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1786002667.883743:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:2.0:1786002667.883748:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561071488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883767:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561071488:12345-0@lo:400:kworker.0 Request processed in 19us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.883783:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:2.0:1786002667.883793:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1786002667.883799:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561072000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883822:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561072000:12345-0@lo:400:kworker.0 Request processed in 24us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.883826:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1786002667.883905:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561070976:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883914:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561071488:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883922:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561072000:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883929:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561071104:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883936:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561071616:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883943:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561072128:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.883963:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786002667.883968:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561072512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002667.883991:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002667.884024:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561071232:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.884034:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed366d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561071744:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.884042:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561072256:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.884049:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758561070848:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.884057:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561071360:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.884064:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561071872:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.884072:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561072384:0@lo:400:kworker.0 00000100:00100000:2.0:1786002667.884145:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561072512 00000100:00100000:2.0:1786002667.884149:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561072512 00000100:00100000:2.0:1786002667.884173:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1786002667.884179:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561072512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002667.884200:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002667.884234:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561072512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002667.884240:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1786002667.884266:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561072512:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1786002667.885414:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786002667.885419:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786002667.885422:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002667.885929:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002667.885940:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561072640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002667.885975:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002667.886002:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561072640 00000100:00100000:1.0:1786002667.886006:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561072640 00000100:00100000:1.0:1786002667.886049:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1786002667.886056:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561072640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786002667.886069:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1786002667.886096:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561072640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002667.886102:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1786002667.886130:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561072640:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1786002668.524004:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002669.418493:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561072768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786002669.418582:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002669.418866:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561072768 00000100:00100000:2.0:1786002669.418874:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561072768 00000100:00100000:2.0:1786002669.418937:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4133 00000100:00100000:2.0:1786002669.418945:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561072768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786002669.418975:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:2.0:1786002669.419028:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561072768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002669.419035:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4133 00000100:00100000:3.0:1786002669.420689:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561072768:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786002669.546010:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786002670.575586:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786002670.957941:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969974 is committed 00000001:02000400:0.0:1786002671.360706:0:22933:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63b: async write errors should be returned to fsync ============================================================= 03:51:09 (1786002669) 00000100:00100000:3.0:1786002671.468190:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561072896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786002671.468254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002671.468418:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561072896 00000100:00100000:0.0:1786002671.468425:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561072896 00000100:00100000:0.0:1786002671.468482:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:0.0:1786002671.468491:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561072896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786002671.468516:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1786002671.468570:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561072896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002671.468576:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00080000:3.0:1786002671.468670:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002671.468703:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561072896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786002671.470369:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786002671.470383:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561073024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786002671.470430:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002671.470660:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561073024 00000100:00100000:2.0:1786002671.470666:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561073024 00000100:00100000:2.0:1786002671.470713:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1786002671.470722:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561073024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786002671.470737:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002671.470785:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561073024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002671.470791:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1786002671.470819:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969974 gen 2 00000004:00080000:2.0:1786002671.470823:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed37136c380, transno 4294969974 00000100:00100000:2.0:1786002671.470835:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561073024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786002671.470954:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786002671.595022:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002671.961252:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002671.961417:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531038336 00000100:00100000:3.0:1786002671.961426:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531038336 00000100:00100000:3.0:1786002671.961489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 569 00000100:00100000:3.0:1786002671.961499:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531038336:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002671.961567:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531038336:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 70us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002671.961575:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 569 00000100:00100000:3.0:1786002671.965586:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002671.966510:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531038464 00000100:00100000:2.0:1786002671.966521:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531038464 00000100:00080000:3.0:1786002671.966624:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002671.966800:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1087 00000100:00100000:2.0:1786002671.966811:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2410:x1872758531038464:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002671.966895:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2410:x1872758531038464:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 85us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002671.966902:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1087 00000100:00100000:1.0:1786002671.974971:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002671.975008:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002671.975039:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002671.975064:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531038720 00000100:00100000:1.0:1786002671.975072:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531038720 00000100:00100000:1.0:1786002671.975119:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531038848 00000100:00100000:1.0:1786002671.975122:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531038848 00000100:00100000:1.0:1786002671.975142:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 604 00000100:00100000:1.0:1786002671.975151:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:2411:x1872758531038720:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002671.975228:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:2411:x1872758531038720:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 66us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002671.975236:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 604 00000100:00100000:1.0:1786002671.975251:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 605 00000100:00100000:1.0:1786002671.975265:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531038848:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002671.975367:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531038592 00000100:00100000:3.0:1786002671.975371:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531038592 00000100:00100000:3.0:1786002671.975406:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1088 00000100:00100000:3.0:1786002671.975962:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531038592:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002671.975997:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531038592:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 585us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002671.976003:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1088 00000100:00100000:1.0:1786002671.976703:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531038848:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 1443us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002671.976716:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 605 00000100:00080000:1.0:1786002671.976750:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786002671.976755:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002671.976757:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002671.989074:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561073152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786002671.989139:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002671.997275:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561073152 00000100:00100000:0.0:1786002671.997296:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561073152 00000100:00100000:1.0:1786002671.997569:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4134 00000100:00100000:1.0:1786002671.997580:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561073152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786002671.997615:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:1.0:1786002671.997700:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561073152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (8560us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002671.997720:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4134 00000100:00100000:0.0:1786002671.998633:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561073152:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1786002672.618279:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002672.942659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002672.942752:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531039104 00000100:00100000:3.0:1786002672.942762:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531039104 00000100:00100000:3.0:1786002672.942821:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24206 00000100:00100000:3.0:1786002672.942831:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:21645:x1872758531039104:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1786002672.942868:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002672.942871:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786002672.942896:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556a200/0x7cee4af57841735c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0ef expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.942915:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002672.942919:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002672.942933:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af57841736a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0f6 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943033:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417371 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943045:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417371 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943053:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417371 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943069:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417378 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943086:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417378 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943092:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417378 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002672.943382:0:14496:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa00:0x0], index 1: 0 00010000:00010000:3.0:1786002672.943685:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841737f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15b6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943694:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841737f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943700:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841737f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943727:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417371 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943734:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417371 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943751:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417371 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943757:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417371 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943762:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002672.943766:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417371 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943772:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417371 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943780:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002672.943783:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002672.943786:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417371 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943792:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af578417371 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002672.943802:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a74631d7 reply state 00000000b399a1f5 transno 4294984165 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417378 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943811:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417378 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943817:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff9ed245735a00) 00010000:00010000:3.0:1786002672.943819:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002672.943821:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002672.943842:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af57841736a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0f6 expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943882:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841737f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0f6 expref: 15 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.943890:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15b6:0x0].0x0 (ffff9ed245735000) 00010000:00010000:3.0:1786002672.943892:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002672.943895:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82200, rc 0) 00000100:00100000:3.0:1786002672.943945:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:21645:x1872758531039104:12345-192.168.203.49@tcp:101:dd.0 Request processed in 1116us (1294us total) trans 4294984165 rc 0/0 00000100:00100000:3.0:1786002672.943952:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24206 00000100:00100000:1.0:1786002672.964132:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002672.964246:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531039232 00000100:00100000:3.0:1786002672.964262:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531039232 00000100:00100000:3.0:1786002672.964316:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5349 00000100:00100000:3.0:1786002672.964326:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:21645:x1872758531039232:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1786002672.964343:0:14687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002672.964362:0:14687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d046223/0x7cee4af57841738d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b0fd expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002672.964384:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002672.964405:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=1033s v=(0 0) 00010000:00010000:3.0:1786002672.964409:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002672.964418:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d046223/0x7cee4af57841738d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0fd expref: 7 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.964435:0:14687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d046223/0x7cee4af57841738d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0fd expref: 7 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002672.964448:0:14687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83a00, rc 0) 00000100:00100000:3.0:1786002672.964495:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:21645:x1872758531039232:12345-192.168.203.49@tcp:101:dd.0 Request processed in 171us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002672.964503:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5349 00000100:00100000:1.0:1786002672.968241:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002672.968357:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531039488 00000100:00100000:3.0:1786002672.968366:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531039488 00000100:00100000:3.0:1786002672.968415:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5230 00000100:00100000:3.0:1786002672.968424:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e7fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:21645:x1872758531039488:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:3.0:1786002672.968630:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294984166 00000100:00100000:3.0:1786002672.968720:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e7fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:21645:x1872758531039488:12345-192.168.203.49@tcp:35:dd.0 Request processed in 296us (485us total) trans 4294984167 rc 0/0 00000100:00100000:3.0:1786002672.968727:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5230 00000020:00080000:3.0:1786002672.968731:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002673.002244:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561073280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786002673.002320:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.006688:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561073280 00000100:00100000:0.0:1786002673.006699:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561073280 00000100:00100000:0.0:1786002673.006765:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1786002673.006775:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561073280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786002673.006803:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1786002673.006894:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561073280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (4573us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002673.006901:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00080000:0.0:1786002673.006930:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786002673.007151:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561073536:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.007216:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561074048:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007235:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.007248:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561074560:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007280:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.007300:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1786002673.007306:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561073664:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007328:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.007343:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758561074176:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007362:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.007376:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758561074688:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007392:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.007414:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758561073408:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007439:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.007461:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561073920:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.007498:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561074432:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.007537:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1786002673.007542:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561073792:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.007572:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561074304:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007591:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.007606:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed349f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561074816:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007625:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002673.007648:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561073664 00000100:00100000:0.0:1786002673.007652:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561073664 00000100:00100000:0.0:1786002673.007675:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561073920 00000100:00100000:0.0:1786002673.007678:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561073920 00000100:00100000:0.0:1786002673.007695:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4135 00000100:00100000:0.0:1786002673.007701:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561073664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007750:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561073664:12345-0@lo:400:kworker.0 Request processed in 49us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002673.007757:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4135 00000100:00100000:0.0:1786002673.007770:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4136 00000100:00100000:0.0:1786002673.007776:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561073920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007808:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561073920:12345-0@lo:400:kworker.0 Request processed in 32us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002673.007814:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4136 00000100:00100000:0.0:1786002673.007876:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561073280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002673.007904:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561073920:0@lo:400:kworker.0 00000100:00100000:0.0:1786002673.007922:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561073664:0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.010901:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561073536 00000100:00100000:1.0:1786002673.010912:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561073536 00000100:00100000:1.0:1786002673.010946:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561074048 00000100:00100000:1.0:1786002673.010949:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561074048 00000100:00100000:1.0:1786002673.010973:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561074560 00000100:00100000:1.0:1786002673.010976:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561074560 00000100:00100000:1.0:1786002673.010987:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561074176 00000100:00100000:1.0:1786002673.010989:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561074176 00000100:00100000:1.0:1786002673.011000:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561074688 00000100:00100000:1.0:1786002673.011002:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561074688 00000100:00100000:1.0:1786002673.011012:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561073792 00000100:00100000:1.0:1786002673.011014:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561073792 00000100:00100000:1.0:1786002673.011027:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1786002673.011035:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561073536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.011103:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1872758561073536:12345-0@lo:400:kworker.0 Request processed in 68us (3915us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002673.011110:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1786002673.011125:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1786002673.011132:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561074048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.011160:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1872758561074048:12345-0@lo:400:kworker.0 Request processed in 29us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002673.011165:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1786002673.011176:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:1.0:1786002673.011182:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561074560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.011205:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1872758561074560:12345-0@lo:400:kworker.0 Request processed in 25us (3926us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002673.011210:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:1.0:1786002673.011220:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1786002673.011226:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758561074176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.011252:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758561074176:12345-0@lo:400:kworker.0 Request processed in 26us (3889us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002673.011257:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1786002673.011268:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1786002673.011274:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758561074688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.011301:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758561074688:12345-0@lo:400:kworker.0 Request processed in 27us (3907us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002673.011306:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1786002673.011316:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1786002673.011322:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561073792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.011353:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561073792:12345-0@lo:400:kworker.0 Request processed in 31us (3790us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002673.011359:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00080000:1.0:1786002673.011375:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786002673.011379:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786002673.011409:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758561074176:0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.011421:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758561074688:0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.011430:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1872758561073536:0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.011438:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1872758561074048:0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.011447:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1872758561074560:0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.011490:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561073792:0@lo:400:kworker.0 00000100:00100000:2.0:1786002673.011635:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561073408 00000100:00100000:2.0:1786002673.011639:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561073408 00000100:00100000:2.0:1786002673.011665:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1786002673.011672:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758561073408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002673.011704:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758561073408:12345-0@lo:400:kworker.0 Request processed in 33us (4265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002673.011710:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1786002673.011750:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561074432 00000100:00100000:2.0:1786002673.011754:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561074432 00000100:00100000:2.0:1786002673.011778:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561074304 00000100:00100000:2.0:1786002673.011781:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561074304 00000100:00100000:2.0:1786002673.011794:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561074816 00000100:00100000:2.0:1786002673.011796:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561074816 00000100:00100000:2.0:1786002673.011817:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1786002673.011823:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561074432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002673.011874:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561074432:12345-0@lo:400:kworker.0 Request processed in 51us (4351us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002673.011880:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1786002673.011891:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1786002673.011897:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561074304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002673.011922:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561074304:12345-0@lo:400:kworker.0 Request processed in 26us (4330us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002673.011927:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1786002673.011936:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1786002673.011943:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561074816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002673.011966:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561074816:12345-0@lo:400:kworker.0 Request processed in 24us (4340us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002673.011971:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1786002673.011991:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786002673.012001:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561074944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002673.012029:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002673.012063:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561074944 00000100:00100000:2.0:1786002673.012067:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561074944 00000100:00100000:2.0:1786002673.012090:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1786002673.012096:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561074944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002673.012110:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002673.012142:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561074944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002673.012148:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00080000:2.0:1786002673.012165:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786002673.012167:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002673.012186:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561074944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002673.012364:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561074304:0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.012373:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed349f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561074816:0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.012381:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758561073408:0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.012390:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561074432:0@lo:400:kworker.0 00000100:00100000:1.0:1786002673.012963:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002673.013016:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531039616 00000100:00100000:2.0:1786002673.013020:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531039616 00000100:00100000:2.0:1786002673.013057:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24207 00000100:00100000:2.0:1786002673.013063:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:21646:x1872758531039616:12345-192.168.203.49@tcp:101:rm.0 00010000:00010000:2.0:1786002673.013076:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002673.013093:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578417394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b104 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.013149:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841739b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.013162:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841739b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.013174:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841739b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002673.013214:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:2.0:1786002673.013217:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786002673.013234:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841739b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.013258:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af578417394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b104 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.013272:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841739b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b104 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.013281:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002673.013283:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786002673.013287:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3a00, rc 0) 00000100:00100000:2.0:1786002673.013322:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:21646:x1872758531039616:12345-192.168.203.49@tcp:101:rm.0 Request processed in 258us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002673.013329:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24207 00000100:00080000:1.0:1786002673.013519:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002673.025384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002673.025485:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531039872 00000100:00100000:2.0:1786002673.025494:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531039872 00000100:00100000:2.0:1786002673.025553:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24208 00000100:00100000:2.0:1786002673.025564:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:21646:x1872758531039872:12345-192.168.203.49@tcp:36:rm.0 00010000:00010000:2.0:1786002673.025616:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786002673.025641:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82200/0x7cee4af57841737f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15b6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0f6 expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.025657:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15b6:0x0].0x0 (ffff9ed245735000) 00010000:00010000:2.0:1786002673.025673:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af57841739b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b104 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.025681:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002673.025684:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002673.025702:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.025714:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.025724:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.025733:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784173a9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.025752:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784173a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.025759:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784173a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.025833:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173b0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15b6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.025842:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.025890:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786002673.026339:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2552, 64 off171520 00000004:00080000:2.0:1786002673.026350:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1033207502157ns, next at 1034207499505ns, rc = 0 00010000:00010000:2.0:1786002673.026397:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784173b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15b6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026406:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784173b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026413:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784173b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026420:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784173b7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026426:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784173b7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026432:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784173b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15b6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026556:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786002673.026575:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026582:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173b0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026589:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173b0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026595:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002673.026599:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173b0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026606:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173b0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026616:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15b6:0x0].0x0 (ffff9ed243d0bb00) 00010000:00010000:2.0:1786002673.026619:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786002673.026622:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173b0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026628:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173b0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15b6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026643:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173a2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026648:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173a2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026657:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026661:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173a2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026666:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002673.026669:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173a2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026674:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173a2 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026680:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002673.026682:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002673.026685:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173a2 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026691:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173a2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002673.026698:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004acbe4aa reply state 0000000054c3e28a transno 4294984168 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784173a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026708:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784173a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.026713:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff9ed245735a00) 00010000:00010000:2.0:1786002673.026715:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002673.026717:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002673.026832:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:21646:x1872758531039872:12345-192.168.203.49@tcp:36:rm.0 Request processed in 1269us (1456us total) trans 4294984168 rc 0/0 00000100:00100000:2.0:1786002673.026840:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24208 00010000:00010000:3.0:1786002673.030439:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002673.030450:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784173b7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15b6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002673.030461:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3000 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:3.0:1786002673.030465:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784173b7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15b6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002673.030484:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784173b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15b6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002673.030501:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15b6:0x0].0x0 (ffff9ed243d0bb00) 00010000:00010000:3.0:1786002673.030504:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786002673.030508:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784173b7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15b6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002673.030514:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3000/0x7cee4af5784173b7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15b6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002673.030529:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002673.030530:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002673.030532:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002673.112458:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002673.112651:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531040000 00000100:00100000:3.0:1786002673.112661:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531040000 00000100:00100000:3.0:1786002673.112714:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24209 00000100:00100000:3.0:1786002673.112725:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:21649:x1872758531040000:12345-192.168.203.49@tcp:101:multiop.0 00010000:00010000:3.0:1786002673.112755:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002673.112772:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784173be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b10b expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002673.112897:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784173c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002673.112911:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784173c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002673.112922:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784173c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002673.112960:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:3.0:1786002673.112964:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1786002673.112985:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784173c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002673.113006:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82a00/0x7cee4af5784173be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b10b expref: 21 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002673.113021:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784173c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b10b expref: 20 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002673.113029:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002673.113032:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786002673.113036:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83800, rc 0) 00000100:00100000:3.0:1786002673.113093:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:21649:x1872758531040000:12345-192.168.203.49@tcp:101:multiop.0 Request processed in 370us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002673.113100:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24209 00000100:00100000:1.0:1786002673.120965:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002673.123008:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531040256 00000100:00100000:2.0:1786002673.123019:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531040256 00000100:00100000:2.0:1786002673.123076:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24210 00000100:00100000:2.0:1786002673.123086:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:21649:x1872758531040256:12345-192.168.203.49@tcp:101:multiop.0 00010000:00010000:2.0:1786002673.123107:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002673.123110:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786002673.123134:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83800/0x7cee4af5784173c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b10b expref: 20 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123152:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002673.123156:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002673.123169:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b112 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123271:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123283:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123292:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123303:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784173da lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123311:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784173da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123318:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784173da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002673.123603:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa01:0x0], index 0: 0 00010000:00010000:2.0:1786002673.123742:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784173e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123753:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784173e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15b7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123761:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784173e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15b7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123789:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173d3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123796:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173d3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123803:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123810:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173d3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123816:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002673.123821:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173d3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123829:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173d3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123842:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002673.123863:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002673.123867:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173d3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123874:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af5784173d3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002673.123884:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ce9aba6 reply state 00000000220d68a6 transno 4294984169 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784173da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123894:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784173da lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123901:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff9ed245735a00) 00010000:00010000:2.0:1786002673.123903:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002673.123906:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002673.123928:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af5784173cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b112 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123940:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784173e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15b7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b112 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.123948:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15b7:0x0].0x0 (ffff9ed243d0b400) 00010000:00010000:2.0:1786002673.123950:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002673.123953:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed2a00, rc 0) 00000100:00100000:2.0:1786002673.124006:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:21649:x1872758531040256:12345-192.168.203.49@tcp:101:multiop.0 Request processed in 922us (3051us total) trans 4294984169 rc 0/0 00000100:00100000:2.0:1786002673.124013:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24210 00000100:00100000:3.0:1786002673.131334:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002673.136352:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531040384 00000100:00100000:2.0:1786002673.136365:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531040384 00000100:00100000:2.0:1786002673.136429:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5350 00000100:00100000:2.0:1786002673.136438:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+5:21649:x1872758531040384:12345-192.168.203.49@tcp:101:multiop.0 00010000:00010000:2.0:1786002673.136453:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002673.136471:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af5784173ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b119 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002673.136495:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002673.136515:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa01:0x0].0x0 since=1033s v=(0 0) 00010000:00010000:2.0:1786002673.136520:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002673.136530:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af5784173ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b119 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.136547:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000196487c1/0x7cee4af5784173ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b119 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.136559:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed2600, rc 0) 00000100:00100000:2.0:1786002673.136617:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:21649:x1872758531040384:12345-192.168.203.49@tcp:101:multiop.0 Request processed in 180us (5293us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002673.136624:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5350 00000100:00080000:3.0:1786002673.139631:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002673.178139:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002673.178217:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531040512 00000100:00100000:3.0:1786002673.178226:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531040512 00000100:00100000:3.0:1786002673.178290:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24211 00000100:00100000:3.0:1786002673.178300:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:21649:x1872758531040512:12345-192.168.203.49@tcp:44:multiop.0 00000001:00080000:2.0:1786002673.180101:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984169 is committed 00000004:00080000:2.0:1786002673.180111:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 91 committed 00010000:00010000:0.0:1786002673.180346:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417378 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180358:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417378 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180366:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417378 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180371:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002673.180376:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417378 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180382:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417378 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180397:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff9ed245735a00) 00010000:00010000:0.0:1786002673.180400:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002673.180403:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417378 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180409:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83e00/0x7cee4af578417378 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180425:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784173a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180430:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784173a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180436:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784173a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180440:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002673.180443:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784173a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180448:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784173a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180456:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff9ed245735a00) 00010000:00010000:0.0:1786002673.180458:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002673.180460:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784173a9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180465:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af5784173a9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180475:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784173da lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180482:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784173da lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180488:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784173da lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180492:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002673.180495:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784173da lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180501:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784173da lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180514:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff9ed245735a00) 00010000:00010000:0.0:1786002673.180517:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002673.180519:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784173da lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.180525:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3a00/0x7cee4af5784173da lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002673.180684:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:21649:x1872758531040512:12345-192.168.203.49@tcp:44:multiop.0 Request processed in 2383us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002673.180694:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24211 00000100:00100000:1.0:1786002673.180969:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561075072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786002673.181009:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002673.181097:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561075072 00000100:00100000:2.0:1786002673.181103:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561075072 00000100:00100000:2.0:1786002673.181145:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5351 00000100:00100000:2.0:1786002673.181154:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561075072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1786002673.181175:0:14686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2560 count 1 00010000:00010000:2.0:1786002673.181195:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.181213:0:14686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d046223/0x7cee4af57841738d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0fd expref: 6 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.181220:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002673.181224:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786002673.181228:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.181267:0:14686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d046223/0x7cee4af57841738d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0fd expref: 6 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.181281:0:14686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d046223/0x7cee4af57841738d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0fd expref: 6 pid: 14687 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002673.181292:0:14686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14686:1872758561075200:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002673.181341:0:14686:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed37b959c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786002673.184384:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002673.184479:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531040640 00000100:00100000:3.0:1786002673.184486:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531040640 00000100:00100000:3.0:1786002673.184537:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5352 00000100:00100000:3.0:1786002673.184547:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531040640:12345-192.168.203.49@tcp:16:multiop.0 00000100:00100000:3.0:1786002673.184644:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2413:x1872758531040640:12345-192.168.203.49@tcp:16:multiop.0 Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002673.184652:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5352 00000100:00100000:3.0:1786002673.188394:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002673.188513:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531040768 00000100:00100000:0.0:1786002673.188521:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531040768 00010000:00010000:0.0:1786002673.188571:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d046223/0x7cee4af57841738d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0fd expref: 7 pid: 14687 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002673.188606:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1700 00000100:00100000:0.0:1786002673.188615:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531040768:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002673.188629:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002673.188634:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d046223/0x7cee4af57841738d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0fd expref: 7 pid: 14687 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.188647:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d046223/0x7cee4af57841738d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0fd expref: 7 pid: 14687 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.188671:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786002673.188675:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa00:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786002673.188680:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.188693:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.188713:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002673.188770:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531040768:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 156us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002673.188778:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1700 00010000:00010000:2.0:1786002673.188919:0:14686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d046223/0x7cee4af57841738d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b0fd expref: 6 pid: 14687 timeout: 1133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002673.188934:0:14686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:14686:1872758561075200:192.168.203.49@tcp:104: 00010000:00010000:2.0:1786002673.188955:0:14686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.188965:0:14686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.188972:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.188982:0:14686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.188991:0:14686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002673.189051:0:14686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1786002673.189498:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002673.195812:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002673.195874:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531041024 00000100:00100000:3.0:1786002673.195884:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531041024 00000100:00100000:3.0:1786002673.195934:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5231 00000100:00100000:3.0:1786002673.195944:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:21649:x1872758531041024:12345-192.168.203.49@tcp:35:multiop.0 00000100:00100000:3.0:1786002673.196220:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:21649:x1872758531041024:12345-192.168.203.49@tcp:35:multiop.0 Request processed in 277us (427us total) trans 4294984170 rc 0/0 00000100:00100000:3.0:1786002673.196228:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5231 00010000:00010000:0.0:1786002673.199962:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786002673.199976:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.199990:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2800 already unused, calling callback (ffffffffc0c84fd0) 00010000:00010000:0.0:1786002673.199995:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.200007:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.200029:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.200037:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bdc3951/0x7cee4af5784173f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002673.200061:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002673.200064:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002673.200066:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002673.201595:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3644:x1872758561075072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20436us (20578us total) trans 4294969951 rc 0/0 00000100:00100000:2.0:1786002673.201607:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5351 00000004:00080000:1.0:1786002673.210690:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ed2454e3b80/2, rc 0, transno 4294969951 00000100:00100000:1.0:1786002673.210703:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561075072:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1786002673.642248:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002674.538667:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002674.538690:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561075328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002674.538774:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002674.538873:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561075328 00000100:00100000:0.0:1786002674.538891:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561075328 00000100:00100000:0.0:1786002674.538957:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4137 00000100:00100000:0.0:1786002674.538967:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561075328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1786002674.538998:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:0.0:1786002674.539053:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561075328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002674.539059:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4137 00000100:00100000:2.0:1786002674.539199:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561075328:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786002674.667694:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786002675.690955:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002676.586449:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561075456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786002676.586519:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002676.586655:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561075456 00000100:00100000:2.0:1786002676.586663:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561075456 00000100:00100000:2.0:1786002676.586728:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1786002676.586739:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561075456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786002676.586765:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002676.586809:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561075456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002676.586816:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1786002676.586878:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561075456:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786002676.586977:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002676.595401:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed349f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561075584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002676.595458:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002676.596674:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561075584 00000100:00100000:2.0:1786002676.596681:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561075584 00000100:00100000:2.0:1786002676.596749:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:2.0:1786002676.596759:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561075584:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1786002676.597178:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1786002676.597604:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002676.597657:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561075584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 900us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002676.597665:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1786002676.598443:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed349f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561075584:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1786002676.726050:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002677.077244:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002677.077284:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002677.077323:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002677.077347:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002677.077369:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002677.077395:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531041152 00000100:00100000:2.0:1786002677.077404:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531041152 00000100:00100000:2.0:1786002677.077451:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 571 00000100:00100000:2.0:1786002677.077461:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758531041152:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002677.077524:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758531041152:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 65us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002677.077531:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 571 00000100:00100000:2.0:1786002677.077562:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531041280 00000100:00100000:2.0:1786002677.077567:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531041280 00000100:00100000:3.0:1786002677.077581:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531041536 00000100:00100000:3.0:1786002677.077588:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531041536 00000100:00100000:2.0:1786002677.077613:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531041408 00000100:00100000:2.0:1786002677.077618:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531041408 00000100:00100000:3.0:1786002677.077632:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531041664 00000100:00100000:3.0:1786002677.077637:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531041664 00000100:00100000:2.0:1786002677.077651:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1095 00000100:00100000:2.0:1786002677.077660:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2410:x1872758531041280:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002677.077672:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 609 00000100:00100000:3.0:1786002677.077684:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531041536:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002677.077697:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2410:x1872758531041280:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 37us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002677.077705:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1095 00000100:00100000:2.0:1786002677.077734:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1096 00000100:00100000:2.0:1786002677.077743:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531041408:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002677.077746:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531041536:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 52us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002677.077765:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 609 00000100:00100000:2.0:1786002677.077770:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531041408:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002677.077777:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1096 00000100:00100000:3.0:1786002677.077791:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 610 00000100:00100000:3.0:1786002677.077802:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531041664:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002677.077834:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2411:x1872758531041664:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 35us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002677.077842:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 610 00000100:00080000:2.0:1786002677.077950:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786002677.077955:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786002677.077956:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786002677.077958:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786002677.107958:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561075712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002677.108031:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002677.108130:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561075712 00000100:00100000:2.0:1786002677.108138:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561075712 00000100:00100000:2.0:1786002677.108195:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4138 00000100:00100000:2.0:1786002677.108206:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561075712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786002677.109335:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:2.0:1786002677.109403:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561075712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1198us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002677.109412:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4138 00000100:00100000:0.0:1786002677.110212:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561075712:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1786002677.739163:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002678.122754:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786002678.122776:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561075840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002678.122842:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002678.122979:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561075840 00000100:00100000:1.0:1786002678.122987:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561075840 00000100:00100000:1.0:1786002678.123039:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1786002678.123051:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561075840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786002678.123076:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1786002678.123117:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561075840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002678.123124:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1786002678.123161:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561075840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002678.123480:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed349f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561076096:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.123525:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002678.123542:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561076608:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.123559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002678.123580:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561077120:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.123595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002678.123608:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1786002678.123613:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed349f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758561075968:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.123633:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002678.123648:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561076480:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.123665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002678.123827:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561076992:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.123884:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002678.123907:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561076352:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.123929:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002678.123945:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561076864:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.123963:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002678.123975:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561077376:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.123992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002678.124005:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1786002678.124010:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed349f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561076224:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.124028:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002678.124041:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561076736:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.124058:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002678.124070:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561077248:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.124087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002678.124105:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561076480 00000100:00100000:0.0:1786002678.124109:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561076480 00000100:00100000:0.0:1786002678.124131:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561076224 00000100:00100000:0.0:1786002678.124134:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561076224 00000100:00100000:0.0:1786002678.124150:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4139 00000100:00100000:0.0:1786002678.124157:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561076480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.124201:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561076480:12345-0@lo:400:kworker.0 Request processed in 43us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002678.124207:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4139 00000100:00080000:2.0:1786002678.125362:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002678.125386:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561076096 00000100:00100000:2.0:1786002678.125393:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561076096 00000100:00100000:2.0:1786002678.125422:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561076608 00000100:00100000:2.0:1786002678.125425:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561076608 00000100:00100000:2.0:1786002678.125443:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561077120 00000100:00100000:2.0:1786002678.125446:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561077120 00000100:00100000:2.0:1786002678.125456:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561076352 00000100:00100000:2.0:1786002678.125458:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561076352 00000100:00100000:2.0:1786002678.125467:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561076736 00000100:00100000:2.0:1786002678.125469:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561076736 00000100:00100000:2.0:1786002678.125479:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561077248 00000100:00100000:2.0:1786002678.125481:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561077248 00000100:00100000:2.0:1786002678.125507:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:2.0:1786002678.125522:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561076096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.125569:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561076096:12345-0@lo:400:kworker.0 Request processed in 54us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002678.125575:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:2.0:1786002678.125588:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1786002678.125594:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561076608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.125617:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561076608:12345-0@lo:400:kworker.0 Request processed in 24us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002678.125623:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1786002678.125632:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1786002678.125638:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561077120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.125664:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561077120:12345-0@lo:400:kworker.0 Request processed in 26us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002678.125669:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1786002678.125679:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1786002678.125695:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561076352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.125747:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561076352:12345-0@lo:400:kworker.0 Request processed in 53us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002678.125753:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1786002678.125764:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1786002678.125770:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561076736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.125799:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561076736:12345-0@lo:400:kworker.0 Request processed in 29us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002678.125804:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1786002678.125815:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1786002678.125821:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561077248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.125867:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561077248:12345-0@lo:400:kworker.0 Request processed in 26us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002678.125873:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1786002678.125897:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561075968 00000100:00100000:2.0:1786002678.125900:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561075968 00000100:00100000:2.0:1786002678.125924:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1786002678.125930:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758561075968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.125958:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758561075968:12345-0@lo:400:kworker.0 Request processed in 28us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002678.125963:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1786002678.125993:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561076992 00000100:00100000:2.0:1786002678.125997:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561076992 00000100:00100000:2.0:1786002678.126019:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561076864 00000100:00100000:2.0:1786002678.126021:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561076864 00000100:00100000:2.0:1786002678.126035:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561077376 00000100:00100000:2.0:1786002678.126037:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561077376 00000100:00100000:2.0:1786002678.126053:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1786002678.126059:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561076992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.126087:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561076992:12345-0@lo:400:kworker.0 Request processed in 28us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002678.126092:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1786002678.126102:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1786002678.126107:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561076864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.126128:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561076864:12345-0@lo:400:kworker.0 Request processed in 21us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002678.126134:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1786002678.126142:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1786002678.126147:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1872758561077376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.126168:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1872758561077376:12345-0@lo:400:kworker.0 Request processed in 21us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002678.126173:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1786002678.126193:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4140 00000100:00100000:2.0:1786002678.126199:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561076224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.126242:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561076224:12345-0@lo:400:kworker.0 Request processed in 43us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002678.126248:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4140 00000100:00080000:2.0:1786002678.126278:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786002678.126280:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786002678.126283:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786002678.126285:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002678.126312:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed349f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561076224:0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.126322:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561076736:0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.126333:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561077248:0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.126342:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561076352:0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.126350:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561076864:0@lo:400:kworker.0 00000100:00100000:2.0:1786002678.126360:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561077376:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.126611:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed349f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758561075968:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.126622:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561076480:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.126631:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561076992:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.126639:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed349f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561076096:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.126648:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561076608:0@lo:400:kworker.0 00000100:00100000:0.0:1786002678.126657:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561077120:0@lo:400:kworker.0 00000100:00100000:3.0:1786002678.128264:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561077504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002678.128312:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002678.138944:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561077504 00000100:00100000:1.0:1786002678.138958:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561077504 00000100:00100000:1.0:1786002678.139027:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1786002678.139037:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872758561077504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786002678.139063:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1786002678.139139:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1872758561077504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (10826us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002678.139146:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:3.0:1786002678.139339:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37bc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561077504:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1786002678.643553:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984170 is committed 00000001:00080000:3.0:1786002678.653549:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969951 is committed 00010000:00010000:1.0:1786002678.769983:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002679.658107:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002679.658128:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561077632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786002679.658193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002679.658841:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561077632 00000100:00100000:2.0:1786002679.658869:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561077632 00000100:00100000:2.0:1786002679.658913:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4141 00000100:00100000:2.0:1786002679.658921:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561077632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786002679.658950:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:2.0:1786002679.659001:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561077632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002679.659009:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4141 00000100:00100000:3.0:1786002679.662591:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561077632:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1786002679.786112:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002679.882383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002679.882508:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531041792 00000100:00100000:2.0:1786002679.882517:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531041792 00000100:00100000:2.0:1786002679.882596:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24212 00000100:00100000:2.0:1786002679.882606:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:21889:x1872758531041792:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002679.882632:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002679.882651:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784173fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b120 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002679.882720:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417404 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002679.882743:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002679.882760:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002679.882799:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:2.0:1786002679.882802:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786002679.882819:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002679.882841:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3c00/0x7cee4af5784173fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b120 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002679.882883:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b120 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002679.882891:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002679.882894:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786002679.882898:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3200, rc 0) 00000100:00100000:2.0:1786002679.882955:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:21889:x1872758531041792:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 350us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002679.882962:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24212 00000100:00080000:0.0:1786002679.883067:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002679.903269:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002679.904115:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531041920 00000100:00100000:0.0:1786002679.904124:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531041920 00000100:00100000:0.0:1786002679.904182:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24213 00000100:00100000:0.0:1786002679.904190:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:21889:x1872758531041920:12345-192.168.203.49@tcp:41:lfs.0 00000004:00000024:0.0:1786002679.904232:0:14496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:0.0:1786002679.904295:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:21889:x1872758531041920:12345-192.168.203.49@tcp:41:lfs.0 Request processed in 106us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002679.904303:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24213 00000100:00100000:1.0:1786002679.922900:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002679.923569:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531042048 00000100:00100000:2.0:1786002679.923578:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531042048 00000100:00080000:0.0:1786002679.923713:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786002679.924313:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24214 00000100:00100000:2.0:1786002679.924324:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:21889:x1872758531042048:12345-192.168.203.49@tcp:41:lfs.0 00000004:00000024:2.0:1786002679.924357:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:2.0:1786002679.924465:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:21889:x1872758531042048:12345-192.168.203.49@tcp:41:lfs.0 Request processed in 143us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002679.924473:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24214 00000100:00100000:3.0:1786002679.946007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002679.946107:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531042176 00000100:00100000:1.0:1786002679.946116:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531042176 00000100:00100000:1.0:1786002679.946181:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 596 00000100:00100000:1.0:1786002679.946191:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:21889:x1872758531042176:12345-192.168.203.49@tcp:13:lfs.0 00002000:00000024:1.0:1786002679.946229:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1786002679.946291:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:21889:x1872758531042176:12345-192.168.203.49@tcp:13:lfs.0 Request processed in 102us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002679.946298:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 596 00000100:00080000:0.0:1786002679.946358:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002679.959238:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002679.959329:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531042304 00000100:00100000:0.0:1786002679.959338:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531042304 00000100:00100000:0.0:1786002679.959410:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 597 00000100:00100000:0.0:1786002679.959423:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:21889:x1872758531042304:12345-192.168.203.49@tcp:13:lfs.0 00002000:00000024:0.0:1786002679.959454:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1786002679.959552:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f537800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:21889:x1872758531042304:12345-192.168.203.49@tcp:13:lfs.0 Request processed in 131us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002679.959560:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 597 00000100:00080000:2.0:1786002679.959804:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786002680.810402:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786002681.708219:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786002681.708241:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561077760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1786002681.708308:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002681.708404:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561077760 00000100:00100000:3.0:1786002681.708411:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561077760 00000100:00100000:3.0:1786002681.708485:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:3.0:1786002681.708496:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561077760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1786002681.708517:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1786002681.708562:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561077760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002681.708570:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:3.0:1786002681.708617:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561077760:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1786002681.708704:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002681.714896:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002681.714918:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed243ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561077888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002681.714983:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002681.715063:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561077888 00000100:00100000:3.0:1786002681.715070:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561077888 00000100:00100000:3.0:1786002681.715127:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:3.0:1786002681.715137:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561077888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786002681.715158:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1786002681.715203:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561077888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002681.715210:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:3.0:1786002681.715253:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed243ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561077888:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786002681.715303:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786002681.834008:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002682.197278:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002682.197321:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002682.197353:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002682.197380:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002682.197405:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002682.197426:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531042688 00000100:00100000:3.0:1786002682.197435:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531042688 00000100:00100000:3.0:1786002682.197497:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531042560 00000100:00100000:3.0:1786002682.197500:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531042560 00000100:00100000:3.0:1786002682.197522:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1103 00000100:00100000:3.0:1786002682.197531:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531042688:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002682.197606:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531042688:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 75us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002682.197614:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1103 00000100:00100000:3.0:1786002682.197631:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1104 00000100:00100000:3.0:1786002682.197637:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2410:x1872758531042560:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002682.197663:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2410:x1872758531042560:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002682.197669:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1104 00000100:00100000:1.0:1786002682.197762:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531042944 00000100:00100000:1.0:1786002682.197766:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531042944 00000100:00100000:1.0:1786002682.197802:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531042816 00000100:00100000:1.0:1786002682.197805:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531042816 00000100:00100000:1.0:1786002682.197825:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 614 00000100:00100000:1.0:1786002682.197833:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531042944:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002682.197888:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531042944:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 56us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002682.197894:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 614 00000100:00100000:1.0:1786002682.197906:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 615 00000100:00100000:1.0:1786002682.197910:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531042816:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002682.197929:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2410:x1872758531042816:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 18us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002682.197934:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 615 00000100:00080000:1.0:1786002682.197946:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786002682.197949:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002682.197952:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786002682.197953:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786002682.200021:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531042432 00000100:00100000:2.0:1786002682.200030:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531042432 00000100:00100000:2.0:1786002682.200080:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 573 00000100:00100000:2.0:1786002682.200098:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531042432:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002682.200142:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531042432:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 54us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002682.200149:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 573 00000100:00100000:3.0:1786002682.218140:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561078016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786002682.218218:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002682.218510:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561078016 00000100:00100000:0.0:1786002682.218517:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561078016 00000100:00100000:0.0:1786002682.218567:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4142 00000100:00100000:0.0:1786002682.218577:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561078016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002682.218609:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:0.0:1786002682.229525:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561078016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10939us (11295us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002682.229540:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4142 00000100:00100000:3.0:1786002682.234570:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561078016:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1786002682.864272:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002683.242590:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786002683.242613:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561078144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002683.242688:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002683.242986:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561078144 00000100:00100000:3.0:1786002683.242994:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561078144 00000100:00100000:1.0:1786002683.243098:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786002683.243108:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561078272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002683.243135:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002683.243873:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561078400:0@lo:400:kworker.0 00000100:00100000:0.0:1786002683.243963:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002683.243987:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561078912:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.243996:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561078272 00000100:00100000:3.0:1786002683.244000:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561078272 00000100:00100000:0.0:1786002683.244009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002683.244026:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561079424:0@lo:400:kworker.0 00000100:00100000:0.0:1786002683.244048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002683.244067:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786002683.244072:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561078784:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244081:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1786002683.244089:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561078144:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002683.244096:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002683.244111:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561079296:0@lo:400:kworker.0 00002000:00000024:3.0:1786002683.244113:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1786002683.244127:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002683.244149:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561078528:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244150:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561078144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002683.244157:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1786002683.244167:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002683.244172:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1786002683.244178:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561078272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002683.244181:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561079040:0@lo:400:kworker.0 00002000:00000024:3.0:1786002683.244187:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1786002683.244198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002683.244211:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561078272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002683.244212:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561079552:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244217:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1786002683.244230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786002683.244240:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002683.244252:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561078784 00000100:00100000:3.0:1786002683.244255:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561078784 00000100:00100000:0.0:1786002683.244262:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561078144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002683.244277:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1786002683.244278:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561078528 00000100:00100000:3.0:1786002683.244280:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561078528 00000100:00100000:0.0:1786002683.244282:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561078656:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244289:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561079040 00000100:00100000:3.0:1786002683.244291:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561079040 00000100:00100000:0.0:1786002683.244302:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002683.244306:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561079552 00000100:00100000:3.0:1786002683.244308:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561079552 00000100:00100000:0.0:1786002683.244317:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561079168:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244322:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:3.0:1786002683.244327:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561078784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002683.244335:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002683.244345:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed3433f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561079680:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244354:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561078784:12345-0@lo:400:kworker.0 Request processed in 27us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002683.244360:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1786002683.244362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002683.244369:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561079168 00000100:00100000:3.0:1786002683.244372:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561079168 00000100:00100000:0.0:1786002683.244383:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561078400 00000100:00100000:3.0:1786002683.244385:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561079680 00000100:00100000:0.0:1786002683.244385:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561078400 00000100:00100000:3.0:1786002683.244387:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561079680 00000100:00100000:3.0:1786002683.244399:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1786002683.244404:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561078528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002683.244409:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:0.0:1786002683.244414:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561078400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244434:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561078528:12345-0@lo:400:kworker.0 Request processed in 29us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002683.244437:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561078400:12345-0@lo:400:kworker.0 Request processed in 23us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002683.244440:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1786002683.244442:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1786002683.244450:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1786002683.244456:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561079040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002683.244467:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561078912 00000100:00100000:0.0:1786002683.244470:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561078912 00000100:00100000:3.0:1786002683.244479:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561079040:12345-0@lo:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002683.244485:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1786002683.244491:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561078656 00000100:00100000:3.0:1786002683.244494:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1786002683.244494:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561078656 00000100:00100000:3.0:1786002683.244499:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561079552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002683.244510:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4143 00000100:00100000:0.0:1786002683.244516:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561078912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244521:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561079552:12345-0@lo:400:kworker.0 Request processed in 23us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002683.244526:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:3.0:1786002683.244536:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1786002683.244541:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561079168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002683.244542:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561078912:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002683.244547:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4143 00000100:00100000:0.0:1786002683.244557:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4144 00000100:00100000:3.0:1786002683.244562:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561079168:12345-0@lo:400:kworker.0 Request processed in 21us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002683.244562:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561078656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244567:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1786002683.244577:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1786002683.244582:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561079680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002683.244584:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561078656:12345-0@lo:400:kworker.0 Request processed in 22us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002683.244589:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4144 00000100:00100000:3.0:1786002683.244602:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561079680:12345-0@lo:400:kworker.0 Request processed in 20us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002683.244605:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561079424 00000100:00100000:3.0:1786002683.244607:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1786002683.244608:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561079424 00000100:00080000:3.0:1786002683.244622:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786002683.244625:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786002683.244627:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002683.244628:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561079296 00000100:00100000:0.0:1786002683.244630:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561079296 00000100:00100000:3.0:1786002683.244643:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561078656:0@lo:400:kworker.0 00000100:00100000:0.0:1786002683.244650:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1786002683.244653:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561079168:0@lo:400:kworker.0 00000100:00100000:0.0:1786002683.244655:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561079424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244661:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561079680:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244682:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561078528:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244691:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561079040:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.244699:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561079552:0@lo:400:kworker.0 00000100:00080000:3.0:1786002683.244723:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002683.244840:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1786002683.244862:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561079296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002683.244977:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561079424:12345-0@lo:400:kworker.0 Request processed in 321us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002683.244984:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1786002683.245962:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561078784:0@lo:400:kworker.0 00000100:00100000:2.0:1786002683.252865:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561079296:12345-0@lo:400:kworker.0 Request processed in 7994us (8712us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002683.252887:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1786002683.254426:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561079296:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.254439:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561078400:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.254449:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561078912:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.254460:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed3433f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561079424:0@lo:400:kworker.0 00000100:00100000:3.0:1786002683.254470:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969951 gen 2 00000004:00080000:3.0:1786002683.254475:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ed2454e3b80, transno 4294969951 00000100:00100000:3.0:1786002683.254497:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561078272:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786002683.882327:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002684.792541:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786002684.792563:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561079808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786002684.792626:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002684.792957:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561079808 00000100:00100000:2.0:1786002684.792964:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561079808 00000100:00100000:2.0:1786002684.793020:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4145 00000100:00100000:2.0:1786002684.793029:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561079808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786002684.793061:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445040128 avail 1298800640 00000100:00100000:3.0:1786002684.793201:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561079808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002684.793292:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561079808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002684.793305:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4145 00010000:00010000:1.0:1786002684.909399:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002685.933508:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002686.826748:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561079936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786002686.826839:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002686.827095:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561079936 00000100:00100000:2.0:1786002686.827115:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561079936 00000100:00100000:2.0:1786002686.827184:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1786002686.827197:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561079936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786002686.827233:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002686.827287:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561079936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002686.827294:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00080000:3.0:1786002686.827361:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002686.827410:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561079936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002686.852951:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786002686.852997:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561080064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002686.853102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002686.853818:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561080064 00000100:00100000:2.0:1786002686.853828:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561080064 00000100:00100000:2.0:1786002686.853939:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1786002686.853951:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561080064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786002686.853990:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 163840 granted 108168896 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1786002686.854064:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561080064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002686.854071:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00080000:1.0:1786002686.856054:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002686.856123:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561080064:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1786002686.956304:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002687.318779:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002687.318816:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002687.318884:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002687.318903:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002687.318991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002687.319025:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531043200 00000100:00100000:1.0:1786002687.319036:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531043200 00000100:00100000:1.0:1786002687.319106:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531043328 00000100:00100000:1.0:1786002687.319110:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531043328 00000100:00100000:1.0:1786002687.319136:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1111 00000100:00100000:1.0:1786002687.319149:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2412:x1872758531043200:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002687.319243:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2412:x1872758531043200:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 96us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002687.319251:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1111 00000100:00100000:1.0:1786002687.319271:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1112 00000100:00100000:1.0:1786002687.319278:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531043328:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002687.319305:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531043328:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002687.319311:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1112 00000100:00080000:1.0:1786002687.319404:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786002687.319408:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786002687.319491:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531043456 00000100:00100000:0.0:1786002687.319496:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531043456 00000100:00100000:0.0:1786002687.319543:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531043584 00000100:00100000:0.0:1786002687.319547:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531043584 00000100:00100000:0.0:1786002687.319573:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 618 00000100:00100000:0.0:1786002687.319581:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531043456:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002687.319620:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531043456:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 40us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002687.319627:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 618 00000100:00100000:0.0:1786002687.319651:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 619 00000100:00100000:0.0:1786002687.319658:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531043584:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002687.319682:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:2412:x1872758531043584:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 24us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002687.319688:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 619 00000100:00100000:0.0:1786002687.319708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531043072 00000100:00100000:0.0:1786002687.319712:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531043072 00000100:00100000:0.0:1786002687.319740:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 575 00000100:00100000:0.0:1786002687.319747:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed357b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758531043072:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002687.319771:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed357b55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2412:x1872758531043072:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002687.319778:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 575 00000100:00080000:1.0:1786002687.323989:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002687.324002:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002687.342174:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002687.342208:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561080192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786002687.342318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002687.342617:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561080192 00000100:00100000:2.0:1786002687.342629:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561080192 00000100:00100000:2.0:1786002687.342709:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4146 00000100:00100000:2.0:1786002687.342722:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561080192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1786002687.342767:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443901440 avail 1297661952 00000100:00100000:2.0:1786002687.342823:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561080192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002687.342831:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4146 00000100:00100000:3.0:1786002687.343295:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561080192:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1786002687.978051:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786002688.289009:0:23274:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63c: test sync_on_close=1 ================= 03:51:26 (1786002686) 00000100:00100000:2.0:1786002688.362553:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561080448:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.362755:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002688.362802:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561080960:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.362824:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002688.364746:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561080320:0@lo:400:kworker.0 00000100:00100000:1.0:1786002688.364799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002688.364835:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561080832:0@lo:400:kworker.0 00000100:00100000:1.0:1786002688.364872:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002688.364889:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561081344:0@lo:400:kworker.0 00000100:00100000:1.0:1786002688.364909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002688.364924:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed349f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561081856:0@lo:400:kworker.0 00000100:00100000:1.0:1786002688.364943:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002688.364962:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002688.364967:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2457f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561081984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002688.364986:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002688.365009:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561080704:0@lo:400:kworker.0 00000100:00100000:1.0:1786002688.365035:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561081344 00000100:00100000:1.0:1786002688.365041:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561081344 00000100:00100000:1.0:1786002688.365083:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561081856 00000100:00100000:1.0:1786002688.365085:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561081856 00000100:00100000:1.0:1786002688.365105:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1786002688.365113:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561081344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002688.365155:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561081344:12345-0@lo:400:kworker.0 Request processed in 44us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002688.365162:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1786002688.365175:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1786002688.365180:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561081856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002688.365201:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561081856:12345-0@lo:400:kworker.0 Request processed in 21us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002688.365206:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1786002688.365224:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561081984 00000100:00100000:1.0:1786002688.365227:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561081984 00000100:00100000:1.0:1786002688.365249:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1786002688.365254:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561081984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1786002688.365271:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:1.0:1786002688.365296:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561081984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002688.365301:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00080000:1.0:1786002688.365314:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002688.365318:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002688.365348:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2457f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561081984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002688.365357:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561081344:0@lo:400:kworker.0 00000100:00100000:1.0:1786002688.365365:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed349f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561081856:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.365609:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561081472:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.365645:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002688.365675:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561080576:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.365698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002688.365714:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561081088:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.365735:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002688.365750:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed349f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561081600:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.365770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002688.365796:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561080448 00000100:00100000:2.0:1786002688.365800:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561080448 00000100:00100000:2.0:1786002688.365822:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561080960 00000100:00100000:2.0:1786002688.365825:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561080960 00000100:00100000:2.0:1786002688.365844:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561081472 00000100:00100000:2.0:1786002688.365861:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561081472 00000100:00100000:2.0:1786002688.365874:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561081088 00000100:00100000:2.0:1786002688.365876:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561081088 00000100:00100000:2.0:1786002688.365888:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561081600 00000100:00100000:2.0:1786002688.365891:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561081600 00000100:00100000:2.0:1786002688.365904:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1786002688.365910:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561080448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.365945:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1872758561080448:12345-0@lo:400:kworker.0 Request processed in 35us (3191us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.365951:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1786002688.365964:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1786002688.365970:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561080960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.365996:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1872758561080960:12345-0@lo:400:kworker.0 Request processed in 26us (3171us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.366002:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1786002688.366012:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1786002688.366017:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed366d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561081472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366039:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed366d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1872758561081472:12345-0@lo:400:kworker.0 Request processed in 22us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.366045:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1786002688.366056:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:2.0:1786002688.366061:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561081088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366088:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1872758561081088:12345-0@lo:400:kworker.0 Request processed in 27us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.366093:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:2.0:1786002688.366104:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:2.0:1786002688.366110:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561081600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366134:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1872758561081600:12345-0@lo:400:kworker.0 Request processed in 24us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.366139:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:2.0:1786002688.366156:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561080320 00000100:00100000:2.0:1786002688.366159:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561080320 00000100:00100000:2.0:1786002688.366182:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1786002688.366188:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561080320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366217:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3644:x1872758561080320:12345-0@lo:400:kworker.0 Request processed in 30us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.366226:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1786002688.366251:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561080832 00000100:00100000:2.0:1786002688.366254:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561080832 00000100:00100000:2.0:1786002688.366273:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561080576 00000100:00100000:2.0:1786002688.366275:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561080576 00000100:00100000:2.0:1786002688.366292:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4147 00000100:00100000:2.0:1786002688.366297:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561080832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366326:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561080832:12345-0@lo:400:kworker.0 Request processed in 28us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.366332:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4147 00000100:00100000:2.0:1786002688.366343:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4148 00000100:00100000:2.0:1786002688.366348:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561080576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366371:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3646:x1872758561080576:12345-0@lo:400:kworker.0 Request processed in 23us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.366377:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4148 00000100:00100000:2.0:1786002688.366411:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561080576:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366419:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1872758561081088:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366426:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed349f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1872758561081600:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366461:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2454e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:338407c0-17ce-47f6-a10f-807d82c493cd:3644:1872758561080320:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366469:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561080832:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366487:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1872758561080448:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366494:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1872758561080960:0@lo:400:kworker.0 00000100:00100000:2.0:1786002688.366504:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1872758561081472:0@lo:400:kworker.0 00000100:00100000:3.0:1786002688.369045:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561082112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002688.369095:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002688.370247:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561082112 00000100:00100000:2.0:1786002688.370256:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561082112 00000100:00100000:2.0:1786002688.370306:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:2.0:1786002688.370316:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561082112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002688.370338:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84293312 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1786002688.370387:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561082112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.370394:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:3.0:1786002688.371454:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561082112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002688.375104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.375151:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561081216:0@lo:400:kworker.0 00000100:00100000:3.0:1786002688.375210:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.375230:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed349f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561081728:0@lo:400:kworker.0 00000100:00100000:3.0:1786002688.375248:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.375296:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561080704 00000100:00100000:3.0:1786002688.375302:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561080704 00000100:00100000:3.0:1786002688.375340:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:3.0:1786002688.375347:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561080704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002688.375391:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1872758561080704:12345-0@lo:400:kworker.0 Request processed in 44us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.375398:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:3.0:1786002688.375416:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561081216 00000100:00100000:3.0:1786002688.375419:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561081216 00000100:00100000:3.0:1786002688.375439:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561081728 00000100:00100000:3.0:1786002688.375441:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561081728 00000100:00100000:3.0:1786002688.375456:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1786002688.375461:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561081216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002688.375499:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561081216:12345-0@lo:400:kworker.0 Request processed in 37us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.375505:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1786002688.375515:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1786002688.375520:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561081728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002688.375539:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561081728:12345-0@lo:400:kworker.0 Request processed in 19us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.375544:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1786002688.375576:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1872758561080704:0@lo:400:kworker.0 00000100:00100000:3.0:1786002688.375584:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561081216:0@lo:400:kworker.0 00000100:00100000:3.0:1786002688.375591:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed349f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561081728:0@lo:400:kworker.0 00000100:00080000:0.0:1786002688.379903:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786002688.379913:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1786002688.379916:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786002688.426828:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002688.427080:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531043840 00000100:00100000:2.0:1786002688.427089:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531043840 00000100:00100000:2.0:1786002688.427176:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24215 00000100:00100000:2.0:1786002688.427194:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:22376:x1872758531043840:12345-192.168.203.49@tcp:36:mkdir.0 00000100:00100000:2.0:1786002688.427289:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561082240:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002688.427337:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002688.427364:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245db1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002688.427382:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561082240 00000100:00100000:2.0:1786002688.427386:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561082240 00000100:00100000:2.0:1786002688.427413:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4149 00000100:00100000:2.0:1786002688.427420:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:10360:x1872758561082240:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002688.427480:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:10360:x1872758561082240:12345-0@lo:1000:mdt00_003.0 Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.427488:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4149 00000100:00100000:2.0:1786002688.427526:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561082240:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002688.427565:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561082368:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002688.427586:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002688.427601:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245db1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786002688.427612:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561082368 00000100:00100000:2.0:1786002688.427615:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561082368 00000100:00100000:2.0:1786002688.427648:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4150 00000100:00100000:2.0:1786002688.427655:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:10360:x1872758561082368:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786002688.427727:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:10360:x1872758561082368:12345-0@lo:1000:mdt00_003.0 Request processed in 72us (139us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786002688.427733:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4150 00000100:00100000:2.0:1786002688.427756:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561082368:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1786002688.427796:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.427806:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.427816:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002688.427826:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561082496:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1786002688.427861:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002688.427873:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245db1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786002688.427883:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561082496 00000100:00100000:2.0:1786002688.427886:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561082496 00000100:00100000:2.0:1786002688.427904:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4151 00000100:00100000:2.0:1786002688.427909:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:10360:x1872758561082496:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1786002688.427917:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002688.427929:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af578417412 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af57841740b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.427949:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417404 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b120 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.427958:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af578417412 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841740b expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.427977:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b120 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.427989:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417404 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b120 expref: 14 pid: 6520 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002688.428000:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6525:1872758561082624:192.168.203.49@tcp:104: 00000100:00100000:2.0:1786002688.428047:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245db1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786002688.437165:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002688.438797:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531043968 00000100:00100000:1.0:1786002688.438806:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531043968 00010000:00010000:1.0:1786002688.438874:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417404 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b120 expref: 15 pid: 6520 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002688.438916:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1701 00000100:00100000:1.0:1786002688.438926:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2412:x1872758531043968:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002688.438940:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002688.438946:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417404 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b120 expref: 15 pid: 6520 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.438959:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417404 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b120 expref: 15 pid: 6520 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.438991:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002688.438998:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af578417412 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af57841740b expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.439009:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af578417412 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7cee4af57841740b expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.439017:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af578417412 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7cee4af57841740b expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.439050:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af578417412 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841740b expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002688.439064:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758561082752:0@lo:105: 00000100:00100000:1.0:1786002688.439115:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002688.439148:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d58240 going to sleep for 11 seconds 00000100:00100000:2.0:1786002688.439396:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561082752 00000100:00100000:2.0:1786002688.439401:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561082752 00000100:00100000:2.0:1786002688.439439:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1786002688.439447:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758561082752:12345-0@lo:105: 00010000:00010000:2.0:1786002688.439457:0:6504:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.439465:0:6504:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.439474:0:6504:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.439487:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.439493:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.439501:0:6504:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.439514:0:6504:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9ed245ed3000) 00000100:00100000:2.0:1786002688.439552:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6506:x1872758561082752:12345-0@lo:105: Request processed in 106us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.439558:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:1.0:1786002688.441304:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245512680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6506:1872758561082752:0@lo:105: 00010000:00010000:1.0:1786002688.441323:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002688.441366:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2412:x1872758531043968:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 2441us (4217us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002688.441375:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1701 00010000:00010000:3.0:1786002688.448760:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3200/0x7cee4af578417404 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b120 expref: 14 pid: 6520 timeout: 1148 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002688.448785:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6525:1872758561082624:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002688.448813:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af578417412 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af57841740b expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.448823:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002688.448826:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002688.448830:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed2200, rc 0) 00000100:00100000:3.0:1786002688.448948:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:10360:x1872758561082496:12345-0@lo:101:mdt00_003.0 Request processed in 21037us (21100us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.448956:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4151 00000100:00100000:3.0:1786002688.448997:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561082496:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002688.449011:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002688.449029:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1786002688.449065:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.449071:0:10360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.449079:0:10360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002688.449095:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561082880:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1786002688.449126:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.449145:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e300c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002688.449161:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561082880 00000100:00100000:3.0:1786002688.449166:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561082880 00000100:00100000:3.0:1786002688.449197:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4152 00000100:00100000:3.0:1786002688.449205:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:10360:x1872758561082880:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002688.449219:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002688.449232:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417420 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7cee4af578417419 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.449258:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417420 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7cee4af578417419 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.449270:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417420 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578417419 expref: 11 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.449276:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff9ed245735100) 00010000:00010000:3.0:1786002688.449279:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002688.449281:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82400, rc 0) 00000100:00100000:3.0:1786002688.449307:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561082880:12345-0@lo:101:mdt00_003.0 Request processed in 103us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.449313:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4152 00000100:00100000:3.0:1786002688.449342:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561082880:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1786002688.449352:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578417420 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.449361:0:10360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578417420 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002688.449372:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1786002688.449403:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561083008:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.449426:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.449441:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e30780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002688.449454:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561083008 00000100:00100000:3.0:1786002688.449457:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561083008 00000100:00100000:3.0:1786002688.449477:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4153 00000100:00100000:3.0:1786002688.449483:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561083008:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.449533:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561083008:12345-0@lo:1000:mdt00_003.0 Request processed in 49us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.449539:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4153 00000100:00100000:3.0:1786002688.449560:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561083008:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.449592:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561083136:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.449611:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.449622:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e30780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002688.449661:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561083136 00000100:00100000:3.0:1786002688.449665:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561083136 00000100:00100000:3.0:1786002688.449682:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4154 00000100:00100000:3.0:1786002688.449686:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561083136:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.449747:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561083136:12345-0@lo:1000:mdt00_003.0 Request processed in 59us (134us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002688.449753:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4154 00000100:00100000:3.0:1786002688.449773:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561083136:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.449828:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561083264:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.449863:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.449874:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e30780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002688.449883:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561083264 00000100:00100000:3.0:1786002688.449885:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561083264 00000100:00100000:3.0:1786002688.449901:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4155 00000100:00100000:3.0:1786002688.449906:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561083264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.449948:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561083264:12345-0@lo:1000:mdt00_003.0 Request processed in 41us (84us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786002688.449957:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4155 00000100:00100000:3.0:1786002688.449976:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561083264:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.450010:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561083392:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.450047:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.450059:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e30780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002688.450068:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561083392 00000100:00100000:3.0:1786002688.450071:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561083392 00000100:00100000:3.0:1786002688.450088:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4156 00000100:00100000:3.0:1786002688.450092:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561083392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.450127:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561083392:12345-0@lo:1000:mdt00_003.0 Request processed in 35us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.450133:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4156 00000100:00100000:3.0:1786002688.450152:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561083392:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.450184:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561083520:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.450203:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.450215:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e30780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002688.450225:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561083520 00000100:00100000:3.0:1786002688.450228:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561083520 00000100:00100000:3.0:1786002688.450244:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4157 00000100:00100000:3.0:1786002688.450249:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561083520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.450291:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561083520:12345-0@lo:1000:mdt00_003.0 Request processed in 41us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.450297:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4157 00000100:00100000:3.0:1786002688.450318:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561083520:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.450351:0:10360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561083648:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.450368:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.450378:0:10360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e30780 going to sleep for 11 seconds 00000100:00100000:3.0:1786002688.450387:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561083648 00000100:00100000:3.0:1786002688.450389:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561083648 00000100:00100000:3.0:1786002688.450405:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4158 00000100:00100000:3.0:1786002688.450409:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561083648:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786002688.450445:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:10360:x1872758561083648:12345-0@lo:1000:mdt00_003.0 Request processed in 35us (76us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.450451:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4158 00000100:00100000:3.0:1786002688.450469:0:10360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:10360:1872758561083648:0@lo:1000:mdt00_003.0 00000040:00080000:3.0:1786002688.450909:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].418, 984 off624536 00000040:00080000:3.0:1786002688.450955:0:10360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].417, 1136 off673672 00000004:00080000:3.0:1786002688.450961:0:10360:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245e300c0 with version 798 00000004:00080000:3.0:1786002688.450973:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 798 rpc_version 798 00000020:00100000:3.0:1786002688.450989:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1786002688.450995:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed2455fd180 x1872758561083904/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786002688.451008:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fd180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758561083904:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002688.451031:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.451042:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e30c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002688.451052:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561083904 00000100:00100000:3.0:1786002688.451055:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561083904 00000100:00100000:3.0:1786002688.451072:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4159 00000100:00100000:3.0:1786002688.451076:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:7466:x1872758561083904:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1786002688.451302:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:7466:x1872758561083904:12345-0@lo:1000:osp_up0-1.0 Request processed in 224us (269us total) trans 4294984171 rc 0/0 00000100:00100000:3.0:1786002688.451309:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4159 00000100:00100000:3.0:1786002688.451340:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fd180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758561083904:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1786002688.451401:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417427 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.451413:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417427 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.451423:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417427 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002688.451437:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b22fc44 reply state 00000000ffc16ec9 transno 4294968603 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417427 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.451448:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417427 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.451455:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:3.0:1786002688.451458:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002688.451460:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1786002688.451465:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a1:0x0]: returning size 4096 00000004:00080000:3.0:1786002688.451470:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1786002688.451477:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.451485:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.451492:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.451511:0:10360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1786002688.451515:0:10360:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1786002688.451519:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578417420 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.451526:0:10360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7cee4af578417420 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002688.451576:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:22376:x1872758531043840:12345-192.168.203.49@tcp:36:mkdir.0 Request processed in 24391us (24756us total) trans 4294968603 rc 0/0 00000100:00100000:3.0:1786002688.451583:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24215 00010000:00010000:3.0:1786002688.451600:0:14667:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002688.451605:0:14667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.451613:0:14667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3000 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002688.451618:0:14667:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002688.451626:0:14667:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002688.454721:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984171 is committed 00010000:00010000:3.0:1786002688.464980:0:14667:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.464990:0:14667:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002688.465025:0:14667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.465034:0:14667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245ed3000/0x7cee4af57841740b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7cee4af578417412 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.465050:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002688.465052:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002688.465055:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002688.465186:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002688.465205:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561084032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002688.465268:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.465316:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561084032 00000100:00100000:3.0:1786002688.465322:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561084032 00000100:00100000:3.0:1786002688.465363:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:3.0:1786002688.465371:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3646:x1872758561084032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002688.465382:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002688.465399:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2200/0x7cee4af578417412 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7cee4af57841740b expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.465413:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002688.465417:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002688.465445:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3646:x1872758561084032:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.465452:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:3.0:1786002688.465489:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561084032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786002688.504901:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002688.504985:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531044096 00000100:00100000:1.0:1786002688.504994:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531044096 00000100:00100000:1.0:1786002688.505053:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24216 00000100:00100000:1.0:1786002688.505064:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:22380:x1872758531044096:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002688.505083:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002688.505102:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af57841742e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b127 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.505159:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417435 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.505171:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417435 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.505183:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417435 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002688.505224:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:1.0:1786002688.505227:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786002688.505245:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417435 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.505269:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556b400/0x7cee4af57841742e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b127 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.505292:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417435 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b127 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.505300:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002688.505303:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786002688.505306:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556be00, rc 0) 00000100:00100000:1.0:1786002688.505363:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22380:x1872758531044096:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 300us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002688.505370:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24216 00000100:00100000:0.0:1786002688.522640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002688.526099:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531044352 00000100:00100000:3.0:1786002688.526111:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531044352 00000100:00100000:3.0:1786002688.526172:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24217 00000100:00100000:3.0:1786002688.526182:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22380:x1872758531044352:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002688.526213:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002688.526216:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786002688.526242:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556be00/0x7cee4af578417435 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b127 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526261:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:3.0:1786002688.526265:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002688.526278:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841743c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b12e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526396:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af578417443 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526408:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af578417443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526417:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af578417443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526426:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526436:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417420 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7cee4af578417419 expref: 9 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526444:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526474:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417420 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7cee4af578417419 expref: 9 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002688.526490:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1872758561084160:0@lo:104: 00000100:00100000:3.0:1786002688.526545:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.526588:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e30c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786002688.526621:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561084160 00000100:00100000:3.0:1786002688.526625:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561084160 00000100:00100000:3.0:1786002688.526665:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1786002688.526671:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6520:x1872758561084160:12345-0@lo:104: 00010000:00010000:3.0:1786002688.526684:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578417420 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526730:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786002688.526736:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6520:x1872758561084160:12345-0@lo:104: Request processed in 65us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.526742:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:3.0:1786002688.526780:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1872758561084160:0@lo:104: 00010000:00010000:3.0:1786002688.526799:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526815:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786002688.526820:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7cee4af578417420 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526828:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82a00 already unused, calling callback (ffffffffc18bbee0) 00010000:00010000:3.0:1786002688.526832:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7cee4af578417420 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002688.526870:0:6508:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7cee4af578417420 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526894:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578417420 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526900:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786002688.526918:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578417420 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526926:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9ed245f82a00/0x7cee4af578417419 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7cee4af578417420 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.526941:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002688.526943:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002688.526945:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002688.526955:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561084288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786002688.526982:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.527017:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561084288 00000100:00100000:3.0:1786002688.527021:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561084288 00010000:00010000:3.0:1786002688.527037:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417420 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7cee4af578417419 expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002688.527059:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1702 00000100:00100000:3.0:1786002688.527066:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3644:x1872758561084288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786002688.527092:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002688.527568:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82400/0x7cee4af578417420 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7cee4af578417419 expref: 10 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.527579:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff9ed245735100) 00010000:00010000:3.0:1786002688.527583:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.527591:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.527597:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.527664:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002688.527694:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561084288:12345-0@lo:103:ldlm_bl.0 Request processed in 628us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.527702:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1702 00000100:00100000:3.0:1786002688.527745:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561084288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786002688.532963:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.532979:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002688.533086:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2423f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758561084416:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786002688.533146:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002688.533185:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243311cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786002688.533310:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561084416 00000100:00100000:3.0:1786002688.533318:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561084416 00000100:00100000:3.0:1786002688.533374:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4160 00000100:00100000:3.0:1786002688.533384:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6520:x1872758561084416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002688.533475:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6520:x1872758561084416:12345-0@lo:1000:mdt00_000.0 Request processed in 91us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.533482:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4160 00000100:00100000:1.0:1786002688.533588:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2423f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1872758561084416:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1786002688.533681:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417451 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533695:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417451 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533706:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417451 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533719:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af578417443 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533725:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af578417443 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533731:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af578417443 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533737:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af578417443 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533743:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002688.533748:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af578417443 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533755:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af578417443 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533766:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:1.0:1786002688.533769:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002688.533774:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af578417443 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533780:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83600/0x7cee4af578417443 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533791:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533797:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533803:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533808:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002688.533810:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533815:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533825:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff9ed245735100) 00010000:00010000:1.0:1786002688.533827:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002688.533829:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533834:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82600/0x7cee4af57841744a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533907:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82c00/0x7cee4af57841743c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b12e expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533920:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417451 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b12e expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.533927:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245644800) 00010000:00010000:1.0:1786002688.533929:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002688.533931:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556aa00, rc 0) 00000100:00100000:1.0:1786002688.533978:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22380:x1872758531044352:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 7797us (11357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002688.533985:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24217 00000100:00100000:0.0:1786002688.558187:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002688.558339:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531044608 00000100:00100000:1.0:1786002688.558349:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531044608 00000100:00100000:1.0:1786002688.558412:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24218 00000100:00100000:1.0:1786002688.558422:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:22380:x1872758531044608:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002688.558447:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002688.558467:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417458 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b135 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002688.558584:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a1:0x0]: returning size 4096 00010000:00010000:1.0:1786002688.558612:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417458 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b135 expref: 10 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.558628:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:1.0:1786002688.558641:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002688.558646:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417458 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b135 expref: 10 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.558660:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b400, rc 0) 00000100:00100000:1.0:1786002688.558719:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:22380:x1872758531044608:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 298us (542us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002688.558726:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24218 00000100:00100000:3.0:1786002688.562819:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002688.562944:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531044736 00000100:00100000:0.0:1786002688.562954:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531044736 00000100:00100000:0.0:1786002688.563011:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24219 00000100:00100000:0.0:1786002688.563021:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22380:x1872758531044736:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1786002688.563041:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002688.563061:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af57841745f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b13c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.563115:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578417466 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.563129:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578417466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.563141:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578417466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002688.563183:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 249856 00000004:00200000:0.0:1786002688.563186:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786002688.563205:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578417466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.563227:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245717000/0x7cee4af57841745f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b13c expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.563250:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245716200/0x7cee4af578417466 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b13c expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.563258:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:0.0:1786002688.563262:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786002688.563265:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245716200, rc 0) 00000100:00100000:0.0:1786002688.563319:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22380:x1872758531044736:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 300us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002688.563326:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24219 00000100:00100000:0.0:1786002688.570578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002688.582838:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531044992 00000100:00100000:2.0:1786002688.582871:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531044992 00000100:00100000:2.0:1786002688.582933:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24220 00000100:00100000:2.0:1786002688.582942:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22380:x1872758531044992:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002688.582963:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002688.583169:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af57841746d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b143 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583240:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578417474 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583255:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578417474 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583271:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578417474 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583285:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af57841747b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583293:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af57841747b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583299:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af57841747b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583357:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417482 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583366:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417482 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583372:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417482 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583384:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578417474 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583391:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578417474 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583397:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578417474 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583403:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578417474 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583412:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002688.583416:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578417474 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583423:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578417474 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583433:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002688.583436:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002688.583440:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578417474 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583445:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3400/0x7cee4af578417474 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583456:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af57841747b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583460:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af57841747b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583465:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af57841747b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583469:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002688.583471:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af57841747b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583475:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af57841747b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583484:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff9ed2456f9800) 00010000:00010000:2.0:1786002688.583486:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002688.583488:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af57841747b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583493:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2e00/0x7cee4af57841747b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583523:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2800/0x7cee4af57841746d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b143 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583534:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417482 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b143 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.583541:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245644800) 00010000:00010000:2.0:1786002688.583543:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002688.583545:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3e00, rc 0) 00000100:00100000:2.0:1786002688.583660:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:22380:x1872758531044992:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 718us (13090us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.583667:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24220 00000100:00100000:0.0:1786002688.599323:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002688.599372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002688.599404:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531045376 00000100:00100000:0.0:1786002688.599413:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531045376 00000100:00100000:0.0:1786002688.599470:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1523 00000100:00100000:0.0:1786002688.599480:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531045376:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002688.599494:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002688.599519:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed3e00/0x7cee4af578417482 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b143 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.599535:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245644800) 00010000:00010000:0.0:1786002688.599541:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002688.599593:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531045376:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 114us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002688.599601:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1523 00000100:00100000:1.0:1786002688.614296:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531045248 00000100:00100000:1.0:1786002688.614311:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531045248 00000100:00100000:1.0:1786002688.614368:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24221 00000100:00100000:1.0:1786002688.614378:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:22380:x1872758531045248:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002688.614400:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002688.614419:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578417489 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b14a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002688.614512:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a1:0x0]: returning size 4096 00010000:00010000:1.0:1786002688.614607:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578417489 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b14a expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.614623:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:1.0:1786002688.614626:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002688.614642:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af578417489 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b14a expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.614654:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a200, rc 0) 00000100:00100000:1.0:1786002688.614714:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:22380:x1872758531045248:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 338us (15400us total) trans 4294968604 rc 301/301 00000100:00100000:1.0:1786002688.614721:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24221 00000100:00100000:1.0:1786002688.621664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002688.627547:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531045632 00000100:00100000:3.0:1786002688.627563:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531045632 00000100:00100000:3.0:1786002688.627649:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24222 00000100:00100000:3.0:1786002688.627660:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:22380:x1872758531045632:12345-192.168.203.49@tcp:36:lfs.0 00010000:00010000:3.0:1786002688.627736:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417497 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.627753:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417497 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.627765:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417497 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002688.627931:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7c68f06 reply state 0000000048839ed6 transno 4294968605 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417497 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.627944:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417497 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.627951:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:3.0:1786002688.627954:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1786002688.627958:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1786002688.627964:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a1:0x0]: returning size 4096 00000100:00100000:3.0:1786002688.633124:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:22380:x1872758531045632:12345-192.168.203.49@tcp:36:lfs.0 Request processed in 5460us (11460us total) trans 4294968605 rc 0/0 00000100:00100000:3.0:1786002688.633136:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24222 00000100:00100000:0.0:1786002688.642043:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002688.650492:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531045888 00000100:00100000:3.0:1786002688.650505:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531045888 00000100:00100000:3.0:1786002688.651155:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5232 00000100:00100000:3.0:1786002688.651166:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:22380:x1872758531045888:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1786002688.653724:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:22380:x1872758531045888:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 2553us (11684us total) trans 4294968606 rc 0/0 00000100:00100000:3.0:1786002688.653735:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5232 00000100:00100000:3.0:1786002688.790666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002688.790808:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531046144 00000100:00100000:2.0:1786002688.790818:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531046144 00000100:00100000:2.0:1786002688.790930:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24223 00000100:00100000:2.0:1786002688.790941:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:22391:x1872758531046144:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002688.790964:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002688.790991:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af57841749e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b151 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.791095:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784174a5 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.791109:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784174a5 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.791120:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784174a5 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.791165:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af5784174ac lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x69eaf62e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.791173:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af5784174ac lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.791180:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af5784174ac lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002688.819562:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24351d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758561084544:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786002688.819649:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002688.819713:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245e30c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786002688.821401:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561084544 00000100:00100000:0.0:1786002688.821411:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561084544 00000100:00100000:0.0:1786002688.821463:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4161 00000100:00100000:0.0:1786002688.821471:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6520:x1872758561084544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786002688.821579:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6520:x1872758561084544:12345-0@lo:1000:mdt00_000.0 Request processed in 108us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002688.821586:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4161 00000100:00100000:1.0:1786002688.822241:0:6520:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294984171 gen 2 00000004:00080000:1.0:1786002688.822247:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294984171 committed transno 4294984171 00000100:00100000:1.0:1786002688.822271:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24351d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6520:1872758561084544:0@lo:1000:mdt00_000.0 00000004:00080000:1.0:1786002688.822538:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1786002688.822724:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784174b3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822739:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784174b3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822752:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784174b3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822784:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784174a5 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822791:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784174a5 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822798:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784174a5 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822809:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784174a5 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822816:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002688.822820:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784174a5 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822826:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784174a5 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822880:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:1.0:1786002688.822884:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002688.822894:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784174a5 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822901:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784174a5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002688.822914:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000529ec8d9 reply state 000000003484e2ce transno 4294968607 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af5784174ac lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822924:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af5784174ac lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822931:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x69eaf62e (ffff9ed2456f9800) 00010000:00010000:1.0:1786002688.822934:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002688.822936:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002688.822975:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af57841749e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b151 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.822995:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784174b3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b151 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.823003:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9ed245644c00) 00010000:00010000:1.0:1786002688.823005:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002688.823008:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556a200, rc 0) 00000100:00100000:1.0:1786002688.823049:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22391:x1872758531046144:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 32110us (32392us total) trans 4294968607 rc 0/0 00000100:00100000:1.0:1786002688.823056:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24223 00000100:00100000:1.0:1786002688.829972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002688.830107:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531046400 00000100:00100000:3.0:1786002688.830116:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531046400 00000100:00100000:3.0:1786002688.830175:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5233 00000100:00100000:3.0:1786002688.830184:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22391:x1872758531046400:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:3.0:1786002688.830450:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:22391:x1872758531046400:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 266us (486us total) trans 4294968608 rc 0/0 00000100:00100000:3.0:1786002688.830458:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5233 00000100:00100000:0.0:1786002688.842063:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002688.842281:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531046528 00000100:00100000:1.0:1786002688.842292:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531046528 00000100:00100000:1.0:1786002688.842351:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24224 00000100:00100000:1.0:1786002688.842361:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:22391:x1872758531046528:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002688.846126:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968608 is committed 00000020:00080000:2.0:1786002688.846148:0:7451:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9ed245e30780 refcount 2 committed 0 result 0 batchid 420 00010000:00010000:3.0:1786002688.846277:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417427 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846289:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417427 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846296:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417427 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846302:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002688.846306:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417427 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846314:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417427 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846330:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:3.0:1786002688.846334:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002688.846339:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417427 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846347:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417427 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846365:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417497 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846371:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417497 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846376:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417497 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846382:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002688.846385:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417497 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846391:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417497 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846399:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:3.0:1786002688.846401:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786002688.846404:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417497 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846410:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417497 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846430:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af5784174ac lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846441:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af5784174ac lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846447:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af5784174ac lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846452:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002688.846455:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af5784174ac lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846460:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af5784174ac lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846468:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x69eaf62e (ffff9ed2456f9800) 00010000:00010000:3.0:1786002688.846471:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002688.846474:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af5784174ac lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.846480:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af5784174ac lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x69eaf62e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1786002688.846710:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebee00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9ed245e300c0 00000020:00080000:2.0:1786002688.846714:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].417 00000020:00080000:2.0:1786002688.846717:0:7451:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ed245ebe400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ed353703600 00000020:00080000:2.0:1786002688.846719:0:7451:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].418 00000020:00080000:1.0:1786002688.846804:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 420 committed batchid 419 00000020:00080000:1.0:1786002688.846899:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 419 00000100:00100000:3.0:1786002688.847253:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:22391:x1872758531046528:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 4888us (5194us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.847263:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24224 00000100:00100000:0.0:1786002688.864690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002688.864818:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531046784 00000100:00100000:1.0:1786002688.864827:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531046784 00000100:00100000:1.0:1786002688.864911:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24225 00000100:00100000:1.0:1786002688.864921:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:22391:x1872758531046784:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002688.864941:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002688.864961:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af5784174c1 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b158 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.865063:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af5784174c8 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.865087:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af5784174c8 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.865097:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af5784174c8 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.865141:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af5784174cf lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x112b43cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.865310:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af5784174cf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.865321:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af5784174cf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002688.865593:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1786002688.865788:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784174d6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.865798:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784174d6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.865806:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784174d6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.865834:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af5784174c8 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.865842:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af5784174c8 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.867060:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af5784174c8 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.867175:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af5784174c8 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.867183:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002688.867187:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af5784174c8 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.867196:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af5784174c8 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.867210:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245644700) 00010000:00010000:1.0:1786002688.867213:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002688.867218:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af5784174c8 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.867224:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af5784174c8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002688.867239:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ad9d3e0 reply state 00000000042ed2b0 transno 4294968609 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af5784174cf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.867250:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af5784174cf lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.867256:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x112b43cf (ffff9ed245644b00) 00010000:00010000:1.0:1786002688.867259:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002688.867262:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002688.867304:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af5784174c1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b158 expref: 11 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.867328:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784174d6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b158 expref: 10 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002688.867336:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9ed245644600) 00010000:00010000:1.0:1786002688.867338:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002688.867340:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b000, rc 0) 00000100:00100000:1.0:1786002688.867414:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:22391:x1872758531046784:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2494us (2732us total) trans 4294968609 rc 0/0 00000100:00100000:1.0:1786002688.867423:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24225 00000100:00100000:1.0:1786002688.881331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002688.881544:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531047040 00000100:00100000:3.0:1786002688.881554:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531047040 00000100:00100000:3.0:1786002688.881607:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5234 00000100:00100000:3.0:1786002688.881616:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:22391:x1872758531047040:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:3.0:1786002688.881932:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:22391:x1872758531047040:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 316us (608us total) trans 4294968610 rc 0/0 00000100:00100000:3.0:1786002688.881940:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5234 00000100:00100000:0.0:1786002688.896394:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002688.896475:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531047168 00000100:00100000:1.0:1786002688.896484:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531047168 00000100:00100000:1.0:1786002688.896537:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24226 00000100:00100000:1.0:1786002688.896545:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2423fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:22391:x1872758531047168:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002688.900266:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968610 is committed 00000020:00080000:2.0:1786002688.900280:0:7451:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 420 batchid updated 00010000:00010000:0.0:1786002688.900376:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af5784174cf lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.900389:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af5784174cf lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.900395:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af5784174cf lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.900401:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556be00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002688.900405:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af5784174cf lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.900412:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af5784174cf lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.900427:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x112b43cf (ffff9ed245644b00) 00010000:00010000:0.0:1786002688.900430:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002688.900435:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af5784174cf lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.900441:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af5784174cf lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x112b43cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1786002688.905541:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 420 00000004:00080000:1.0:1786002688.905616:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9ed245d58780 with version 799 00000020:00080000:1.0:1786002688.905646:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 420 cancel update log [0x200000401:0x3:0x0].417: rc = 0 00000004:00080000:0.0:1786002688.906639:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9ed3455da0c0 version 799 rpc_version 799 00000020:00100000:0.0:1786002688.906692:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1786002688.906702:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9ed34b5ec000 x1872758561084800/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786002688.906737:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5ec000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758561084800:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002688.906793:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002688.906839:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243311840 going to sleep for 11 seconds 00000100:00100000:0.0:1786002688.906873:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561084800 00000100:00100000:0.0:1786002688.906879:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561084800 00000100:00100000:0.0:1786002688.906922:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4162 00000100:00100000:0.0:1786002688.906929:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:7466:x1872758561084800:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1786002688.907054:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:7466:x1872758561084800:12345-0@lo:1000:osp_up0-1.0 Request processed in 125us (261us total) trans 4294984172 rc 0/0 00000100:00100000:0.0:1786002688.907062:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4162 00000100:00100000:0.0:1786002688.907117:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5ec000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1872758561084800:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1786002688.908812:0:7474:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 420 cancel update log [0x240000400:0x3:0x0].418: rc = 0 00000020:00080000:0.0:1786002688.908825:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 420 00000100:00100000:3.0:1786002688.922452:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2423fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:22391:x1872758531047168:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 21046us (21204us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002688.922476:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24226 00000100:00100000:1.0:1786002688.924624:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002688.924713:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531047424 00000100:00100000:2.0:1786002688.924723:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531047424 00000100:00100000:2.0:1786002688.924778:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24227 00000100:00100000:2.0:1786002688.924789:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:22391:x1872758531047424:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002688.924817:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002688.924880:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784174e4 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b15f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.924982:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784174eb lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.924996:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784174eb lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925007:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784174eb lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925020:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784174f2 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x5e132fd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925028:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784174f2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925034:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784174f2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002688.925339:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1786002688.925468:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3800/0x7cee4af5784174f9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925478:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3800/0x7cee4af5784174f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925486:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3800/0x7cee4af5784174f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925517:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784174eb lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925525:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784174eb lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925531:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784174eb lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925537:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784174eb lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925543:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002688.925547:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784174eb lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925554:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784174eb lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925564:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456f9800) 00010000:00010000:2.0:1786002688.925567:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002688.925571:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784174eb lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925577:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784174eb lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002688.925588:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3250e6d reply state 0000000048e233e1 transno 4294968611 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784174f2 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925598:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784174f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925605:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x5e132fd4 (ffff9ed2456f9500) 00010000:00010000:2.0:1786002688.925607:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002688.925609:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002688.925644:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784174e4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b15f expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925663:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3800/0x7cee4af5784174f9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b15f expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.925670:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9ed2456f9a00) 00010000:00010000:2.0:1786002688.925672:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002688.925675:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3800, rc 0) 00000100:00100000:2.0:1786002688.925732:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:22391:x1872758531047424:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 944us (1113us total) trans 4294968611 rc 0/0 00000100:00100000:2.0:1786002688.925739:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24227 00000100:00100000:1.0:1786002688.931434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002688.931686:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531047680 00000100:00100000:2.0:1786002688.931695:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531047680 00000100:00100000:2.0:1786002688.931749:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5235 00000100:00100000:2.0:1786002688.931759:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:22391:x1872758531047680:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:2.0:1786002688.932200:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:22391:x1872758531047680:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 441us (773us total) trans 4294968612 rc 0/0 00000100:00100000:2.0:1786002688.932209:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5235 00000100:00100000:0.0:1786002688.947806:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002688.948959:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531047808 00000100:00100000:1.0:1786002688.948969:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531047808 00000100:00100000:1.0:1786002688.949033:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24228 00000100:00100000:1.0:1786002688.949044:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:22391:x1872758531047808:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002688.951932:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968612 is committed 00010000:00010000:3.0:1786002688.952002:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784174f2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.952027:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784174f2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.952035:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784174f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.952040:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002688.952044:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784174f2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.952050:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784174f2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.952064:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x5e132fd4 (ffff9ed2456f9500) 00010000:00010000:3.0:1786002688.952089:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002688.952094:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784174f2 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002688.952098:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784174f2 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x5e132fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002688.952520:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:22391:x1872758531047808:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 3475us (4719us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002688.952530:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24228 00000100:00100000:1.0:1786002688.965933:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002688.966793:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531048064 00000100:00100000:0.0:1786002688.966803:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531048064 00000100:00100000:0.0:1786002688.966890:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24229 00000100:00100000:0.0:1786002688.966900:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:22391:x1872758531048064:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002688.966921:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002688.966941:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af578417507 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b166 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967041:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af57841750e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967055:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af57841750e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967066:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af57841750e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967079:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af578417515 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0xd873b914 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967086:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af578417515 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967093:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af578417515 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002688.967495:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1786002688.967621:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af57841751c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967640:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af57841751c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967648:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af57841751c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967684:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af57841750e lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967691:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af57841750e lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967697:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af57841750e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967704:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af57841750e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967709:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002688.967713:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af57841750e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967721:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af57841750e lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967732:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ae300) 00010000:00010000:0.0:1786002688.967735:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002688.967739:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af57841750e lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967745:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af57841750e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002688.967757:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb74e95d reply state 000000009fe964b8 transno 4294968613 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af578417515 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967767:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af578417515 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967774:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xd873b914 (ffff9ed2456ae700) 00010000:00010000:0.0:1786002688.967776:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002688.967778:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002688.967804:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af578417507 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b166 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967820:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af57841751c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b166 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002688.967826:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9ed2456ae600) 00010000:00010000:0.0:1786002688.967828:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002688.967830:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245716a00, rc 0) 00000100:00100000:0.0:1786002688.968007:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:22391:x1872758531048064:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1107us (2080us total) trans 4294968613 rc 0/0 00000100:00100000:0.0:1786002688.968014:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24229 00000100:00100000:0.0:1786002688.982787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002688.984709:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531048320 00000100:00100000:1.0:1786002688.984719:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531048320 00000100:00100000:1.0:1786002688.984775:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5236 00000100:00100000:1.0:1786002688.984783:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:22391:x1872758531048320:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:0.0:1786002688.985120:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:22391:x1872758531048320:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 335us (2339us total) trans 4294968614 rc 0/0 00000100:00100000:0.0:1786002688.985128:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5236 00000100:00100000:0.0:1786002688.989742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002688.989828:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531048448 00000100:00100000:2.0:1786002688.989838:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531048448 00000100:00100000:2.0:1786002688.989966:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24230 00000100:00100000:2.0:1786002688.989976:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:22391:x1872758531048448:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:0.0:1786002688.991912:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968614 is committed 00010000:00010000:2.0:1786002688.992127:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af578417515 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.992139:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af578417515 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.992147:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af578417515 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.992153:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002688.992158:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af578417515 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.992166:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af578417515 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.992181:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xd873b914 (ffff9ed2456ae700) 00010000:00010000:2.0:1786002688.992184:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002688.992188:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af578417515 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002688.992194:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af578417515 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xd873b914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002688.998053:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:22391:x1872758531048448:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 8070us (8310us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002688.998073:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24230 00010000:00010000:3.0:1786002689.006222:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002689.007392:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.007481:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531048704 00000100:00100000:1.0:1786002689.007489:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531048704 00000100:00100000:1.0:1786002689.007559:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24231 00000100:00100000:1.0:1786002689.007568:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:22391:x1872758531048704:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002689.007587:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002689.007616:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af57841752a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b16d expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.007715:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417531 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.007741:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417531 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.007750:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417531 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.007761:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417538 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x233016a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.007767:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417538 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.007776:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417538 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002689.008108:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1786002689.008532:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af57841753f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008549:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af57841753f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008555:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af57841753f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008580:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417531 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008592:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417531 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008599:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417531 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008660:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417531 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008667:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002689.008671:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417531 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008678:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417531 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008694:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245644700) 00010000:00010000:1.0:1786002689.008717:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002689.008721:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417531 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008728:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417531 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002689.008740:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000995cd018 reply state 0000000093173217 transno 4294968615 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417538 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008750:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417538 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008756:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x233016a9 (ffff9ed245644200) 00010000:00010000:1.0:1786002689.008759:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002689.008761:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002689.008785:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af57841752a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b16d expref: 14 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008801:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af57841753f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b16d expref: 13 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.008808:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9ed245644a00) 00010000:00010000:1.0:1786002689.008812:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002689.008814:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed382166c00, rc 0) 00000100:00100000:1.0:1786002689.009094:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:22391:x1872758531048704:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1526us (1705us total) trans 4294968615 rc 0/0 00000100:00100000:1.0:1786002689.009102:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24231 00000100:00080000:0.0:1786002689.009300:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002689.024866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002689.024942:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531048960 00000100:00100000:2.0:1786002689.024953:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531048960 00000100:00100000:2.0:1786002689.025017:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5237 00000100:00100000:2.0:1786002689.025028:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:22391:x1872758531048960:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:2.0:1786002689.025426:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22391:x1872758531048960:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 399us (582us total) trans 4294968616 rc 0/0 00000100:00100000:2.0:1786002689.025435:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5237 00000100:00100000:2.0:1786002689.030926:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002689.031103:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531049088 00000100:00100000:0.0:1786002689.031112:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531049088 00000100:00100000:0.0:1786002689.031164:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24232 00000100:00100000:0.0:1786002689.031172:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22391:x1872758531049088:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:0.0:1786002689.033374:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968616 is committed 00010000:00010000:3.0:1786002689.033454:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417538 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.033466:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417538 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.033473:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417538 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.033480:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.033484:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417538 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.033491:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417538 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.033506:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x233016a9 (ffff9ed245644200) 00010000:00010000:3.0:1786002689.033509:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.033514:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417538 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.033520:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417538 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x233016a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002689.033743:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:22391:x1872758531049088:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 2568us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002689.033752:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24232 00000100:00100000:1.0:1786002689.043346:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002689.043597:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531049344 00000100:00100000:2.0:1786002689.043758:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531049344 00000100:00100000:2.0:1786002689.043819:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24233 00000100:00100000:2.0:1786002689.043830:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:22391:x1872758531049344:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002689.043890:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002689.043911:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af57841754d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b174 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.044317:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417554 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.044342:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417554 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.044352:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417554 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.044389:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af57841755b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0xa88c5e99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.044399:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af57841755b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.044408:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af57841755b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002689.044901:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1786002689.046314:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af578417562 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.046329:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af578417562 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.046337:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af578417562 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.046372:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417554 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.046380:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417554 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.046385:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417554 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.046391:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417554 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.046396:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002689.046399:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417554 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.046404:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417554 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.046416:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456f9800) 00010000:00010000:2.0:1786002689.047129:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002689.047143:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417554 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.047159:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417554 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002689.047176:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043d2e1b4 reply state 00000000cf58337b transno 4294968617 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af57841755b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.047188:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af57841755b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.047195:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xa88c5e99 (ffff9ed2456f9700) 00010000:00010000:2.0:1786002689.047198:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002689.047201:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002689.047238:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af57841754d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b174 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.047254:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af578417562 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b174 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.047261:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9ed2456f9900) 00010000:00010000:2.0:1786002689.047263:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002689.047265:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3400, rc 0) 00000100:00100000:2.0:1786002689.047331:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22391:x1872758531049344:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 3504us (3992us total) trans 4294968617 rc 0/0 00000100:00100000:2.0:1786002689.047338:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24233 00000100:00100000:1.0:1786002689.059901:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002689.059995:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531049600 00000100:00100000:0.0:1786002689.060003:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531049600 00000100:00100000:0.0:1786002689.060053:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5238 00000100:00100000:0.0:1786002689.060062:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22391:x1872758531049600:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:0.0:1786002689.060315:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22391:x1872758531049600:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 254us (421us total) trans 4294968618 rc 0/0 00000100:00100000:0.0:1786002689.060322:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5238 00000100:00100000:3.0:1786002689.063197:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.063353:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531049728 00000100:00100000:1.0:1786002689.063361:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531049728 00000100:00100000:1.0:1786002689.063409:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24234 00000100:00100000:1.0:1786002689.063417:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22391:x1872758531049728:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:0.0:1786002689.065423:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968618 is committed 00010000:00010000:2.0:1786002689.065511:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af57841755b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.065523:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af57841755b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.065530:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af57841755b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.065535:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002689.065539:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af57841755b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.065546:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af57841755b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.065559:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xa88c5e99 (ffff9ed2456f9700) 00010000:00010000:2.0:1786002689.065562:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002689.065566:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af57841755b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.065570:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af57841755b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xa88c5e99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002689.078493:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:22391:x1872758531049728:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 15066us (15291us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002689.078505:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24234 00000100:00100000:1.0:1786002689.103478:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002689.103563:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531049984 00000100:00100000:0.0:1786002689.103572:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531049984 00000100:00100000:0.0:1786002689.103639:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24235 00000100:00100000:0.0:1786002689.103648:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:22391:x1872758531049984:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002689.103667:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002689.103687:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716c00/0x7cee4af578417570 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b17b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.103796:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417577 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.103820:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417577 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.103880:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417577 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.103923:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af57841757e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x24f3e3ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.103955:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af57841757e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.103961:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af57841757e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002689.104492:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1786002689.104603:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af578417585 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104613:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af578417585 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104620:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af578417585 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104743:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417577 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104751:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417577 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104758:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417577 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104764:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417577 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104770:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002689.104774:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417577 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104786:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417577 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104796:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ae300) 00010000:00010000:0.0:1786002689.104799:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002689.104803:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417577 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104810:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417577 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002689.104823:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f18cb126 reply state 00000000f237d192 transno 4294968619 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af57841757e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104833:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af57841757e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104839:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x24f3e3ee (ffff9ed2456ae800) 00010000:00010000:0.0:1786002689.104841:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002689.104844:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002689.104892:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716c00/0x7cee4af578417570 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b17b expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104927:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af578417585 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b17b expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.104934:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9ed2456aef00) 00010000:00010000:0.0:1786002689.104937:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002689.104939:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717a00, rc 0) 00000100:00100000:0.0:1786002689.106475:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22391:x1872758531049984:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2824us (3000us total) trans 4294968619 rc 0/0 00000100:00100000:0.0:1786002689.106484:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24235 00000100:00100000:0.0:1786002689.118800:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.118926:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531050240 00000100:00100000:3.0:1786002689.118935:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531050240 00000100:00100000:3.0:1786002689.118990:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5239 00000100:00100000:3.0:1786002689.118999:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22391:x1872758531050240:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:3.0:1786002689.119407:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:22391:x1872758531050240:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 409us (616us total) trans 4294968620 rc 0/0 00000100:00100000:3.0:1786002689.119415:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5239 00000100:00100000:3.0:1786002689.122998:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002689.123082:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531050368 00000100:00100000:2.0:1786002689.123089:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531050368 00000100:00100000:2.0:1786002689.123134:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24236 00000100:00100000:2.0:1786002689.123143:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:22391:x1872758531050368:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:0.0:1786002689.126118:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968620 is committed 00010000:00010000:3.0:1786002689.126269:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af57841757e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.126305:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af57841757e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.126317:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af57841757e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.126323:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.126327:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af57841757e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.126333:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af57841757e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.126347:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x24f3e3ee (ffff9ed2456ae800) 00010000:00010000:3.0:1786002689.126350:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.126354:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af57841757e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.126359:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af57841757e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x24f3e3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002689.126558:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:22391:x1872758531050368:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 3412us (3563us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002689.126567:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24236 00000100:00100000:1.0:1786002689.134953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.135377:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531050624 00000100:00100000:3.0:1786002689.135386:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531050624 00000100:00100000:3.0:1786002689.135440:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24237 00000100:00100000:3.0:1786002689.135449:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:22391:x1872758531050624:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002689.135468:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002689.135487:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417593 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b182 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.135593:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841759a lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.135617:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841759a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.135636:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841759a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.135650:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af5784175a1 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x3f283190 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.135658:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af5784175a1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.135665:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af5784175a1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002689.136000:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1786002689.136454:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82e00/0x7cee4af5784175a8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.136464:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82e00/0x7cee4af5784175a8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.136471:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82e00/0x7cee4af5784175a8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.136500:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841759a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.136507:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841759a lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.136512:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841759a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.136519:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841759a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.136525:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.136529:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841759a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.136536:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841759a lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.136546:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:3.0:1786002689.136549:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.136562:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841759a lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.136569:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841759a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002689.136581:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6d71a4e reply state 00000000cc759a4c transno 4294968621 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af5784175a1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.136589:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af5784175a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.136594:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x3f283190 (ffff9ed245735f00) 00010000:00010000:3.0:1786002689.136596:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002689.136598:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002689.137347:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417593 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b182 expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.137368:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82e00/0x7cee4af5784175a8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b182 expref: 16 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.137386:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9ed245735700) 00010000:00010000:3.0:1786002689.137388:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002689.137390:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82e00, rc 0) 00000100:00100000:3.0:1786002689.137449:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:22391:x1872758531050624:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2001us (2505us total) trans 4294968621 rc 0/0 00000100:00100000:3.0:1786002689.137456:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24237 00000100:00100000:1.0:1786002689.150160:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002689.150273:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531050880 00000100:00100000:2.0:1786002689.150282:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531050880 00000100:00100000:2.0:1786002689.150338:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5240 00000100:00100000:2.0:1786002689.150353:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:22391:x1872758531050880:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:2.0:1786002689.150595:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:22391:x1872758531050880:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 242us (451us total) trans 4294968622 rc 0/0 00000100:00100000:2.0:1786002689.150603:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5240 00000100:00100000:0.0:1786002689.156528:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.156805:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531051008 00000100:00100000:1.0:1786002689.156814:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531051008 00000100:00100000:1.0:1786002689.156892:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24238 00000100:00100000:1.0:1786002689.156901:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:22391:x1872758531051008:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002689.165333:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968622 is committed 00000100:00100000:1.0:1786002689.165826:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22391:x1872758531051008:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 8921us (9301us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002689.165838:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24238 00010000:00010000:0.0:1786002689.167968:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af5784175a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.167993:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af5784175a1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.168000:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af5784175a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.168005:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002689.168009:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af5784175a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.168015:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af5784175a1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.168029:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x3f283190 (ffff9ed245735f00) 00010000:00010000:0.0:1786002689.168034:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002689.168038:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af5784175a1 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.168043:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af5784175a1 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x3f283190 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002689.172772:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002689.173044:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531051264 00000100:00100000:2.0:1786002689.173053:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531051264 00000100:00100000:2.0:1786002689.173124:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24239 00000100:00100000:2.0:1786002689.173135:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22391:x1872758531051264:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002689.173168:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002689.173188:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784175b6 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b189 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.173282:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175bd lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.173319:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175bd lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.173329:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175bd lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.173340:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784175c4 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0xa000570f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.173346:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784175c4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.173352:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784175c4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002689.174733:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1786002689.174874:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784175cb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.174886:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784175cb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.174895:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784175cb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.174922:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175bd lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.174930:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175bd lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.174936:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175bd lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.174942:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175bd lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.174948:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002689.174952:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175bd lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.174959:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175bd lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.174973:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456f9700) 00010000:00010000:2.0:1786002689.174976:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002689.174981:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175bd lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.174988:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175bd lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002689.174999:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aba54e1d reply state 000000004281b725 transno 4294968623 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784175c4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.175009:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784175c4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.175015:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xa000570f (ffff9ed2456f9800) 00010000:00010000:2.0:1786002689.175018:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002689.175020:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002689.175043:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af5784175b6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b189 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.175061:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784175cb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b189 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.175078:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9ed2456f9200) 00010000:00010000:2.0:1786002689.175081:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002689.175083:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed2e00, rc 0) 00000100:00100000:2.0:1786002689.175139:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:22391:x1872758531051264:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2006us (2375us total) trans 4294968623 rc 0/0 00000100:00100000:2.0:1786002689.175146:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24239 00000100:00100000:2.0:1786002689.206621:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.206758:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531051520 00000100:00100000:3.0:1786002689.206768:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531051520 00000100:00100000:3.0:1786002689.206821:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5241 00000100:00100000:3.0:1786002689.206830:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:22391:x1872758531051520:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:3.0:1786002689.207146:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:22391:x1872758531051520:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 316us (542us total) trans 4294968624 rc 0/0 00000100:00100000:3.0:1786002689.207162:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5241 00000100:00100000:3.0:1786002689.219664:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.219878:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531051648 00000100:00100000:1.0:1786002689.219887:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531051648 00000100:00100000:1.0:1786002689.219942:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24240 00000100:00100000:1.0:1786002689.219950:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:22391:x1872758531051648:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002689.223752:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968624 is committed 00010000:00010000:3.0:1786002689.223827:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784175c4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.223870:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784175c4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.223878:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784175c4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.223884:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.223889:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784175c4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.223896:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784175c4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.223912:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xa000570f (ffff9ed2456f9800) 00010000:00010000:3.0:1786002689.223916:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.223921:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784175c4 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.223927:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784175c4 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xa000570f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002689.224126:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22391:x1872758531051648:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 4173us (4466us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002689.224135:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24240 00000100:00100000:1.0:1786002689.240143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002689.240248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531051904 00000100:00100000:0.0:1786002689.240257:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531051904 00000100:00100000:0.0:1786002689.240316:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24241 00000100:00100000:0.0:1786002689.240325:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22391:x1872758531051904:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002689.240343:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002689.240362:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af5784175d9 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b190 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.240448:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784175e0 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.240462:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784175e0 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.240470:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784175e0 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.240480:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af5784175e7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x9a2cdc4e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.240495:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af5784175e7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.240500:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af5784175e7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002689.240770:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x7:0x0], index 0: 0 00010000:00010000:0.0:1786002689.240925:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784175ee lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.240943:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784175ee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.240955:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784175ee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.240992:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784175e0 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.240999:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784175e0 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.241004:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784175e0 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.241009:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784175e0 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.241014:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002689.241017:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784175e0 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.241023:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784175e0 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.241033:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ae300) 00010000:00010000:0.0:1786002689.241056:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002689.241059:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784175e0 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.241065:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784175e0 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002689.241077:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbf6925c reply state 000000008eb3e029 transno 4294968625 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af5784175e7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.241087:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af5784175e7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.241093:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x9a2cdc4e (ffff9ed2456aec00) 00010000:00010000:0.0:1786002689.241095:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002689.241097:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002689.241119:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af5784175d9 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b190 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.241134:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784175ee lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b190 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.241162:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9ed2456ae200) 00010000:00010000:0.0:1786002689.241164:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002689.241166:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717400, rc 0) 00000100:00100000:0.0:1786002689.241212:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:22391:x1872758531051904:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 888us (1078us total) trans 4294968625 rc 0/0 00000100:00100000:0.0:1786002689.241218:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24241 00000100:00100000:2.0:1786002689.258236:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002689.258417:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531052160 00000100:00100000:0.0:1786002689.258427:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531052160 00000100:00100000:0.0:1786002689.258483:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5242 00000100:00100000:0.0:1786002689.258491:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:22391:x1872758531052160:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:0.0:1786002689.258739:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:22391:x1872758531052160:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 247us (509us total) trans 4294968626 rc 0/0 00000100:00100000:0.0:1786002689.258747:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5242 00000100:00100000:1.0:1786002689.278034:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002689.278146:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531052288 00000100:00100000:2.0:1786002689.278166:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531052288 00000100:00100000:2.0:1786002689.278230:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24242 00000100:00100000:2.0:1786002689.278242:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:22391:x1872758531052288:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:0.0:1786002689.280580:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968626 is committed 00000100:00100000:3.0:1786002689.280771:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:22391:x1872758531052288:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 2528us (2742us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002689.280783:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24242 00010000:00010000:2.0:1786002689.281785:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af5784175e7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.281798:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af5784175e7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.281806:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af5784175e7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.281813:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002689.281818:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af5784175e7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.281826:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af5784175e7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.281842:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x9a2cdc4e (ffff9ed2456aec00) 00010000:00010000:2.0:1786002689.281879:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002689.281885:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af5784175e7 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.281892:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716000/0x7cee4af5784175e7 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x9a2cdc4e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002689.295055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002689.295166:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531052544 00000100:00100000:2.0:1786002689.295176:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531052544 00000100:00100000:2.0:1786002689.295243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24243 00000100:00100000:2.0:1786002689.295254:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:22391:x1872758531052544:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002689.295275:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002689.295327:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175fc lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b197 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.295433:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417603 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.295446:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417603 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.295478:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417603 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.295494:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841760a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0xb3c1e899 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.295500:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841760a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.295508:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841760a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002689.295894:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x7:0x0], index 1: 0 00010000:00010000:2.0:1786002689.296037:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3000/0x7cee4af578417611 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296050:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3000/0x7cee4af578417611 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296058:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3000/0x7cee4af578417611 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296090:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417603 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296098:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417603 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296104:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417603 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296110:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417603 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296116:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002689.296120:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417603 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296127:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417603 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296139:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed243d0b700) 00010000:00010000:2.0:1786002689.296142:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002689.296146:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417603 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296152:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417603 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002689.296165:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4f7a78f reply state 000000008651e9b9 transno 4294968627 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841760a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296176:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841760a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296183:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xb3c1e899 (ffff9ed243d0b200) 00010000:00010000:2.0:1786002689.296185:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002689.296187:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002689.296216:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784175fc lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b197 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296234:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3000/0x7cee4af578417611 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b197 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.296241:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9ed243d0bd00) 00010000:00010000:2.0:1786002689.296244:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002689.296246:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3000, rc 0) 00000100:00100000:2.0:1786002689.296298:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:22391:x1872758531052544:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1046us (1253us total) trans 4294968627 rc 0/0 00000100:00100000:2.0:1786002689.296306:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24243 00000100:00100000:1.0:1786002689.320984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002689.321168:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531052800 00000100:00100000:2.0:1786002689.321178:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531052800 00000100:00100000:2.0:1786002689.321238:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5243 00000100:00100000:2.0:1786002689.321248:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:22391:x1872758531052800:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:2.0:1786002689.321685:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:22391:x1872758531052800:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 437us (720us total) trans 4294968628 rc 0/0 00000100:00100000:2.0:1786002689.321698:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5243 00000100:00100000:1.0:1786002689.324096:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.324198:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531052928 00000100:00100000:3.0:1786002689.324205:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531052928 00000100:00100000:3.0:1786002689.324256:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24244 00000100:00100000:3.0:1786002689.324265:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:22391:x1872758531052928:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002689.325800:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968628 is committed 00000100:00100000:1.0:1786002689.333767:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:22391:x1872758531052928:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 9494us (9667us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002689.333780:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24244 00010000:00010000:3.0:1786002689.337450:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841760a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.337466:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841760a lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.337474:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841760a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.337480:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed2200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.337484:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841760a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.337492:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841760a lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.337508:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xb3c1e899 (ffff9ed243d0b200) 00010000:00010000:3.0:1786002689.337511:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.337515:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841760a lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.337521:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841760a lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xb3c1e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002689.337634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.337818:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531053184 00000100:00100000:3.0:1786002689.337828:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531053184 00000100:00100000:3.0:1786002689.337980:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24245 00000100:00100000:3.0:1786002689.337992:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:22391:x1872758531053184:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002689.338011:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002689.338031:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af57841761f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b19e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338146:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417626 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338168:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417626 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338178:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417626 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338220:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af57841762d lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x5b3c1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338227:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af57841762d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338235:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af57841762d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002689.338741:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x8:0x0], index 0: 0 00010000:00010000:3.0:1786002689.338880:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af578417634 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338890:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af578417634 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338898:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af578417634 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338926:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417626 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338938:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417626 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338944:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417626 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338950:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417626 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338956:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.338959:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417626 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338975:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417626 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338984:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:3.0:1786002689.338986:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.338990:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417626 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.338996:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417626 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002689.339006:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a076fc5a reply state 000000003cc9f043 transno 4294968629 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af57841762d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.339016:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af57841762d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.339022:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x5b3c1a7 (ffff9ed245735900) 00010000:00010000:3.0:1786002689.339025:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002689.339027:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002689.339050:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af57841761f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b19e expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.339215:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af578417634 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b19e expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.339224:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9ed245735600) 00010000:00010000:3.0:1786002689.339227:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002689.339229:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82a00, rc 0) 00000100:00100000:3.0:1786002689.339360:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:22391:x1872758531053184:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1371us (1738us total) trans 4294968629 rc 0/0 00000100:00100000:3.0:1786002689.339368:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24245 00000100:00100000:2.0:1786002689.351196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.351264:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531053440 00000100:00100000:3.0:1786002689.351274:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531053440 00000100:00100000:3.0:1786002689.351326:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5244 00000100:00100000:3.0:1786002689.351337:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:22391:x1872758531053440:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:3.0:1786002689.351605:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:22391:x1872758531053440:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 269us (417us total) trans 4294968630 rc 0/0 00000100:00100000:3.0:1786002689.351614:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5244 00000100:00100000:0.0:1786002689.353463:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.353532:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531053568 00000100:00100000:1.0:1786002689.353538:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531053568 00000100:00100000:1.0:1786002689.353578:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24246 00000100:00100000:1.0:1786002689.353586:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:22391:x1872758531053568:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002689.362741:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968630 is committed 00010000:00010000:0.0:1786002689.362875:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af57841762d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.362896:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af57841762d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.362903:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af57841762d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.362910:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002689.362914:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af57841762d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.362922:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af57841762d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.362938:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x5b3c1a7 (ffff9ed245735900) 00010000:00010000:0.0:1786002689.362941:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002689.362945:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af57841762d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.362951:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af57841762d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x5b3c1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002689.364959:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:22391:x1872758531053568:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 11367us (11494us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002689.364979:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24246 00000100:00100000:1.0:1786002689.385058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.385178:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531053824 00000100:00100000:3.0:1786002689.385187:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531053824 00000100:00100000:3.0:1786002689.385241:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24247 00000100:00100000:3.0:1786002689.385424:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:22391:x1872758531053824:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002689.385443:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002689.385463:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417642 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1a5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.385554:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417649 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.385567:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417649 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.385577:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417649 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.385638:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af578417650 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x72a5df42 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.385653:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af578417650 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.385661:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af578417650 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002689.385990:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x8:0x0], index 1: 0 00010000:00010000:3.0:1786002689.386103:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82600/0x7cee4af578417657 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.386112:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82600/0x7cee4af578417657 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.386119:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82600/0x7cee4af578417657 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.386145:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417649 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.386157:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417649 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.386163:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417649 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.386170:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417649 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.386176:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.386180:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417649 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.386187:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417649 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.386197:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:3.0:1786002689.386200:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.386204:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417649 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.386211:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af578417649 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002689.386223:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005594abba reply state 00000000390950cf transno 4294968631 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af578417650 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.386233:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af578417650 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.386239:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x72a5df42 (ffff9ed245735b00) 00010000:00010000:3.0:1786002689.386241:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002689.386257:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002689.386279:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417642 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1a5 expref: 22 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.389220:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82600/0x7cee4af578417657 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1a5 expref: 21 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.389468:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9ed245735500) 00010000:00010000:3.0:1786002689.389472:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002689.389477:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82600, rc 0) 00000100:00100000:3.0:1786002689.389552:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:22391:x1872758531053824:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 4130us (4501us total) trans 4294968631 rc 0/0 00000100:00100000:1.0:1786002689.394130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.394164:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531054080 00000100:00100000:1.0:1786002689.394173:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531054080 00000100:00100000:1.0:1786002689.394224:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5245 00000100:00100000:1.0:1786002689.394235:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:22391:x1872758531054080:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:1.0:1786002689.394535:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:22391:x1872758531054080:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 301us (411us total) trans 4294968632 rc 0/0 00000100:00100000:1.0:1786002689.394548:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5245 00000100:00100000:3.0:1786002689.402530:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24247 00000100:00100000:0.0:1786002689.403096:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.404141:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531054208 00000100:00100000:3.0:1786002689.404150:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531054208 00000100:00100000:3.0:1786002689.404189:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24248 00000100:00100000:3.0:1786002689.404197:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:22391:x1872758531054208:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:1.0:1786002689.414815:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968632 is committed 00010000:00010000:3.0:1786002689.414967:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af578417650 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.414981:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af578417650 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.414990:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af578417650 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.414997:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.415001:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af578417650 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.415011:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af578417650 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.415029:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x72a5df42 (ffff9ed245735b00) 00010000:00010000:3.0:1786002689.415032:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.415037:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af578417650 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.415043:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af578417650 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x72a5df42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002689.415328:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:22391:x1872758531054208:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 11123us (12225us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002689.415340:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24248 00000100:00100000:0.0:1786002689.422993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002689.431014:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531054464 00000100:00100000:2.0:1786002689.431032:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531054464 00000100:00100000:2.0:1786002689.431135:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24249 00000100:00100000:2.0:1786002689.431149:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:22391:x1872758531054464:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002689.431174:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002689.431201:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3200/0x7cee4af578417665 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1ac expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.431324:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af57841766c lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.431340:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af57841766c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.431352:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af57841766c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.431398:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417673 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0xa14d934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.431408:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417673 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.431418:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417673 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002689.431831:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x9:0x0], index 0: 0 00010000:00010000:2.0:1786002689.432075:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841767a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432086:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841767a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432096:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841767a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432137:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af57841766c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432146:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af57841766c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432153:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af57841766c lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432160:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af57841766c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432166:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002689.432171:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af57841766c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432178:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af57841766c lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432196:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456f9700) 00010000:00010000:2.0:1786002689.432200:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002689.432205:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af57841766c lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432212:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af57841766c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002689.432228:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2c394c3 reply state 000000007931a1b2 transno 4294968633 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417673 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432239:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417673 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432247:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xa14d934 (ffff9ed2456f9b00) 00010000:00010000:2.0:1786002689.432249:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002689.432252:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002689.432289:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3200/0x7cee4af578417665 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1ac expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432314:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841767a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1ac expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.432324:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1af:0x0].0x0 (ffff9ed2456f9100) 00010000:00010000:2.0:1786002689.432326:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002689.432329:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed2200, rc 0) 00000100:00100000:2.0:1786002689.432425:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:22391:x1872758531054464:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1277us (9439us total) trans 4294968633 rc 0/0 00000100:00100000:2.0:1786002689.432434:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24249 00000100:00100000:1.0:1786002689.437815:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.438141:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531054720 00000100:00100000:3.0:1786002689.438155:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531054720 00000100:00100000:3.0:1786002689.438268:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5246 00000100:00100000:3.0:1786002689.438287:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:22391:x1872758531054720:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:3.0:1786002689.438786:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:22391:x1872758531054720:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 501us (983us total) trans 4294968634 rc 0/0 00000100:00100000:3.0:1786002689.438797:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5246 00000100:00100000:3.0:1786002689.443079:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.443172:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531054848 00000100:00100000:1.0:1786002689.443182:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531054848 00000100:00100000:1.0:1786002689.443240:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24250 00000100:00100000:1.0:1786002689.443258:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:22391:x1872758531054848:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002689.451023:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968634 is committed 00010000:00010000:0.0:1786002689.451120:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417673 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.451134:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417673 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.451142:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417673 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.451148:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ed3e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002689.451153:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417673 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.451161:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417673 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.451177:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xa14d934 (ffff9ed2456f9b00) 00010000:00010000:0.0:1786002689.451180:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002689.451184:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417673 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.451190:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417673 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xa14d934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002689.451512:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:22391:x1872758531054848:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 8250us (8437us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002689.451523:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24250 00000100:00100000:0.0:1786002689.462235:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002689.462724:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531055104 00000100:00100000:2.0:1786002689.462733:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531055104 00000100:00100000:2.0:1786002689.462790:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24251 00000100:00100000:2.0:1786002689.462799:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:22391:x1872758531055104:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:2.0:1786002689.462818:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002689.462839:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af578417688 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1b3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.467680:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841768f lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.467700:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841768f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.467711:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841768f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.467726:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417696 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0xc0330bcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.467733:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417696 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.467740:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417696 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002689.468049:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x9:0x0], index 1: 0 00010000:00010000:3.0:1786002689.468167:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841769d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468176:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841769d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468183:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841769d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468210:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841768f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468218:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841768f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468224:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841768f lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468231:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841768f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468238:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.468242:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841768f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468253:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841768f lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468263:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed243d0bf00) 00010000:00010000:3.0:1786002689.468266:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.468270:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841768f lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468277:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841768f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002689.468288:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0853fb7 reply state 000000003c4302fd transno 4294968635 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417696 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468298:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417696 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468304:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xc0330bcf (ffff9ed245735b00) 00010000:00010000:3.0:1786002689.468307:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002689.468309:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002689.468338:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3a00/0x7cee4af578417688 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1b3 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468354:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841769d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1b3 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.468361:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b0:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:3.0:1786002689.468363:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002689.468365:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83400, rc 0) 00000100:00100000:3.0:1786002689.468420:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:22391:x1872758531055104:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 5622us (6192us total) trans 4294968635 rc 0/0 00000100:00100000:3.0:1786002689.468428:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24251 00000100:00100000:0.0:1786002689.473700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.473818:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531055360 00000100:00100000:1.0:1786002689.473827:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531055360 00000100:00100000:1.0:1786002689.473902:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5247 00000100:00100000:1.0:1786002689.473912:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:22391:x1872758531055360:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:1.0:1786002689.474153:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:22391:x1872758531055360:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 242us (461us total) trans 4294968636 rc 0/0 00000100:00100000:1.0:1786002689.474160:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5247 00000100:00100000:0.0:1786002689.479337:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.479402:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531055488 00000100:00100000:1.0:1786002689.479412:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531055488 00000100:00100000:1.0:1786002689.479466:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24252 00000100:00100000:1.0:1786002689.479475:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:22391:x1872758531055488:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002689.482027:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968636 is committed 00010000:00010000:3.0:1786002689.482103:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417696 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.482116:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417696 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.482123:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417696 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.482130:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.482135:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417696 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.482142:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417696 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.482165:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xc0330bcf (ffff9ed245735b00) 00010000:00010000:3.0:1786002689.482168:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.482172:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417696 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.482179:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417696 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xc0330bcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002689.484220:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:22391:x1872758531055488:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 4737us (4882us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002689.484230:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24252 00000100:00100000:0.0:1786002689.497907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.497967:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531055744 00000100:00100000:1.0:1786002689.497977:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531055744 00000100:00100000:1.0:1786002689.498038:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24253 00000100:00100000:1.0:1786002689.498049:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:22391:x1872758531055744:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002689.498067:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002689.498086:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af5784176ab lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1ba expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498179:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176b2 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498192:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176b2 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498202:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176b2 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498214:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af5784176b9 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x5be36ea4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498220:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af5784176b9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498226:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af5784176b9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002689.498767:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa:0x0], index 0: 0 00010000:00010000:1.0:1786002689.498907:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999000/0x7cee4af5784176c0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498917:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999000/0x7cee4af5784176c0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498925:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999000/0x7cee4af5784176c0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498953:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176b2 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498960:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176b2 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498967:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176b2 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498972:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176b2 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498977:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002689.498981:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176b2 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498988:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176b2 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.498999:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245644300) 00010000:00010000:1.0:1786002689.499002:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002689.499954:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176b2 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.499965:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176b2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002689.499979:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b66c774 reply state 0000000072f5a83e transno 4294968637 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af5784176b9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.499990:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af5784176b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.499996:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x5be36ea4 (ffff9ed245644e00) 00010000:00010000:1.0:1786002689.499998:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002689.500001:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002689.500076:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af5784176ab lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1ba expref: 25 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.500093:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999000/0x7cee4af5784176c0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1ba expref: 24 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.500100:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b1:0x0].0x0 (ffff9ed245644900) 00010000:00010000:1.0:1786002689.500103:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002689.500105:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999000, rc 0) 00000100:00100000:1.0:1786002689.500164:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:22391:x1872758531055744:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 2116us (2263us total) trans 4294968637 rc 0/0 00000100:00100000:1.0:1786002689.500172:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24253 00000100:00100000:0.0:1786002689.509789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.512237:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531056000 00000100:00100000:1.0:1786002689.512259:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531056000 00000100:00100000:1.0:1786002689.512319:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5248 00000100:00100000:1.0:1786002689.512329:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:22391:x1872758531056000:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:1.0:1786002689.512594:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:22391:x1872758531056000:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 266us (2814us total) trans 4294968638 rc 0/0 00000100:00100000:1.0:1786002689.512602:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5248 00000100:00100000:0.0:1786002689.517516:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.517642:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531056128 00000100:00100000:3.0:1786002689.517651:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531056128 00000100:00100000:3.0:1786002689.517705:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24254 00000100:00100000:3.0:1786002689.517714:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:22391:x1872758531056128:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002689.524488:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968638 is committed 00010000:00010000:0.0:1786002689.524557:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af5784176b9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.524575:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af5784176b9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.524582:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af5784176b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.524588:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002689.524592:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af5784176b9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.524600:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af5784176b9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.524614:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x5be36ea4 (ffff9ed245644e00) 00010000:00010000:0.0:1786002689.524617:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002689.524621:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af5784176b9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.524638:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af5784176b9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x5be36ea4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002689.525256:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:22391:x1872758531056128:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 7538us (7744us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002689.525266:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24254 00000100:00100000:0.0:1786002689.534343:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.534439:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531056384 00000100:00100000:1.0:1786002689.534448:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531056384 00000100:00100000:1.0:1786002689.534508:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24255 00000100:00100000:1.0:1786002689.534517:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:22391:x1872758531056384:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:1.0:1786002689.534535:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002689.534553:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af5784176ce lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1c1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.534654:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176d5 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.534667:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176d5 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.534678:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176d5 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.534722:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784176dc lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x13f7213f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.534730:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784176dc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.534737:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784176dc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786002689.535039:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa:0x0], index 1: 0 00010000:00010000:1.0:1786002689.535424:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999a00/0x7cee4af5784176e3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535435:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999a00/0x7cee4af5784176e3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535448:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999a00/0x7cee4af5784176e3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535474:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176d5 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535481:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176d5 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535487:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176d5 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535494:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176d5 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535500:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002689.535504:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176d5 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535511:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176d5 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535522:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245644300) 00010000:00010000:1.0:1786002689.535524:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002689.535528:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176d5 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535535:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af5784176d5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786002689.535545:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa29f35d reply state 00000000e258ef02 transno 4294968639 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784176dc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535556:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784176dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535562:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x13f7213f (ffff9ed245644b00) 00010000:00010000:1.0:1786002689.535565:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002689.535567:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786002689.535589:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af5784176ce lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1c1 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535605:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999a00/0x7cee4af5784176e3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1c1 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.535613:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b2:0x0].0x0 (ffff9ed245644200) 00010000:00010000:1.0:1786002689.535615:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002689.535617:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999a00, rc 0) 00000100:00100000:1.0:1786002689.535734:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:22391:x1872758531056384:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1217us (1397us total) trans 4294968639 rc 0/0 00000100:00100000:1.0:1786002689.535741:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24255 00000100:00100000:3.0:1786002689.550350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.554096:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531056640 00000100:00100000:1.0:1786002689.554109:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531056640 00000100:00100000:1.0:1786002689.556196:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5249 00000100:00100000:1.0:1786002689.556206:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:22391:x1872758531056640:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:1.0:1786002689.556475:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:22391:x1872758531056640:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 269us (6182us total) trans 4294968640 rc 0/0 00000100:00100000:1.0:1786002689.556483:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5249 00000100:00100000:3.0:1786002689.558914:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.559072:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531056768 00000100:00100000:1.0:1786002689.559081:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531056768 00000100:00100000:1.0:1786002689.559128:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24256 00000100:00100000:1.0:1786002689.559136:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:22391:x1872758531056768:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002689.561701:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968640 is committed 00000100:00100000:1.0:1786002689.561868:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:22391:x1872758531056768:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 2729us (2958us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002689.561878:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24256 00010000:00010000:3.0:1786002689.561942:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784176dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.561953:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784176dc lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.561968:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784176dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.561975:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244998400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.561979:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784176dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.561987:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784176dc lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.562001:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x13f7213f (ffff9ed245644b00) 00010000:00010000:3.0:1786002689.562005:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.562009:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784176dc lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.562015:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784176dc lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x13f7213f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002689.574649:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.574879:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531057024 00000100:00100000:3.0:1786002689.574889:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531057024 00000100:00100000:3.0:1786002689.574948:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24257 00000100:00100000:3.0:1786002689.574958:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:22391:x1872758531057024:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002689.574975:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002689.574996:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af5784176f1 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1c8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575101:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784176f8 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575113:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784176f8 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575128:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784176f8 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575140:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af5784176ff lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x4a6b5b31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575154:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af5784176ff lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575161:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af5784176ff lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002689.575710:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xb:0x0], index 0: 0 00010000:00010000:3.0:1786002689.575891:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83a00/0x7cee4af578417706 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575901:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83a00/0x7cee4af578417706 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575914:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83a00/0x7cee4af578417706 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575949:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784176f8 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575956:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784176f8 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575963:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784176f8 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575969:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784176f8 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575975:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.575979:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784176f8 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575986:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784176f8 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.575998:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245735b00) 00010000:00010000:3.0:1786002689.576001:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.576005:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784176f8 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.576011:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784176f8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002689.576024:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f65fdab8 reply state 0000000092f31584 transno 4294968641 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af5784176ff lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.576035:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af5784176ff lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.576041:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x4a6b5b31 (ffff9ed245735e00) 00010000:00010000:3.0:1786002689.576044:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002689.576046:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002689.576140:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af5784176f1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1c8 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.576274:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83a00/0x7cee4af578417706 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1c8 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.576281:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b3:0x0].0x0 (ffff9ed245735200) 00010000:00010000:3.0:1786002689.576283:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002689.576285:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83a00, rc 0) 00000100:00100000:3.0:1786002689.576387:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:22391:x1872758531057024:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1430us (1748us total) trans 4294968641 rc 0/0 00000100:00100000:3.0:1786002689.576394:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24257 00000100:00100000:2.0:1786002689.592978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.593103:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531057280 00000100:00100000:1.0:1786002689.593116:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531057280 00000100:00100000:1.0:1786002689.593191:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5250 00000100:00100000:1.0:1786002689.593202:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:22391:x1872758531057280:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:1.0:1786002689.593784:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:22391:x1872758531057280:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 583us (826us total) trans 4294968642 rc 0/0 00000100:00100000:1.0:1786002689.593792:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5250 00000100:00100000:3.0:1786002689.619323:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002689.620242:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531057408 00000100:00100000:2.0:1786002689.620251:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531057408 00000100:00100000:2.0:1786002689.620314:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24258 00000100:00100000:2.0:1786002689.620323:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:22391:x1872758531057408:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:1.0:1786002689.622270:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968642 is committed 00010000:00010000:2.0:1786002689.623083:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af5784176ff lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.623094:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af5784176ff lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.623100:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af5784176ff lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.623106:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002689.623110:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af5784176ff lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.623117:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af5784176ff lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.623132:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x4a6b5b31 (ffff9ed245735e00) 00010000:00010000:2.0:1786002689.623135:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002689.623139:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af5784176ff lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002689.623143:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af5784176ff lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x4a6b5b31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002689.623659:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:22391:x1872758531057408:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 3334us (4341us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002689.623667:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24258 00000100:00100000:2.0:1786002689.632032:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.632210:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531057664 00000100:00100000:3.0:1786002689.632232:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531057664 00000100:00100000:3.0:1786002689.632290:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24259 00000100:00100000:3.0:1786002689.632312:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+25:22391:x1872758531057664:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:3.0:1786002689.632330:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002689.632355:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417714 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1cf expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.632468:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841771b lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.632480:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841771b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.632710:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841771b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.632753:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417722 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0xa8a8d8e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.632761:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417722 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.632768:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417722 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786002689.633411:0:10360:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xb:0x0], index 1: 0 00010000:00010000:3.0:1786002689.633636:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83800/0x7cee4af578417729 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633647:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83800/0x7cee4af578417729 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633655:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83800/0x7cee4af578417729 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633694:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841771b lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633706:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841771b lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633758:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841771b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633767:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841771b lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633774:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f82c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002689.633779:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841771b lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633791:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841771b lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633805:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245735b00) 00010000:00010000:3.0:1786002689.633808:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002689.633812:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841771b lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633824:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af57841771b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002689.633836:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054b81079 reply state 000000002fc50268 transno 4294968643 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417722 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633866:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417722 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633873:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xa8a8d8e4 (ffff9ed245735a00) 00010000:00010000:3.0:1786002689.633876:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002689.633878:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002689.633915:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82400/0x7cee4af578417714 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1cf expref: 28 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633940:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83800/0x7cee4af578417729 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1cf expref: 27 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.633948:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b4:0x0].0x0 (ffff9ed245735400) 00010000:00010000:3.0:1786002689.633950:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002689.633957:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83800, rc 0) 00000100:00100000:3.0:1786002689.634188:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:22391:x1872758531057664:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1876us (2159us total) trans 4294968643 rc 0/0 00000100:00100000:3.0:1786002689.634202:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24259 00000100:00100000:3.0:1786002689.652810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002689.653003:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531057920 00000100:00100000:0.0:1786002689.653013:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531057920 00000100:00100000:0.0:1786002689.653071:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5251 00000100:00100000:0.0:1786002689.653080:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:22391:x1872758531057920:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:0.0:1786002689.653446:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:22391:x1872758531057920:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 344us (621us total) trans 4294968644 rc 0/0 00000100:00100000:0.0:1786002689.653459:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5251 00000100:00100000:0.0:1786002689.666132:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.666315:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531058048 00000100:00100000:3.0:1786002689.666324:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531058048 00000100:00100000:3.0:1786002689.666385:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24260 00000100:00100000:3.0:1786002689.666394:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:22391:x1872758531058048:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002689.682671:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968644 is committed 00010000:00010000:0.0:1786002689.682749:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417722 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.682762:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417722 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.682770:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417722 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.682777:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245f83e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002689.682781:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417722 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.682788:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417722 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.682804:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xa8a8d8e4 (ffff9ed245735a00) 00010000:00010000:0.0:1786002689.682807:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002689.682811:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417722 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.682818:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417722 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xa8a8d8e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002689.684197:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:22391:x1872758531058048:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 17797us (18066us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002689.684209:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24260 00000100:00100000:2.0:1786002689.701116:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002689.701479:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531058304 00000100:00100000:0.0:1786002689.701489:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531058304 00000100:00100000:0.0:1786002689.701551:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24261 00000100:00100000:0.0:1786002689.701560:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+26:22391:x1872758531058304:12345-192.168.203.49@tcp:101:createmany.0 00010000:00010000:0.0:1786002689.701579:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002689.701606:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717800/0x7cee4af578417737 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1d6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.701706:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841773e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.701719:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841773e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.701728:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841773e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.701770:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717e00/0x7cee4af578417745 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0xff13bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.701776:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717e00/0x7cee4af578417745 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.701782:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717e00/0x7cee4af578417745 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786002689.702127:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xc:0x0], index 0: 0 00010000:00010000:0.0:1786002689.702470:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716800/0x7cee4af57841774c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702479:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716800/0x7cee4af57841774c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702486:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716800/0x7cee4af57841774c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702514:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841773e lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702520:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841773e lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702544:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841773e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702549:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841773e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702556:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002689.702560:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841773e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702567:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841773e lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702576:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ae700) 00010000:00010000:0.0:1786002689.702579:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002689.702582:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841773e lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702588:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841773e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786002689.702598:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c43fc67 reply state 000000004fa9ae73 transno 4294968645 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717e00/0x7cee4af578417745 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702606:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717e00/0x7cee4af578417745 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702612:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xff13bf8 (ffff9ed2456ae800) 00010000:00010000:0.0:1786002689.702614:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002689.702616:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786002689.702650:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717800/0x7cee4af578417737 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1d6 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702666:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716800/0x7cee4af57841774c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1d6 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.702672:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b5:0x0].0x0 (ffff9ed2456aee00) 00010000:00010000:0.0:1786002689.702674:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002689.702676:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245716800, rc 0) 00000100:00100000:0.0:1786002689.702816:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:22391:x1872758531058304:12345-192.168.203.49@tcp:101:createmany.0 Request processed in 1256us (1709us total) trans 4294968645 rc 0/0 00000100:00100000:0.0:1786002689.702822:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24261 00000100:00100000:2.0:1786002689.717504:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002689.717587:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531058560 00000100:00100000:0.0:1786002689.717596:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531058560 00000100:00100000:0.0:1786002689.717655:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5252 00000100:00100000:0.0:1786002689.717664:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:22391:x1872758531058560:12345-192.168.203.49@tcp:35:createmany.0 00000100:00100000:0.0:1786002689.717936:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:22391:x1872758531058560:12345-192.168.203.49@tcp:35:createmany.0 Request processed in 272us (439us total) trans 4294968646 rc 0/0 00000100:00100000:0.0:1786002689.717943:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5252 00000100:00100000:0.0:1786002689.725749:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.726276:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531058688 00000100:00100000:3.0:1786002689.726286:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531058688 00000100:00100000:3.0:1786002689.726340:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24262 00000100:00100000:3.0:1786002689.726366:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+30:22391:x1872758531058688:12345-192.168.203.49@tcp:44:createmany.0 00000001:00080000:2.0:1786002689.728828:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968646 is committed 00000100:00100000:1.0:1786002689.729086:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:22391:x1872758531058688:12345-192.168.203.49@tcp:44:createmany.0 Request processed in 2733us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002689.729096:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24262 00010000:00010000:0.0:1786002689.730078:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717e00/0x7cee4af578417745 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.730095:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717e00/0x7cee4af578417745 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.730102:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717e00/0x7cee4af578417745 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.730107:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002689.730112:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717e00/0x7cee4af578417745 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.730119:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717e00/0x7cee4af578417745 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.730135:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xff13bf8 (ffff9ed2456ae800) 00010000:00010000:0.0:1786002689.730138:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002689.730148:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717e00/0x7cee4af578417745 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.730155:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717e00/0x7cee4af578417745 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xff13bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002689.866348:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.866436:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531058944 00000100:00100000:1.0:1786002689.866445:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531058944 00000100:00100000:1.0:1786002689.866507:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24263 00000100:00100000:1.0:1786002689.866517:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+27:22233:x1872758531058944:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002689.866535:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002689.866556:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af57841775a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1dd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.866663:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af578417761 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.866677:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af578417761 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.866690:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af578417761 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002689.866700:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a2:0x0]: returning size 0 00010000:00010000:1.0:1786002689.866797:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af57841775a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1dd expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.866819:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af578417761 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1dd expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.866828:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9ed245644c00) 00010000:00010000:1.0:1786002689.866831:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002689.866834:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999c00, rc 0) 00000100:00100000:1.0:1786002689.866928:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:22233:x1872758531058944:12345-192.168.203.49@tcp:101:bash.0 Request processed in 412us (589us total) trans 4294968647 rc 0/0 00000100:00100000:1.0:1786002689.866935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24263 00000100:00100000:2.0:1786002689.871490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002689.871600:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531059072 00000100:00100000:3.0:1786002689.871609:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531059072 00000100:00100000:3.0:1786002689.871669:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1524 00000100:00100000:3.0:1786002689.871678:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:2410:x1872758531059072:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002689.871693:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002689.871714:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999c00/0x7cee4af578417761 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1dd expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002689.871730:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9ed245644c00) 00010000:00010000:3.0:1786002689.871734:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002689.871781:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:2410:x1872758531059072:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 104us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002689.871788:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1524 00000100:00100000:2.0:1786002689.875387:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002689.875460:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531059200 00000100:00100000:0.0:1786002689.875468:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531059200 00000100:00100000:0.0:1786002689.875535:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5353 00000100:00100000:0.0:1786002689.875544:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:22233:x1872758531059200:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002689.875559:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002689.875576:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af57841776f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1e4 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002689.875603:0:14665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002689.875631:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:0.0:1786002689.875636:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002689.875643:0:14665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af57841776f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1e4 expref: 7 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.875660:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7d185ad/0x7cee4af57841776f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1e4 expref: 7 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.875672:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717e00, rc 0) 00000100:00100000:0.0:1786002689.875721:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:22233:x1872758531059200:12345-192.168.203.49@tcp:101:bash.0 Request processed in 178us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002689.875728:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5353 00000100:00080000:1.0:1786002689.875787:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002689.888278:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002689.888437:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531059328 00000100:00100000:0.0:1786002689.888445:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531059328 00000100:00100000:0.0:1786002689.888507:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24264 00000100:00100000:0.0:1786002689.888516:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+28:22233:x1872758531059328:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002689.888536:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002689.888553:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717800/0x7cee4af578417776 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1eb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.888585:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841777d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.888597:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841777d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.888609:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841777d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.888715:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717800/0x7cee4af578417776 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1eb expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.888731:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716400/0x7cee4af57841777d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1eb expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.888740:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9ed245644c00) 00010000:00010000:0.0:1786002689.888743:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786002689.888746:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245716400, rc 0) 00000100:00100000:0.0:1786002689.888797:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:22233:x1872758531059328:12345-192.168.203.49@tcp:101:bash.0 Request processed in 282us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002689.888804:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24264 00000100:00100000:0.0:1786002689.898386:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786002689.898412:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37137c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561084928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1786002689.898491:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002689.903393:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561084928 00000100:00100000:1.0:1786002689.903406:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561084928 00000100:00100000:1.0:1786002689.903468:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4163 00000100:00100000:1.0:1786002689.903477:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561084928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1786002689.903512:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445036032 avail 1298796544 00000100:00100000:1.0:1786002689.903591:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561084928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (5099us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002689.903598:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4163 00000100:00100000:0.0:1786002689.903693:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37137c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561084928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786002689.919930:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.922536:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531059456 00000100:00100000:1.0:1786002689.922548:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531059456 00002000:00100000:1.0:1786002689.927588:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2:0x0] (0->5) req@ffff9ed2455fd500 x1872758531059456/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:370/0 lens 496/0 e 0 to 0 dl 1786002700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002689.927602:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455fd500 with x1872758531059456 ext(0->5) 00002000:00010000:1.0:1786002689.927609:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455fd500 00000100:00100000:1.0:1786002689.927667:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 42 00000100:00100000:1.0:1786002689.927697:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531059456:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:1.0:1786002689.928563:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2410:x1872758531059456:12345-192.168.203.49@tcp:4:bash.0 Request processed in 883us (8637us total) trans 4294969952 rc 0/0 00000100:00100000:1.0:1786002689.928572:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 42 00002000:00100000:1.0:1786002689.928579:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x2:0x0] (0->5) req@ffff9ed2455fd500 x1872758531059456/t4294969952(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:370/0 lens 496/448 e 0 to 0 dl 1786002700 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002689.928589:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455fd500 with x1872758531059456 ext(0->5) 00002000:00010000:1.0:1786002689.928592:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455fd500 00000100:00100000:2.0:1786002689.938584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002689.944276:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531059584 00000100:00100000:0.0:1786002689.944292:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531059584 00000100:00100000:0.0:1786002689.944362:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5354 00000100:00100000:0.0:1786002689.944373:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2411:x1872758531059584:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002689.968889:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969952 is committed 00000100:00100000:2.0:1786002689.969150:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2411:x1872758531059584:12345-192.168.203.49@tcp:16:bash.0 Request processed in 24773us (30568us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002689.969161:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5354 00000100:00100000:2.0:1786002689.977049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.977148:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531059840 00000100:00100000:1.0:1786002689.977157:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531059840 00000100:00100000:1.0:1786002689.977211:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5253 00000100:00100000:1.0:1786002689.977222:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+29:22233:x1872758531059840:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:1.0:1786002689.977444:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968648 00000100:00100000:1.0:1786002689.977560:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:22233:x1872758531059840:12345-192.168.203.49@tcp:35:bash.0 Request processed in 340us (521us total) trans 4294968649 rc 0/0 00000100:00100000:1.0:1786002689.977568:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5253 00000020:00080000:1.0:1786002689.977572:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002689.990487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002689.990588:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531060096 00000100:00100000:1.0:1786002689.990598:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531060096 00000100:00100000:1.0:1786002689.990674:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24265 00000100:00100000:1.0:1786002689.990684:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+31:22233:x1872758531060096:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002689.990707:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002689.990729:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af578417784 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1f2 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.990887:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998c00/0x7cee4af57841778b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.990901:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998c00/0x7cee4af57841778b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.990913:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998c00/0x7cee4af57841778b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002689.990923:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a3:0x0]: returning size 0 00010000:00010000:1.0:1786002689.991037:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af578417784 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1f2 expref: 34 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.991060:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998c00/0x7cee4af57841778b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1f2 expref: 33 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002689.991068:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9ed245644600) 00010000:00010000:1.0:1786002689.991072:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002689.991075:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998c00, rc 0) 00000100:00100000:1.0:1786002689.991128:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:22233:x1872758531060096:12345-192.168.203.49@tcp:101:bash.0 Request processed in 445us (650us total) trans 4294968650 rc 0/0 00000100:00100000:1.0:1786002689.991135:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24265 00000100:00100000:2.0:1786002689.997942:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002689.999782:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531060224 00000100:00100000:0.0:1786002689.999795:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531060224 00000100:00100000:0.0:1786002689.999902:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1525 00000100:00100000:0.0:1786002689.999914:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:2410:x1872758531060224:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002689.999929:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002689.999954:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998c00/0x7cee4af57841778b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1f2 expref: 33 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002689.999986:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9ed245644600) 00010000:00010000:0.0:1786002689.999990:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002690.000047:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:2410:x1872758531060224:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 136us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.000055:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1525 00000100:00100000:0.0:1786002690.007809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.007893:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531060352 00000100:00100000:1.0:1786002690.007902:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531060352 00000100:00100000:1.0:1786002690.007960:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5355 00000100:00100000:1.0:1786002690.007969:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+6:22233:x1872758531060352:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002690.007984:0:14691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002690.008002:0:14691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578417799 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b1f9 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002690.008023:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002690.008043:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:1.0:1786002690.008047:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002690.008053:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578417799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1f9 expref: 7 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.008068:0:14691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004dc4a0ba/0x7cee4af578417799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1f9 expref: 7 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.008079:0:14691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998000, rc 0) 00000100:00100000:1.0:1786002690.008133:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:22233:x1872758531060352:12345-192.168.203.49@tcp:101:bash.0 Request processed in 166us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002690.008139:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5355 00000100:00080000:0.0:1786002690.008482:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786002690.026991:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002690.088978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.089080:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531060480 00000100:00100000:0.0:1786002690.089090:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531060480 00000100:00100000:0.0:1786002690.089161:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24266 00000100:00100000:0.0:1786002690.089172:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+32:22233:x1872758531060480:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002690.089194:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002690.089214:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716e00/0x7cee4af5784177a0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b200 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.089250:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784177a7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.089263:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784177a7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.089274:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784177a7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.089385:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716e00/0x7cee4af5784177a0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b200 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.089404:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716600/0x7cee4af5784177a7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b200 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.089412:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9ed245644600) 00010000:00010000:0.0:1786002690.089416:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786002690.089419:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245716600, rc 0) 00000100:00100000:0.0:1786002690.089476:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:22233:x1872758531060480:12345-192.168.203.49@tcp:101:bash.0 Request processed in 306us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.089484:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24266 00000100:00100000:3.0:1786002690.125140:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.125251:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531060608 00000100:00100000:0.0:1786002690.125260:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531060608 00002000:00100000:0.0:1786002690.125305:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->5) req@ffff9ed2448fdf80 x1872758531060608/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.125316:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2448fdf80 with x1872758531060608 ext(0->5) 00002000:00010000:0.0:1786002690.125322:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2448fdf80 00000100:00100000:0.0:1786002690.125354:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 43 00000100:00100000:0.0:1786002690.125363:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531060608:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002690.128504:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758531060608:12345-192.168.203.49@tcp:4:bash.0 Request processed in 3134us (3365us total) trans 4294969975 rc 0/0 00000100:00100000:0.0:1786002690.128517:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 43 00002000:00100000:0.0:1786002690.128529:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->5) req@ffff9ed2448fdf80 x1872758531060608/t4294969975(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.128547:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2448fdf80 with x1872758531060608 ext(0->5) 00002000:00010000:0.0:1786002690.128552:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2448fdf80 00000100:00100000:1.0:1786002690.139605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.139708:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531060736 00000100:00100000:2.0:1786002690.139717:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531060736 00000100:00100000:2.0:1786002690.139771:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5356 00000100:00100000:2.0:1786002690.139779:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2410:x1872758531060736:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002690.145627:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969975 is committed 00000100:00100000:2.0:1786002690.145790:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2410:x1872758531060736:12345-192.168.203.49@tcp:16:bash.0 Request processed in 6006us (6189us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.145801:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5356 00000100:00100000:1.0:1786002690.154800:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.157699:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531060992 00000100:00100000:3.0:1786002690.157711:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531060992 00000100:00100000:3.0:1786002690.157778:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5254 00000100:00100000:3.0:1786002690.157788:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+33:22233:x1872758531060992:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:3.0:1786002690.158013:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968651 00000100:00100000:3.0:1786002690.158110:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:22233:x1872758531060992:12345-192.168.203.49@tcp:35:bash.0 Request processed in 323us (3317us total) trans 4294968652 rc 0/0 00000100:00100000:3.0:1786002690.158118:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5254 00000020:00080000:3.0:1786002690.158123:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002690.179409:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.179580:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531061248 00000100:00100000:1.0:1786002690.179590:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531061248 00000100:00100000:1.0:1786002690.179661:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24267 00000100:00100000:1.0:1786002690.179671:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+35:22233:x1872758531061248:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002690.179692:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002690.179712:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af5784177ae lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b207 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.179811:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999200/0x7cee4af5784177b5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.179825:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999200/0x7cee4af5784177b5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.179836:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999200/0x7cee4af5784177b5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002690.179880:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a4:0x0]: returning size 0 00010000:00010000:1.0:1786002690.180043:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af5784177ae lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b207 expref: 38 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.180065:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999200/0x7cee4af5784177b5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b207 expref: 37 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.180074:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9ed2456f9a00) 00010000:00010000:1.0:1786002690.180077:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002690.180080:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999200, rc 0) 00000100:00100000:1.0:1786002690.180329:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:22233:x1872758531061248:12345-192.168.203.49@tcp:101:bash.0 Request processed in 659us (929us total) trans 4294968653 rc 0/0 00000100:00100000:1.0:1786002690.180337:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24267 00000100:00100000:0.0:1786002690.199658:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.199813:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531061376 00000100:00100000:3.0:1786002690.199821:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531061376 00000100:00100000:3.0:1786002690.199917:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5357 00000100:00100000:3.0:1786002690.199927:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:22233:x1872758531061376:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.199944:0:14687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.199972:0:14687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051cfe320/0x7cee4af5784177c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b20e expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002690.199995:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002690.200016:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:3.0:1786002690.200021:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002690.200029:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051cfe320/0x7cee4af5784177c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b20e expref: 8 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.200045:0:14687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051cfe320/0x7cee4af5784177c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b20e expref: 8 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.200058:0:14687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82400, rc 0) 00000100:00100000:3.0:1786002690.200118:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:22233:x1872758531061376:12345-192.168.203.49@tcp:101:bash.0 Request processed in 192us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.200125:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5357 00000100:00100000:2.0:1786002690.229220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.229398:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531061504 00000100:00100000:3.0:1786002690.229407:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531061504 00000100:00100000:3.0:1786002690.229482:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1526 00000100:00100000:3.0:1786002690.229493:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:2412:x1872758531061504:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002690.229510:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002690.229534:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999200/0x7cee4af5784177b5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b207 expref: 37 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.229558:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9ed2456f9a00) 00010000:00010000:3.0:1786002690.229563:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002690.229921:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:2412:x1872758531061504:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 429us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.229930:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1526 00000100:00100000:2.0:1786002690.239389:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.239490:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531061632 00000100:00100000:1.0:1786002690.239499:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531061632 00000100:00100000:1.0:1786002690.239559:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24268 00000100:00100000:1.0:1786002690.239569:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+36:22233:x1872758531061632:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002690.239591:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002690.239610:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af5784177ca lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b215 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.239654:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998600/0x7cee4af5784177d1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.239667:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998600/0x7cee4af5784177d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.239678:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998600/0x7cee4af5784177d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.239785:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af5784177ca lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b215 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.239803:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998600/0x7cee4af5784177d1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b215 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.239812:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9ed2456f9a00) 00010000:00010000:1.0:1786002690.239816:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786002690.239820:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998600, rc 0) 00000100:00100000:1.0:1786002690.239896:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:22233:x1872758531061632:12345-192.168.203.49@tcp:101:bash.0 Request processed in 327us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002690.239902:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24268 00000100:00100000:0.0:1786002690.251342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.251419:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531061760 00000100:00100000:1.0:1786002690.251427:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531061760 00002000:00100000:1.0:1786002690.251473:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x3:0x0] (0->5) req@ffff9ed34b5ef800 x1872758531061760/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002690.251495:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5ef800 with x1872758531061760 ext(0->5) 00002000:00010000:1.0:1786002690.251500:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5ef800 00000100:00100000:1.0:1786002690.251530:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 44 00000100:00100000:1.0:1786002690.251539:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2411:x1872758531061760:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:1.0:1786002690.252774:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2411:x1872758531061760:12345-192.168.203.49@tcp:4:bash.0 Request processed in 1232us (1438us total) trans 4294969953 rc 0/0 00000100:00100000:1.0:1786002690.252783:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 44 00002000:00100000:1.0:1786002690.252791:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x3:0x0] (0->5) req@ffff9ed34b5ef800 x1872758531061760/t4294969953(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002690.252800:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5ef800 with x1872758531061760 ext(0->5) 00002000:00010000:1.0:1786002690.252804:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5ef800 00000100:00100000:3.0:1786002690.268793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.269307:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531061888 00000100:00100000:2.0:1786002690.269316:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531061888 00000100:00100000:2.0:1786002690.269370:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5358 00000100:00100000:2.0:1786002690.269381:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2410:x1872758531061888:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002690.271827:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969953 is committed 00000100:00100000:2.0:1786002690.272146:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2410:x1872758531061888:12345-192.168.203.49@tcp:16:bash.0 Request processed in 2756us (3351us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.272157:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5358 00000100:00100000:2.0:1786002690.280483:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.280785:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531062144 00000100:00100000:0.0:1786002690.280794:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531062144 00000100:00100000:0.0:1786002690.280878:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5255 00000100:00100000:0.0:1786002690.280890:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+37:22233:x1872758531062144:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:0.0:1786002690.281108:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968654 00000100:00100000:0.0:1786002690.281223:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+39:22233:x1872758531062144:12345-192.168.203.49@tcp:35:bash.0 Request processed in 334us (748us total) trans 4294968655 rc 0/0 00000100:00100000:0.0:1786002690.281231:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5255 00000020:00080000:0.0:1786002690.281236:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002690.286012:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.286141:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531062400 00000100:00100000:2.0:1786002690.286159:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531062400 00000100:00100000:2.0:1786002690.286215:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24269 00000100:00100000:2.0:1786002690.286226:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+39:22233:x1872758531062400:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002690.286385:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002690.286408:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784177d8 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b21c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.286545:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784177df lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.286560:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784177df lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.286570:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784177df lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002690.286582:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a5:0x0]: returning size 0 00010000:00010000:2.0:1786002690.286687:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3c00/0x7cee4af5784177d8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b21c expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.286710:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784177df lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b21c expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.286719:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9ed2456ae600) 00010000:00010000:2.0:1786002690.286722:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002690.286726:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed2800, rc 0) 00000100:00100000:2.0:1786002690.286784:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+41:22233:x1872758531062400:12345-192.168.203.49@tcp:101:bash.0 Request processed in 560us (779us total) trans 4294968656 rc 0/0 00000100:00100000:2.0:1786002690.286791:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24269 00000100:00100000:2.0:1786002690.293024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.293099:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531062656 00000100:00100000:0.0:1786002690.293108:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531062656 00000100:00100000:0.0:1786002690.293177:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1527 00000100:00100000:0.0:1786002690.293188:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+41:2410:x1872758531062656:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002690.293203:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002690.293226:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af5784177df lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b21c expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.293253:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9ed2456ae600) 00010000:00010000:0.0:1786002690.293259:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002690.293316:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:2410:x1872758531062656:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 129us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.293324:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1527 00000100:00100000:3.0:1786002690.297197:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.297376:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531062528 00000100:00100000:2.0:1786002690.297386:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531062528 00000100:00100000:2.0:1786002690.297439:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5359 00000100:00100000:2.0:1786002690.297449:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:22233:x1872758531062528:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002690.297562:0:14686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002690.297585:0:14686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa707bcf/0x7cee4af5784177ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b223 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002690.297609:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002690.297639:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:2.0:1786002690.297644:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002690.297653:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa707bcf/0x7cee4af5784177ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b223 expref: 8 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.297670:0:14686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa707bcf/0x7cee4af5784177ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b223 expref: 8 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.297683:0:14686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3c00, rc 0) 00000100:00100000:2.0:1786002690.297739:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:22233:x1872758531062528:12345-192.168.203.49@tcp:101:bash.0 Request processed in 291us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.297747:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5359 00000100:00100000:1.0:1786002690.300905:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.300996:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531062784 00000100:00100000:3.0:1786002690.301003:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531062784 00000100:00100000:3.0:1786002690.301053:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24270 00000100:00100000:3.0:1786002690.301062:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+40:22233:x1872758531062784:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.301081:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.301096:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784177f4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b22a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.301127:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82200/0x7cee4af5784177fb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.301140:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82200/0x7cee4af5784177fb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.301161:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82200/0x7cee4af5784177fb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.301430:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82c00/0x7cee4af5784177f4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b22a expref: 42 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.301453:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82200/0x7cee4af5784177fb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b22a expref: 41 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.301462:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9ed2456ae600) 00010000:00010000:3.0:1786002690.301465:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786002690.301468:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82200, rc 0) 00000100:00100000:3.0:1786002690.301612:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+41:22233:x1872758531062784:12345-192.168.203.49@tcp:101:bash.0 Request processed in 550us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.301627:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24270 00000100:00100000:3.0:1786002690.308561:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.308655:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531062912 00000100:00100000:0.0:1786002690.308665:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531062912 00002000:00100000:0.0:1786002690.308710:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->5) req@ffff9ed2448fc700 x1872758531062912/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.308720:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2448fc700 with x1872758531062912 ext(0->5) 00002000:00010000:0.0:1786002690.308726:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2448fc700 00000100:00100000:0.0:1786002690.308796:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 45 00000100:00100000:0.0:1786002690.308807:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2412:x1872758531062912:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002690.309703:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758531062912:12345-192.168.203.49@tcp:4:bash.0 Request processed in 895us (1149us total) trans 4294969976 rc 0/0 00000100:00100000:0.0:1786002690.309712:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 45 00002000:00100000:0.0:1786002690.309719:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->5) req@ffff9ed2448fc700 x1872758531062912/t4294969976(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.309728:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2448fc700 with x1872758531062912 ext(0->5) 00002000:00010000:0.0:1786002690.309731:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2448fc700 00000100:00100000:2.0:1786002690.316728:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.316801:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531063040 00000100:00100000:3.0:1786002690.316810:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531063040 00000100:00100000:3.0:1786002690.316895:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5360 00000100:00100000:3.0:1786002690.316906:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2413:x1872758531063040:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:2.0:1786002690.318650:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969976 is committed 00000100:00100000:3.0:1786002690.318794:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:2413:x1872758531063040:12345-192.168.203.49@tcp:16:bash.0 Request processed in 1887us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.318803:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5360 00000100:00100000:1.0:1786002690.323463:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.323564:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531063296 00000100:00100000:2.0:1786002690.323573:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531063296 00000100:00100000:2.0:1786002690.323717:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5256 00000100:00100000:2.0:1786002690.323728:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+41:22233:x1872758531063296:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:2.0:1786002690.323975:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968657 00000100:00100000:2.0:1786002690.324079:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+43:22233:x1872758531063296:12345-192.168.203.49@tcp:35:bash.0 Request processed in 353us (623us total) trans 4294968658 rc 0/0 00000100:00100000:2.0:1786002690.324091:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5256 00000020:00080000:2.0:1786002690.324096:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002690.328610:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.329072:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531063552 00000100:00100000:0.0:1786002690.329082:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531063552 00000100:00100000:0.0:1786002690.329184:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24271 00000100:00100000:0.0:1786002690.329195:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+43:22233:x1872758531063552:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002690.329216:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002690.329237:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716c00/0x7cee4af578417802 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b231 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.329342:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af578417809 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.329355:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af578417809 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.329366:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af578417809 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002690.329377:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a6:0x0]: returning size 0 00010000:00010000:0.0:1786002690.329485:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716c00/0x7cee4af578417802 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b231 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.329508:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af578417809 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b231 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.329517:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9ed245644a00) 00010000:00010000:0.0:1786002690.329520:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002690.329524:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717c00, rc 0) 00000100:00100000:0.0:1786002690.329640:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+45:22233:x1872758531063552:12345-192.168.203.49@tcp:101:bash.0 Request processed in 446us (1045us total) trans 4294968659 rc 0/0 00000100:00100000:0.0:1786002690.329648:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24271 00000100:00100000:3.0:1786002690.335161:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.335551:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531063680 00000100:00100000:2.0:1786002690.335561:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531063680 00000100:00100000:2.0:1786002690.335633:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1528 00000100:00100000:2.0:1786002690.335643:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+45:2410:x1872758531063680:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002690.335658:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002690.335680:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af578417809 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b231 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.335698:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9ed245644a00) 00010000:00010000:2.0:1786002690.335703:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002690.335760:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+44:2410:x1872758531063680:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 118us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.335768:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1528 00000100:00100000:1.0:1786002690.339186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.339290:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531063808 00000100:00100000:2.0:1786002690.339297:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531063808 00000100:00100000:2.0:1786002690.339345:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5361 00000100:00100000:2.0:1786002690.339356:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:22233:x1872758531063808:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002690.339371:0:14685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002690.339390:0:14685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578417817 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b238 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002690.339413:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002690.339431:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:2.0:1786002690.339436:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002690.339444:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578417817 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b238 expref: 9 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.339460:0:14685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f1f6319/0x7cee4af578417817 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b238 expref: 9 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.339483:0:14685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3a00, rc 0) 00000100:00100000:2.0:1786002690.339535:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:22233:x1872758531063808:12345-192.168.203.49@tcp:101:bash.0 Request processed in 181us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.339542:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5361 00000100:00100000:0.0:1786002690.346275:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.346420:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531063936 00000100:00100000:2.0:1786002690.346429:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531063936 00000100:00100000:2.0:1786002690.346499:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24272 00000100:00100000:2.0:1786002690.346510:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+44:22233:x1872758531063936:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002690.346532:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002690.346551:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3200/0x7cee4af57841781e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b23f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.346583:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417825 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.346596:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417825 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.346608:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417825 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.346726:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3200/0x7cee4af57841781e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b23f expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.346744:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3e00/0x7cee4af578417825 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b23f expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.346752:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9ed245644a00) 00010000:00010000:2.0:1786002690.346756:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786002690.346759:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3e00, rc 0) 00000100:00100000:2.0:1786002690.346818:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+45:22233:x1872758531063936:12345-192.168.203.49@tcp:101:bash.0 Request processed in 309us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.346825:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24272 00000100:00100000:0.0:1786002690.353811:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.354281:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531064064 00000100:00100000:1.0:1786002690.354291:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531064064 00002000:00100000:1.0:1786002690.354335:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x4:0x0] (0->5) req@ffff9ed245512300 x1872758531064064/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002690.354346:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245512300 with x1872758531064064 ext(0->5) 00002000:00010000:1.0:1786002690.354351:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed245512300 00000100:00100000:1.0:1786002690.354381:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 46 00000100:00100000:1.0:1786002690.354391:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758531064064:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:1.0:1786002690.355318:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2412:x1872758531064064:12345-192.168.203.49@tcp:4:bash.0 Request processed in 926us (1514us total) trans 4294969954 rc 0/0 00000100:00100000:1.0:1786002690.355326:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 46 00002000:00100000:1.0:1786002690.355333:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x4:0x0] (0->5) req@ffff9ed245512300 x1872758531064064/t4294969954(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002690.355341:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245512300 with x1872758531064064 ext(0->5) 00002000:00010000:1.0:1786002690.355345:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed245512300 00000100:00100000:1.0:1786002690.373485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.373573:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531064192 00000100:00100000:3.0:1786002690.373582:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531064192 00000100:00100000:3.0:1786002690.373643:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5362 00000100:00100000:3.0:1786002690.373653:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758531064192:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002690.376792:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969954 is committed 00000100:00100000:3.0:1786002690.376974:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758531064192:12345-192.168.203.49@tcp:16:bash.0 Request processed in 3318us (3495us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.376990:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5362 00000100:00100000:1.0:1786002690.380913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.381005:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531064448 00000100:00100000:3.0:1786002690.381014:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531064448 00000100:00100000:3.0:1786002690.381059:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5257 00000100:00100000:3.0:1786002690.381068:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+45:22233:x1872758531064448:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:3.0:1786002690.381276:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968660 00000100:00100000:3.0:1786002690.381378:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:22233:x1872758531064448:12345-192.168.203.49@tcp:35:bash.0 Request processed in 310us (473us total) trans 4294968661 rc 0/0 00000100:00100000:3.0:1786002690.381386:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5257 00000020:00080000:3.0:1786002690.381390:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002690.387758:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.387901:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531064704 00000100:00100000:1.0:1786002690.387910:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531064704 00000100:00100000:1.0:1786002690.387976:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24273 00000100:00100000:1.0:1786002690.387987:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+47:22233:x1872758531064704:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002690.388010:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002690.388031:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999800/0x7cee4af57841782c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b246 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.388137:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417833 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.388166:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417833 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.388177:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417833 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002690.388189:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a7:0x0]: returning size 0 00010000:00010000:1.0:1786002690.388284:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999800/0x7cee4af57841782c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b246 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.388305:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417833 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b246 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.388335:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9ed2456f9900) 00010000:00010000:1.0:1786002690.388338:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002690.388341:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999600, rc 0) 00000100:00100000:1.0:1786002690.388400:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:22233:x1872758531064704:12345-192.168.203.49@tcp:101:bash.0 Request processed in 415us (651us total) trans 4294968662 rc 0/0 00000100:00100000:1.0:1786002690.388408:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24273 00000100:00100000:1.0:1786002690.395275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.395361:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531064832 00000100:00100000:0.0:1786002690.395370:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531064832 00000100:00100000:0.0:1786002690.395439:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1529 00000100:00100000:0.0:1786002690.395449:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:2412:x1872758531064832:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002690.395464:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002690.395498:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417833 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b246 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.395516:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9ed2456f9900) 00010000:00010000:0.0:1786002690.395521:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002690.395577:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:2412:x1872758531064832:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 129us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.395584:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1529 00000100:00100000:2.0:1786002690.400013:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.400099:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531064960 00000100:00100000:3.0:1786002690.400108:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531064960 00000100:00100000:3.0:1786002690.400160:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5363 00000100:00100000:3.0:1786002690.400170:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+8:22233:x1872758531064960:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.400187:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.400206:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578417841 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b24d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002690.400229:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002690.400254:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:3.0:1786002690.400259:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002690.400266:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578417841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b24d expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.400282:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4b3da80/0x7cee4af578417841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b24d expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.400301:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f82c00, rc 0) 00000100:00100000:3.0:1786002690.400357:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:22233:x1872758531064960:12345-192.168.203.49@tcp:101:bash.0 Request processed in 187us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.400364:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5363 00000100:00100000:1.0:1786002690.403608:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.406466:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531065088 00000100:00100000:0.0:1786002690.406478:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531065088 00000100:00100000:0.0:1786002690.406546:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24274 00000100:00100000:0.0:1786002690.406557:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:22233:x1872758531065088:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002690.406580:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002690.406599:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716e00/0x7cee4af578417848 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b254 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.406641:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717800/0x7cee4af57841784f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.406655:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717800/0x7cee4af57841784f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.406665:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717800/0x7cee4af57841784f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.406772:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716e00/0x7cee4af578417848 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b254 expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.406791:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717800/0x7cee4af57841784f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b254 expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.406800:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9ed2456f9900) 00010000:00010000:0.0:1786002690.406803:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786002690.406806:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717800, rc 0) 00000100:00100000:0.0:1786002690.407114:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:22233:x1872758531065088:12345-192.168.203.49@tcp:101:bash.0 Request processed in 558us (3510us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.407122:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24274 00000100:00100000:2.0:1786002690.419626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.420119:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531065216 00000100:00100000:0.0:1786002690.420128:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531065216 00002000:00100000:0.0:1786002690.420173:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->5) req@ffff9ed244ffa300 x1872758531065216/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.420184:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ffa300 with x1872758531065216 ext(0->5) 00002000:00010000:0.0:1786002690.420190:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244ffa300 00000100:00100000:0.0:1786002690.420220:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 47 00000100:00100000:0.0:1786002690.420229:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2413:x1872758531065216:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002690.421209:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758531065216:12345-192.168.203.49@tcp:4:bash.0 Request processed in 979us (1597us total) trans 4294969977 rc 0/0 00000100:00100000:0.0:1786002690.421218:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 47 00002000:00100000:0.0:1786002690.421225:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->5) req@ffff9ed244ffa300 x1872758531065216/t4294969977(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.421234:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ffa300 with x1872758531065216 ext(0->5) 00002000:00010000:0.0:1786002690.421238:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244ffa300 00000100:00100000:1.0:1786002690.424046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.424133:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531065344 00000100:00100000:2.0:1786002690.424140:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531065344 00000100:00100000:2.0:1786002690.424186:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5364 00000100:00100000:2.0:1786002690.424196:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2412:x1872758531065344:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002690.426936:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969977 is committed 00000100:00100000:2.0:1786002690.427130:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:2412:x1872758531065344:12345-192.168.203.49@tcp:16:bash.0 Request processed in 2931us (3087us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.427148:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5364 00000100:00100000:1.0:1786002690.430538:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.430779:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531065600 00000100:00100000:2.0:1786002690.430787:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531065600 00000100:00100000:2.0:1786002690.430839:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5258 00000100:00100000:2.0:1786002690.430884:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:22233:x1872758531065600:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:2.0:1786002690.431088:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968663 00000100:00100000:2.0:1786002690.431194:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+51:22233:x1872758531065600:12345-192.168.203.49@tcp:35:bash.0 Request processed in 345us (661us total) trans 4294968664 rc 0/0 00000100:00100000:2.0:1786002690.431206:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5258 00000020:00080000:2.0:1786002690.431210:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002690.435155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.435582:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531065856 00000100:00100000:3.0:1786002690.435591:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531065856 00000100:00100000:3.0:1786002690.435651:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24275 00000100:00100000:3.0:1786002690.435662:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+51:22233:x1872758531065856:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.435683:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.435703:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417856 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b25b expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.435798:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af57841785d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.435813:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af57841785d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.435824:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af57841785d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002690.435835:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a8:0x0]: returning size 0 00010000:00010000:3.0:1786002690.435970:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83e00/0x7cee4af578417856 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b25b expref: 54 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.435993:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af57841785d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b25b expref: 53 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.436008:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9ed2456aef00) 00010000:00010000:3.0:1786002690.436011:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002690.436014:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83600, rc 0) 00000100:00100000:3.0:1786002690.436061:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+53:22233:x1872758531065856:12345-192.168.203.49@tcp:101:bash.0 Request processed in 400us (922us total) trans 4294968665 rc 0/0 00000100:00100000:3.0:1786002690.436068:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24275 00000100:00100000:1.0:1786002690.441762:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.441809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.441889:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531066112 00000100:00100000:2.0:1786002690.441898:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531066112 00000100:00100000:2.0:1786002690.441967:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1530 00000100:00100000:2.0:1786002690.441977:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+53:2411:x1872758531066112:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002690.441992:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002690.442015:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af57841785d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b25b expref: 53 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.442031:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9ed2456aef00) 00010000:00010000:2.0:1786002690.442036:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002690.442093:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+52:2411:x1872758531066112:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 117us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.442100:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1530 00000100:00100000:3.0:1786002690.442725:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531065984 00000100:00100000:3.0:1786002690.442731:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531065984 00000100:00100000:3.0:1786002690.442765:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5365 00000100:00100000:3.0:1786002690.442773:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:22233:x1872758531065984:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.442785:0:14678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.442802:0:14678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ea82150/0x7cee4af57841786b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b262 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002690.442824:0:14678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002690.442840:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:3.0:1786002690.442876:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002690.442886:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ea82150/0x7cee4af57841786b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b262 expref: 10 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.442902:0:14678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ea82150/0x7cee4af57841786b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b262 expref: 10 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.442913:0:14678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83e00, rc 0) 00000100:00100000:3.0:1786002690.442943:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:22233:x1872758531065984:12345-192.168.203.49@tcp:101:bash.0 Request processed in 171us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.442950:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5365 00000100:00100000:1.0:1786002690.453048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.453426:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531066240 00000100:00100000:3.0:1786002690.453436:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531066240 00000100:00100000:3.0:1786002690.453498:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24276 00000100:00100000:3.0:1786002690.453508:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+52:22233:x1872758531066240:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.453530:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.453547:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af578417872 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b269 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.453579:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af578417879 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.453591:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af578417879 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.453602:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af578417879 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.453734:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83000/0x7cee4af578417872 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b269 expref: 54 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.453765:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83600/0x7cee4af578417879 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b269 expref: 53 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.453774:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9ed2456aef00) 00010000:00010000:3.0:1786002690.453778:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786002690.453781:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83600, rc 0) 00000100:00100000:3.0:1786002690.453887:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+53:22233:x1872758531066240:12345-192.168.203.49@tcp:101:bash.0 Request processed in 341us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.453896:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24276 00000100:00100000:2.0:1786002690.465898:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.466295:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531066368 00000100:00100000:1.0:1786002690.466304:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531066368 00002000:00100000:1.0:1786002690.466351:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x5:0x0] (0->5) req@ffff9ed244ff8e00 x1872758531066368/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002690.466361:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ff8e00 with x1872758531066368 ext(0->5) 00002000:00010000:1.0:1786002690.466368:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed244ff8e00 00000100:00100000:1.0:1786002690.466398:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 48 00000100:00100000:1.0:1786002690.466407:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2413:x1872758531066368:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:1.0:1786002690.467157:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2413:x1872758531066368:12345-192.168.203.49@tcp:4:bash.0 Request processed in 749us (1265us total) trans 4294969955 rc 0/0 00000100:00100000:1.0:1786002690.467166:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 48 00002000:00100000:1.0:1786002690.467173:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x5:0x0] (0->5) req@ffff9ed244ff8e00 x1872758531066368/t4294969955(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002690.467182:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ff8e00 with x1872758531066368 ext(0->5) 00002000:00010000:1.0:1786002690.467186:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed244ff8e00 00000100:00100000:3.0:1786002690.471054:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.471195:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531066496 00000100:00100000:2.0:1786002690.471204:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531066496 00000100:00100000:2.0:1786002690.471253:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5366 00000100:00100000:2.0:1786002690.471263:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758531066496:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002690.474124:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969955 is committed 00000100:00100000:2.0:1786002690.477411:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758531066496:12345-192.168.203.49@tcp:16:bash.0 Request processed in 6142us (6357us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.477423:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5366 00000100:00100000:1.0:1786002690.481343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.481438:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531066752 00000100:00100000:0.0:1786002690.481446:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531066752 00000100:00100000:0.0:1786002690.481533:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5259 00000100:00100000:0.0:1786002690.481544:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+53:22233:x1872758531066752:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:0.0:1786002690.482278:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968666 00000100:00100000:0.0:1786002690.482375:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+55:22233:x1872758531066752:12345-192.168.203.49@tcp:35:bash.0 Request processed in 832us (1038us total) trans 4294968667 rc 0/0 00000100:00100000:0.0:1786002690.482383:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5259 00000020:00080000:0.0:1786002690.482388:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002690.488051:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.488202:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531067008 00000100:00100000:2.0:1786002690.488211:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531067008 00000100:00100000:2.0:1786002690.488269:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24277 00000100:00100000:2.0:1786002690.488280:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+55:22233:x1872758531067008:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002690.488304:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002690.488325:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af578417880 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b270 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.488428:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af578417887 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.488441:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af578417887 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.488452:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af578417887 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002690.488463:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a9:0x0]: returning size 0 00010000:00010000:2.0:1786002690.488559:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af578417880 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b270 expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.488582:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af578417887 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b270 expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.488590:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002690.488593:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002690.488597:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed2800, rc 0) 00000100:00100000:2.0:1786002690.488750:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+57:22233:x1872758531067008:12345-192.168.203.49@tcp:101:bash.0 Request processed in 470us (707us total) trans 4294968668 rc 0/0 00000100:00100000:2.0:1786002690.488758:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24277 00000100:00100000:1.0:1786002690.494369:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.494506:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531067136 00000100:00100000:0.0:1786002690.494514:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531067136 00000100:00100000:0.0:1786002690.494574:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1531 00000100:00100000:0.0:1786002690.494584:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+57:2410:x1872758531067136:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002690.494598:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002690.494632:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af578417887 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b270 expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.494650:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002690.494654:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002690.494742:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+56:2410:x1872758531067136:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 160us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.494750:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1531 00000100:00100000:1.0:1786002690.496047:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.496156:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531067264 00000100:00100000:3.0:1786002690.496162:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531067264 00000100:00100000:3.0:1786002690.496197:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5367 00000100:00100000:3.0:1786002690.496205:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+9:22233:x1872758531067264:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.496219:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.496236:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578417895 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b277 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002690.496259:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002690.496276:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:3.0:1786002690.496280:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002690.496288:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578417895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b277 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.496303:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000beff4ab1/0x7cee4af578417895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b277 expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.496315:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245f83000, rc 0) 00000100:00100000:3.0:1786002690.496353:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:22233:x1872758531067264:12345-192.168.203.49@tcp:101:bash.0 Request processed in 149us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.496360:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5367 00000100:00100000:2.0:1786002690.499310:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.499386:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531067392 00000100:00100000:1.0:1786002690.499394:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531067392 00000100:00100000:1.0:1786002690.499445:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24278 00000100:00100000:1.0:1786002690.499454:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+56:22233:x1872758531067392:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002690.499483:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002690.499501:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af57841789c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b27e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.499533:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784178a3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.499546:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784178a3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.499557:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784178a3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.499676:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af57841789c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b27e expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.499692:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998400/0x7cee4af5784178a3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b27e expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.499700:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9ed245735700) 00010000:00010000:1.0:1786002690.499703:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786002690.499706:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998400, rc 0) 00000100:00100000:1.0:1786002690.499757:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+57:22233:x1872758531067392:12345-192.168.203.49@tcp:101:bash.0 Request processed in 303us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002690.499764:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24278 00000100:00100000:1.0:1786002690.517727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.518071:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531067520 00000100:00100000:0.0:1786002690.518081:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531067520 00002000:00100000:0.0:1786002690.518128:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->5) req@ffff9ed37f570e00 x1872758531067520/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.518149:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f570e00 with x1872758531067520 ext(0->5) 00002000:00010000:0.0:1786002690.518156:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f570e00 00000100:00100000:0.0:1786002690.518184:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 49 00000100:00100000:0.0:1786002690.518193:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2410:x1872758531067520:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002690.519136:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2410:x1872758531067520:12345-192.168.203.49@tcp:4:bash.0 Request processed in 941us (1415us total) trans 4294969978 rc 0/0 00000100:00100000:0.0:1786002690.519153:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 49 00002000:00100000:0.0:1786002690.519160:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->5) req@ffff9ed37f570e00 x1872758531067520/t4294969978(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.519169:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f570e00 with x1872758531067520 ext(0->5) 00002000:00010000:0.0:1786002690.519172:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f570e00 00000100:00100000:2.0:1786002690.543092:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.543260:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531067648 00000100:00100000:3.0:1786002690.543271:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531067648 00000100:00100000:3.0:1786002690.543367:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5368 00000100:00100000:3.0:1786002690.543377:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758531067648:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:2.0:1786002690.545100:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969978 is committed 00000100:00100000:3.0:1786002690.545281:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:2412:x1872758531067648:12345-192.168.203.49@tcp:16:bash.0 Request processed in 1902us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.545291:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5368 00000100:00100000:0.0:1786002690.549897:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.550007:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531067904 00000100:00100000:3.0:1786002690.550016:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531067904 00000100:00100000:3.0:1786002690.550063:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5260 00000100:00100000:3.0:1786002690.550072:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+57:22233:x1872758531067904:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:3.0:1786002690.550355:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968669 00000100:00100000:3.0:1786002690.550478:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+59:22233:x1872758531067904:12345-192.168.203.49@tcp:35:bash.0 Request processed in 406us (794us total) trans 4294968670 rc 0/0 00000100:00100000:3.0:1786002690.550486:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5260 00000020:00080000:3.0:1786002690.550490:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002690.554099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.554338:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531068160 00000100:00100000:2.0:1786002690.554345:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531068160 00000100:00100000:2.0:1786002690.554396:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24279 00000100:00100000:2.0:1786002690.554404:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+59:22233:x1872758531068160:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002690.554422:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002690.554443:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3200/0x7cee4af5784178aa lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b285 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.554540:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784178b1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.554553:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784178b1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.554564:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784178b1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002690.554573:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1aa:0x0]: returning size 0 00010000:00010000:2.0:1786002690.554668:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3200/0x7cee4af5784178aa lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b285 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.554699:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784178b1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b285 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.554708:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9ed2456f9200) 00010000:00010000:2.0:1786002690.554711:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002690.554714:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3600, rc 0) 00000100:00100000:2.0:1786002690.554993:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+61:22233:x1872758531068160:12345-192.168.203.49@tcp:101:bash.0 Request processed in 588us (900us total) trans 4294968671 rc 0/0 00000100:00100000:2.0:1786002690.555000:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24279 00000100:00100000:2.0:1786002690.562888:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.562970:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531068288 00000100:00100000:1.0:1786002690.562979:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531068288 00000100:00100000:1.0:1786002690.563034:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1532 00000100:00100000:1.0:1786002690.563044:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+61:2413:x1872758531068288:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002690.563059:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002690.563081:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af5784178b1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b285 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.563098:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9ed2456f9200) 00010000:00010000:1.0:1786002690.563102:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002690.563143:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+60:2413:x1872758531068288:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 101us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002690.563150:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1532 00000100:00100000:1.0:1786002690.572189:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.572274:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531068416 00000100:00100000:2.0:1786002690.572282:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531068416 00000100:00100000:2.0:1786002690.572328:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5369 00000100:00100000:2.0:1786002690.572336:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:22233:x1872758531068416:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002690.572349:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002690.572362:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af5784178bf lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b28c expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002690.572380:0:14665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002690.572396:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:2.0:1786002690.572400:0:14665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002690.572405:0:14665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af5784178bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b28c expref: 11 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.572415:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf17d64b/0x7cee4af5784178bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b28c expref: 11 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.572424:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed3200, rc 0) 00000100:00100000:2.0:1786002690.572469:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:22233:x1872758531068416:12345-192.168.203.49@tcp:101:bash.0 Request processed in 134us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.572473:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5369 00000100:00100000:0.0:1786002690.576254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.576327:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531068544 00000100:00100000:1.0:1786002690.576334:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531068544 00000100:00100000:1.0:1786002690.576385:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24280 00000100:00100000:1.0:1786002690.576394:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+60:22233:x1872758531068544:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002690.576415:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002690.576432:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af5784178c6 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b293 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.576459:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998c00/0x7cee4af5784178cd lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.576470:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998c00/0x7cee4af5784178cd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.576480:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998c00/0x7cee4af5784178cd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.576577:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af5784178c6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b293 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.576593:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998c00/0x7cee4af5784178cd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b293 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.576602:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9ed2456f9200) 00010000:00010000:1.0:1786002690.576605:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786002690.576608:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998c00, rc 0) 00000100:00100000:1.0:1786002690.576671:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+61:22233:x1872758531068544:12345-192.168.203.49@tcp:101:bash.0 Request processed in 278us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002690.576678:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24280 00000100:00100000:0.0:1786002690.582215:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.582478:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531068672 00000100:00100000:2.0:1786002690.582488:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531068672 00002000:00100000:2.0:1786002690.582532:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x6:0x0] (0->5) req@ffff9ed349f7ad80 x1872758531068672/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002690.582541:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed349f7ad80 with x1872758531068672 ext(0->5) 00002000:00010000:2.0:1786002690.582545:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed349f7ad80 00000100:00100000:2.0:1786002690.582572:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 50 00000100:00100000:2.0:1786002690.582580:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed349f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2413:x1872758531068672:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:2.0:1786002690.583461:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed349f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2413:x1872758531068672:12345-192.168.203.49@tcp:4:bash.0 Request processed in 879us (1252us total) trans 4294969956 rc 0/0 00000100:00100000:2.0:1786002690.583469:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 50 00002000:00100000:2.0:1786002690.583476:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x6:0x0] (0->5) req@ffff9ed349f7ad80 x1872758531068672/t4294969956(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002690.583483:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed349f7ad80 with x1872758531068672 ext(0->5) 00002000:00010000:2.0:1786002690.583487:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed349f7ad80 00000100:00100000:2.0:1786002690.587015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.587086:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531068800 00000100:00100000:0.0:1786002690.587094:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531068800 00000100:00100000:0.0:1786002690.587137:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5370 00000100:00100000:0.0:1786002690.587152:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758531068800:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002690.588604:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969956 is committed 00000100:00100000:0.0:1786002690.588747:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2412:x1872758531068800:12345-192.168.203.49@tcp:16:bash.0 Request processed in 1593us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.588755:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5370 00000100:00100000:3.0:1786002690.591729:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.591804:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531069056 00000100:00100000:0.0:1786002690.591820:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531069056 00000100:00100000:0.0:1786002690.591887:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5261 00000100:00100000:0.0:1786002690.591896:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+61:22233:x1872758531069056:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:0.0:1786002690.592087:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968672 00000100:00100000:0.0:1786002690.592177:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+63:22233:x1872758531069056:12345-192.168.203.49@tcp:35:bash.0 Request processed in 281us (453us total) trans 4294968673 rc 0/0 00000100:00100000:0.0:1786002690.592184:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5261 00000020:00080000:0.0:1786002690.592188:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002690.595939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.596020:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531069312 00000100:00100000:3.0:1786002690.596028:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531069312 00000100:00100000:3.0:1786002690.596078:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24281 00000100:00100000:3.0:1786002690.596087:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+63:22233:x1872758531069312:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.596108:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.596128:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af5784178d4 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b29a expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.596223:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429eb600/0x7cee4af5784178db lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.596239:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429eb600/0x7cee4af5784178db lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.596249:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429eb600/0x7cee4af5784178db lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002690.596258:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ab:0x0]: returning size 0 00010000:00010000:3.0:1786002690.596342:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af5784178d4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b29a expref: 66 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.596364:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429eb600/0x7cee4af5784178db lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b29a expref: 65 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.596372:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9ed2456ae200) 00010000:00010000:3.0:1786002690.596374:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002690.596377:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed3429eb600, rc 0) 00000100:00100000:3.0:1786002690.596429:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+65:22233:x1872758531069312:12345-192.168.203.49@tcp:101:bash.0 Request processed in 343us (496us total) trans 4294968674 rc 0/0 00000100:00100000:3.0:1786002690.596435:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24281 00000100:00100000:1.0:1786002690.600804:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.600976:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531069440 00000100:00100000:0.0:1786002690.600983:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531069440 00000100:00100000:0.0:1786002690.601028:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1533 00000100:00100000:0.0:1786002690.601037:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+65:2411:x1872758531069440:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002690.601048:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002690.601069:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429eb600/0x7cee4af5784178db lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b29a expref: 65 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.601085:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9ed2456ae200) 00010000:00010000:0.0:1786002690.601089:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002690.601133:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+64:2411:x1872758531069440:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 98us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.601140:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1533 00000100:00100000:1.0:1786002690.605527:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.605612:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531069568 00000100:00100000:0.0:1786002690.605629:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531069568 00000100:00100000:0.0:1786002690.605672:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5371 00000100:00100000:0.0:1786002690.605680:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+10:22233:x1872758531069568:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002690.605696:0:14691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002690.605713:0:14691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eefa003e/0x7cee4af5784178e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2a1 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002690.605750:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002690.605770:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:0.0:1786002690.605774:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002690.605781:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eefa003e/0x7cee4af5784178e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2a1 expref: 11 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.605794:0:14691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eefa003e/0x7cee4af5784178e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2a1 expref: 11 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.605805:0:14691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245716e00, rc 0) 00000100:00100000:0.0:1786002690.605880:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:22233:x1872758531069568:12345-192.168.203.49@tcp:101:bash.0 Request processed in 201us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.605887:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5371 00000100:00100000:1.0:1786002690.610948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.611212:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531069696 00000100:00100000:3.0:1786002690.611220:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531069696 00000100:00100000:3.0:1786002690.611275:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24282 00000100:00100000:3.0:1786002690.611285:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+64:22233:x1872758531069696:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.611305:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.611322:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af5784178f0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2a8 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.611359:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429eb600/0x7cee4af5784178f7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.611370:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429eb600/0x7cee4af5784178f7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.611380:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429eb600/0x7cee4af5784178f7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.611490:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af5784178f0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2a8 expref: 66 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.611506:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429eb600/0x7cee4af5784178f7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2a8 expref: 65 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.611513:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9ed2456ae200) 00010000:00010000:3.0:1786002690.611516:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786002690.611519:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed3429eb600, rc 0) 00000100:00100000:3.0:1786002690.612655:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2465fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+65:22233:x1872758531069696:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1369us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.612663:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24282 00000100:00100000:2.0:1786002690.620370:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.620437:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531069824 00000100:00100000:0.0:1786002690.620447:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531069824 00002000:00100000:0.0:1786002690.620490:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x7:0x0] (0->5) req@ffff9ed244ff9180 x1872758531069824/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.620500:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ff9180 with x1872758531069824 ext(0->5) 00002000:00010000:0.0:1786002690.620506:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244ff9180 00000100:00100000:0.0:1786002690.620536:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 51 00000100:00100000:0.0:1786002690.620547:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2412:x1872758531069824:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002690.622029:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758531069824:12345-192.168.203.49@tcp:4:bash.0 Request processed in 1478us (1659us total) trans 4294969979 rc 0/0 00000100:00100000:0.0:1786002690.622042:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 51 00002000:00100000:0.0:1786002690.622051:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x7:0x0] (0->5) req@ffff9ed244ff9180 x1872758531069824/t4294969979(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.622060:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ff9180 with x1872758531069824 ext(0->5) 00002000:00010000:0.0:1786002690.622065:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244ff9180 00000100:00100000:1.0:1786002690.629177:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.629308:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531069952 00000100:00100000:2.0:1786002690.629317:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531069952 00000100:00100000:2.0:1786002690.629370:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5372 00000100:00100000:2.0:1786002690.629379:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2410:x1872758531069952:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002690.630982:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969979 is committed 00000100:00100000:2.0:1786002690.631236:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:2410:x1872758531069952:12345-192.168.203.49@tcp:16:bash.0 Request processed in 1854us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.631245:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5372 00000100:00100000:1.0:1786002690.634529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.634609:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531070208 00000100:00100000:3.0:1786002690.634627:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531070208 00000100:00100000:3.0:1786002690.634678:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5262 00000100:00100000:3.0:1786002690.634688:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+65:22233:x1872758531070208:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:3.0:1786002690.634935:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968675 00000100:00100000:3.0:1786002690.635035:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+67:22233:x1872758531070208:12345-192.168.203.49@tcp:35:bash.0 Request processed in 348us (512us total) trans 4294968676 rc 0/0 00000100:00100000:3.0:1786002690.635044:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5262 00000020:00080000:3.0:1786002690.635048:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002690.640203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.640344:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531070464 00000100:00100000:0.0:1786002690.640353:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531070464 00000100:00100000:0.0:1786002690.640412:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24283 00000100:00100000:0.0:1786002690.640421:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+67:22233:x1872758531070464:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002690.640444:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002690.640465:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716c00/0x7cee4af5784178fe lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2af expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.640592:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417905 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.640606:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417905 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.640626:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417905 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002690.640637:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ac:0x0]: returning size 0 00010000:00010000:0.0:1786002690.640730:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716c00/0x7cee4af5784178fe lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2af expref: 70 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.640763:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417905 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2af expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.640772:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9ed243d0bd00) 00010000:00010000:0.0:1786002690.640775:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002690.640778:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717200, rc 0) 00000100:00100000:0.0:1786002690.640840:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+69:22233:x1872758531070464:12345-192.168.203.49@tcp:101:bash.0 Request processed in 419us (644us total) trans 4294968677 rc 0/0 00000100:00100000:0.0:1786002690.640887:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24283 00000100:00100000:1.0:1786002690.648178:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.648275:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531070592 00000100:00100000:2.0:1786002690.648285:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531070592 00000100:00100000:2.0:1786002690.648345:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1534 00000100:00100000:2.0:1786002690.648357:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+69:2411:x1872758531070592:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002690.648374:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002690.648397:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af578417905 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2af expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.648416:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9ed243d0bd00) 00010000:00010000:2.0:1786002690.648420:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002690.648480:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+68:2411:x1872758531070592:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 125us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.648487:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1534 00000100:00100000:1.0:1786002690.654113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.654201:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531070720 00000100:00100000:0.0:1786002690.654210:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531070720 00000100:00100000:0.0:1786002690.654284:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5373 00000100:00100000:0.0:1786002690.654294:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:22233:x1872758531070720:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002690.654312:0:14687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002690.654333:0:14687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce2ef4d4/0x7cee4af578417913 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2b6 expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002690.654358:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002690.654378:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:0.0:1786002690.654382:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002690.654390:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce2ef4d4/0x7cee4af578417913 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2b6 expref: 12 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.654406:0:14687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce2ef4d4/0x7cee4af578417913 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2b6 expref: 12 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.654418:0:14687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245716c00, rc 0) 00000100:00100000:0.0:1786002690.654478:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:22233:x1872758531070720:12345-192.168.203.49@tcp:101:bash.0 Request processed in 186us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.654485:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5373 00000100:00100000:1.0:1786002690.659206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.659337:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531070848 00000100:00100000:2.0:1786002690.659345:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531070848 00000100:00100000:2.0:1786002690.659398:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24284 00000100:00100000:2.0:1786002690.659408:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+68:22233:x1872758531070848:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002690.659430:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002690.659449:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af57841791a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2bd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.659490:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af578417921 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.659503:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af578417921 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.659514:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af578417921 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.659625:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af57841791a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2bd expref: 70 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.659643:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2400/0x7cee4af578417921 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2bd expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.659652:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9ed243d0bd00) 00010000:00010000:2.0:1786002690.659655:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786002690.659659:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed2400, rc 0) 00000100:00100000:2.0:1786002690.659714:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+69:22233:x1872758531070848:12345-192.168.203.49@tcp:101:bash.0 Request processed in 308us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.659721:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24284 00000100:00100000:1.0:1786002690.666562:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.666640:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531070976 00000100:00100000:2.0:1786002690.666650:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531070976 00002000:00100000:2.0:1786002690.666695:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x7:0x0] (0->6) req@ffff9ed2419aed80 x1872758531070976/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002690.666706:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2419aed80 with x1872758531070976 ext(0->6) 00002000:00010000:2.0:1786002690.666712:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2419aed80 00000100:00100000:2.0:1786002690.666751:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 52 00000100:00100000:2.0:1786002690.666761:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758531070976:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:2.0:1786002690.669180:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2412:x1872758531070976:12345-192.168.203.49@tcp:4:bash.0 Request processed in 2414us (2619us total) trans 4294969957 rc 0/0 00000100:00100000:2.0:1786002690.669191:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 52 00002000:00100000:2.0:1786002690.669200:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x7:0x0] (0->6) req@ffff9ed2419aed80 x1872758531070976/t4294969957(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002690.669209:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2419aed80 with x1872758531070976 ext(0->6) 00002000:00010000:2.0:1786002690.669214:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2419aed80 00000100:00100000:0.0:1786002690.673469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.673547:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531071104 00000100:00100000:3.0:1786002690.673555:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531071104 00000100:00100000:3.0:1786002690.673607:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5374 00000100:00100000:3.0:1786002690.673627:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2410:x1872758531071104:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002690.676183:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969957 is committed 00000100:00100000:3.0:1786002690.676326:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2410:x1872758531071104:12345-192.168.203.49@tcp:16:bash.0 Request processed in 2707us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.676336:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5374 00000100:00100000:1.0:1786002690.680562:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.680655:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531071360 00000100:00100000:2.0:1786002690.680664:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531071360 00000100:00100000:2.0:1786002690.680718:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5263 00000100:00100000:2.0:1786002690.680728:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+69:22233:x1872758531071360:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:2.0:1786002690.681317:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968678 00000100:00100000:2.0:1786002690.681451:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+71:22233:x1872758531071360:12345-192.168.203.49@tcp:35:bash.0 Request processed in 723us (896us total) trans 4294968679 rc 0/0 00000100:00100000:2.0:1786002690.681460:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5263 00000020:00080000:2.0:1786002690.681465:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002690.685243:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.685335:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531071616 00000100:00100000:3.0:1786002690.685343:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531071616 00000100:00100000:3.0:1786002690.685431:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24285 00000100:00100000:3.0:1786002690.685442:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+71:22233:x1872758531071616:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.685462:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.685500:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578417928 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2c4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.685599:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6000/0x7cee4af57841792f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.685612:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6000/0x7cee4af57841792f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.685633:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6000/0x7cee4af57841792f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002690.685644:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ad:0x0]: returning size 0 00010000:00010000:3.0:1786002690.685729:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578417928 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2c4 expref: 74 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.685753:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6000/0x7cee4af57841792f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2c4 expref: 73 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.685762:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9ed245735600) 00010000:00010000:3.0:1786002690.685765:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002690.685768:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca6000, rc 0) 00000100:00100000:3.0:1786002690.685825:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:22233:x1872758531071616:12345-192.168.203.49@tcp:101:bash.0 Request processed in 385us (589us total) trans 4294968680 rc 0/0 00000100:00100000:3.0:1786002690.685832:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24285 00000100:00100000:0.0:1786002690.691284:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.691506:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531071744 00000100:00100000:3.0:1786002690.691514:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531071744 00000100:00100000:3.0:1786002690.691574:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1535 00000100:00100000:3.0:1786002690.691585:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:2413:x1872758531071744:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002690.691602:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002690.691635:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6000/0x7cee4af57841792f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2c4 expref: 73 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.691652:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9ed245735600) 00010000:00010000:3.0:1786002690.691657:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002690.691710:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+72:2413:x1872758531071744:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 127us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.691717:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1535 00000100:00100000:1.0:1786002690.692321:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.692653:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531071872 00000100:00100000:0.0:1786002690.692658:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531071872 00000100:00100000:0.0:1786002690.692722:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5375 00000100:00100000:0.0:1786002690.692731:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+11:22233:x1872758531071872:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002690.692744:0:14686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002690.692763:0:14686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffbe672e/0x7cee4af57841793d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2cb expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002690.692786:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002690.692803:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:0.0:1786002690.692807:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002690.692826:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffbe672e/0x7cee4af57841793d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2cb expref: 12 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.692842:0:14686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffbe672e/0x7cee4af57841793d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2cb expref: 12 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.692869:0:14686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245716000, rc 0) 00000100:00100000:0.0:1786002690.692912:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:22233:x1872758531071872:12345-192.168.203.49@tcp:101:bash.0 Request processed in 182us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.692918:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5375 00000100:00100000:1.0:1786002690.700135:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.700675:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531072000 00000100:00100000:3.0:1786002690.700685:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531072000 00000100:00100000:3.0:1786002690.700754:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24286 00000100:00100000:3.0:1786002690.701010:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+72:22233:x1872758531072000:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.701035:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002690.701150:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af578417944 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2d2 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.701188:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af57841794b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.701201:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af57841794b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.701211:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af57841794b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.701315:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717c00/0x7cee4af578417944 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2d2 expref: 74 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.701331:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717200/0x7cee4af57841794b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2d2 expref: 73 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.701339:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9ed245735600) 00010000:00010000:0.0:1786002690.701342:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786002690.701345:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717200, rc 0) 00000100:00100000:0.0:1786002690.701395:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:22233:x1872758531072000:12345-192.168.203.49@tcp:101:bash.0 Request processed in 632us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.701401:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24286 00000100:00100000:1.0:1786002690.708015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.708087:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531072128 00000100:00100000:0.0:1786002690.708097:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531072128 00002000:00100000:0.0:1786002690.708152:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->6) req@ffff9ed2467f0380 x1872758531072128/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.708164:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2467f0380 with x1872758531072128 ext(0->6) 00002000:00010000:0.0:1786002690.708171:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2467f0380 00000100:00100000:0.0:1786002690.708201:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 53 00000100:00100000:0.0:1786002690.708211:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2467f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2412:x1872758531072128:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002690.709399:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2467f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2412:x1872758531072128:12345-192.168.203.49@tcp:4:bash.0 Request processed in 1185us (1388us total) trans 4294969980 rc 0/0 00000100:00100000:0.0:1786002690.709408:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 53 00002000:00100000:0.0:1786002690.709415:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x8:0x0] (0->6) req@ffff9ed2467f0380 x1872758531072128/t4294969980(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.709425:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2467f0380 with x1872758531072128 ext(0->6) 00002000:00010000:0.0:1786002690.709429:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2467f0380 00000100:00100000:2.0:1786002690.712941:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.713119:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531072256 00000100:00100000:0.0:1786002690.713127:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531072256 00000100:00100000:0.0:1786002690.713190:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5376 00000100:00100000:0.0:1786002690.713200:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2413:x1872758531072256:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:2.0:1786002690.714752:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969980 is committed 00000100:00100000:0.0:1786002690.714921:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:2413:x1872758531072256:12345-192.168.203.49@tcp:16:bash.0 Request processed in 1720us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.714931:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5376 00000100:00100000:1.0:1786002690.717590:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.717682:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531072512 00000100:00100000:0.0:1786002690.717689:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531072512 00000100:00100000:0.0:1786002690.717771:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5264 00000100:00100000:0.0:1786002690.717782:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:22233:x1872758531072512:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:0.0:1786002690.718018:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968681 00000100:00100000:0.0:1786002690.718111:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+75:22233:x1872758531072512:12345-192.168.203.49@tcp:35:bash.0 Request processed in 331us (526us total) trans 4294968682 rc 0/0 00000100:00100000:0.0:1786002690.718119:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5264 00000020:00080000:0.0:1786002690.718124:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002690.721211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.721313:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531072768 00000100:00100000:2.0:1786002690.721321:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531072768 00000100:00100000:2.0:1786002690.721373:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24287 00000100:00100000:2.0:1786002690.721384:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+75:22233:x1872758531072768:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002690.721405:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002690.721426:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417952 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2d9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.721531:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af578417959 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.721545:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af578417959 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.721557:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af578417959 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002690.721572:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 0 00010000:00010000:2.0:1786002690.721671:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417952 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2d9 expref: 78 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.721692:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af578417959 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2d9 expref: 77 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.721700:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9ed245735500) 00010000:00010000:2.0:1786002690.721703:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002690.721707:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed2800, rc 0) 00000100:00100000:2.0:1786002690.721792:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+77:22233:x1872758531072768:12345-192.168.203.49@tcp:101:bash.0 Request processed in 410us (588us total) trans 4294968683 rc 0/0 00000100:00100000:2.0:1786002690.721800:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24287 00000100:00100000:2.0:1786002690.726248:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.726318:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531072896 00000100:00100000:1.0:1786002690.726327:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531072896 00000100:00100000:1.0:1786002690.726374:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5377 00000100:00100000:1.0:1786002690.726384:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:22233:x1872758531072896:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002690.726399:0:14685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002690.726416:0:14685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578417967 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2e0 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002690.726437:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002690.726454:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:1.0:1786002690.726459:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002690.726476:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578417967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2e0 expref: 13 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.726492:0:14685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c94fe4e/0x7cee4af578417967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2e0 expref: 13 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002690.726504:0:14685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999c00, rc 0) 00000100:00100000:1.0:1786002690.726556:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:22233:x1872758531072896:12345-192.168.203.49@tcp:101:bash.0 Request processed in 173us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002690.726562:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5377 00000100:00100000:1.0:1786002690.730191:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.730263:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531073024 00000100:00100000:2.0:1786002690.730271:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531073024 00000100:00100000:2.0:1786002690.730327:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1536 00000100:00100000:2.0:1786002690.730337:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+77:2411:x1872758531073024:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002690.730350:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002690.730373:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af578417959 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2d9 expref: 77 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.730390:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9ed245735500) 00010000:00010000:2.0:1786002690.730394:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002690.730441:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+76:2411:x1872758531073024:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 106us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.730452:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1536 00000100:00100000:0.0:1786002690.731520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.732263:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531073152 00000100:00100000:3.0:1786002690.732268:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531073152 00000100:00100000:3.0:1786002690.732326:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24288 00000100:00100000:3.0:1786002690.732333:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+76:22233:x1872758531073152:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.732348:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.732362:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6000/0x7cee4af57841796e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2e7 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.732385:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7c00/0x7cee4af578417975 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.732394:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7c00/0x7cee4af578417975 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.732401:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7c00/0x7cee4af578417975 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.732504:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6000/0x7cee4af57841796e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2e7 expref: 78 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.732518:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7c00/0x7cee4af578417975 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2e7 expref: 77 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.732526:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9ed245735500) 00010000:00010000:3.0:1786002690.732529:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786002690.732531:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca7c00, rc 0) 00000100:00100000:3.0:1786002690.732568:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+77:22233:x1872758531073152:12345-192.168.203.49@tcp:101:bash.0 Request processed in 235us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.732575:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24288 00000100:00100000:0.0:1786002690.737935:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.738071:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531073280 00000100:00100000:3.0:1786002690.738080:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531073280 00002000:00100000:3.0:1786002690.738123:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x8:0x0] (0->6) req@ffff9ed37f3a0700 x1872758531073280/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002690.738135:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a0700 with x1872758531073280 ext(0->6) 00002000:00010000:3.0:1786002690.738196:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f3a0700 00000100:00100000:3.0:1786002690.738266:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 54 00000100:00100000:3.0:1786002690.738276:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2412:x1872758531073280:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002690.739285:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2412:x1872758531073280:12345-192.168.203.49@tcp:4:bash.0 Request processed in 1007us (1356us total) trans 4294969958 rc 0/0 00000100:00100000:0.0:1786002690.739293:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 54 00002000:00100000:0.0:1786002690.739301:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x8:0x0] (0->6) req@ffff9ed37f3a0700 x1872758531073280/t4294969958(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.739310:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a0700 with x1872758531073280 ext(0->6) 00002000:00010000:0.0:1786002690.739314:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f3a0700 00000100:00100000:1.0:1786002690.742880:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.742966:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531073408 00000100:00100000:3.0:1786002690.742975:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531073408 00000100:00100000:3.0:1786002690.743024:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5378 00000100:00100000:3.0:1786002690.743033:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2410:x1872758531073408:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002690.744386:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969958 is committed 00000100:00100000:2.0:1786002690.746801:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2410:x1872758531073408:12345-192.168.203.49@tcp:16:bash.0 Request processed in 3761us (3945us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.746812:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5378 00000100:00100000:0.0:1786002690.749742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.749807:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531073664 00000100:00100000:2.0:1786002690.749815:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531073664 00000100:00100000:2.0:1786002690.749884:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5265 00000100:00100000:2.0:1786002690.749894:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+77:22233:x1872758531073664:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:2.0:1786002690.750098:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968684 00000100:00100000:2.0:1786002690.750387:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+79:22233:x1872758531073664:12345-192.168.203.49@tcp:35:bash.0 Request processed in 493us (648us total) trans 4294968685 rc 0/0 00000100:00100000:2.0:1786002690.750395:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5265 00000020:00080000:2.0:1786002690.750400:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002690.759017:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.759418:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531073920 00000100:00100000:0.0:1786002690.759427:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531073920 00000100:00100000:0.0:1786002690.759525:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24289 00000100:00100000:0.0:1786002690.759536:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+79:22233:x1872758531073920:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002690.759559:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002690.759580:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717600/0x7cee4af57841797c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2ee expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.759694:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717000/0x7cee4af578417983 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.759709:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717000/0x7cee4af578417983 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.759720:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717000/0x7cee4af578417983 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002690.759731:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1af:0x0]: returning size 0 00010000:00010000:0.0:1786002690.759826:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717600/0x7cee4af57841797c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2ee expref: 82 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.759903:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717000/0x7cee4af578417983 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2ee expref: 81 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.759912:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1af:0x0].0x0 (ffff9ed2456f9100) 00010000:00010000:0.0:1786002690.759916:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002690.759920:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717000, rc 0) 00000100:00100000:0.0:1786002690.759984:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+81:22233:x1872758531073920:12345-192.168.203.49@tcp:101:bash.0 Request processed in 449us (975us total) trans 4294968686 rc 0/0 00000100:00100000:0.0:1786002690.759991:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24289 00000100:00100000:1.0:1786002690.773543:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.773717:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531074048 00000100:00100000:3.0:1786002690.773728:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531074048 00000100:00100000:3.0:1786002690.773972:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1537 00000100:00100000:3.0:1786002690.773984:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af76050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+81:2411:x1872758531074048:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002690.774000:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002690.774023:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717000/0x7cee4af578417983 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2ee expref: 81 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.774042:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1af:0x0].0x0 (ffff9ed2456f9100) 00010000:00010000:3.0:1786002690.774048:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002690.774146:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af76050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+80:2411:x1872758531074048:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 156us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.774154:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1537 00000100:00100000:2.0:1786002690.781386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.781523:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531074176 00000100:00100000:3.0:1786002690.781532:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531074176 00000100:00100000:3.0:1786002690.781623:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5379 00000100:00100000:3.0:1786002690.781634:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+12:22233:x1872758531074176:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.781652:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.781672:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9f6fc85/0x7cee4af578417991 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2f5 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002690.781695:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002690.781715:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:3.0:1786002690.781719:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002690.781727:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9f6fc85/0x7cee4af578417991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2f5 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.781744:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9f6fc85/0x7cee4af578417991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2f5 expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.781756:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca6000, rc 0) 00000100:00100000:3.0:1786002690.781874:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:22233:x1872758531074176:12345-192.168.203.49@tcp:101:bash.0 Request processed in 213us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.781882:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5379 00000100:00100000:1.0:1786002690.784632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.784726:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531074304 00000100:00100000:2.0:1786002690.784734:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531074304 00000100:00100000:2.0:1786002690.784818:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24290 00000100:00100000:2.0:1786002690.784827:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+80:22233:x1872758531074304:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002690.784906:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002690.784925:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417998 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b2fc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.785010:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af57841799f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.785023:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af57841799f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.785036:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af57841799f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.785149:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3600/0x7cee4af578417998 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2fc expref: 82 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.785166:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2800/0x7cee4af57841799f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b2fc expref: 81 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.785174:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1af:0x0].0x0 (ffff9ed2456f9100) 00010000:00010000:2.0:1786002690.785177:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786002690.785181:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ed2800, rc 0) 00000100:00100000:2.0:1786002690.785262:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+81:22233:x1872758531074304:12345-192.168.203.49@tcp:101:bash.0 Request processed in 437us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.785270:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24290 00000100:00100000:1.0:1786002690.790279:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.790427:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531074432 00000100:00100000:0.0:1786002690.790434:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531074432 00002000:00100000:0.0:1786002690.790476:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9:0x0] (0->6) req@ffff9ed2457f1880 x1872758531074432/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.790487:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2457f1880 with x1872758531074432 ext(0->6) 00002000:00010000:0.0:1786002690.790493:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2457f1880 00000100:00100000:0.0:1786002690.790522:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 55 00000100:00100000:0.0:1786002690.790531:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2413:x1872758531074432:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002690.791304:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2413:x1872758531074432:12345-192.168.203.49@tcp:4:bash.0 Request processed in 773us (1030us total) trans 4294969981 rc 0/0 00000100:00100000:0.0:1786002690.791313:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 55 00002000:00100000:0.0:1786002690.791320:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9:0x0] (0->6) req@ffff9ed2457f1880 x1872758531074432/t4294969981(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.791328:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2457f1880 with x1872758531074432 ext(0->6) 00002000:00010000:0.0:1786002690.791333:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2457f1880 00000100:00100000:0.0:1786002690.795162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.795273:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531074560 00000100:00100000:3.0:1786002690.795281:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531074560 00000100:00100000:3.0:1786002690.795337:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5380 00000100:00100000:3.0:1786002690.795347:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2410:x1872758531074560:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:2.0:1786002690.796718:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969981 is committed 00000100:00100000:3.0:1786002690.796878:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:2410:x1872758531074560:12345-192.168.203.49@tcp:16:bash.0 Request processed in 1500us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.796888:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5380 00000100:00100000:2.0:1786002690.799722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.799806:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531074816 00000100:00100000:0.0:1786002690.799816:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531074816 00000100:00100000:0.0:1786002690.799891:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5266 00000100:00100000:0.0:1786002690.799903:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+81:22233:x1872758531074816:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:0.0:1786002690.800117:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968687 00000100:00100000:0.0:1786002690.800230:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+83:22233:x1872758531074816:12345-192.168.203.49@tcp:35:bash.0 Request processed in 329us (515us total) trans 4294968688 rc 0/0 00000100:00100000:0.0:1786002690.800238:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5266 00000020:00080000:0.0:1786002690.800242:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002690.803708:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.803791:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531075072 00000100:00100000:3.0:1786002690.803801:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531075072 00000100:00100000:3.0:1786002690.803888:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24291 00000100:00100000:3.0:1786002690.803898:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+83:22233:x1872758531075072:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.803918:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.803937:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6200/0x7cee4af5784179a6 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b303 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.804060:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7e00/0x7cee4af5784179ad lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.804074:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7e00/0x7cee4af5784179ad lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.804084:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7e00/0x7cee4af5784179ad lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002690.804094:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b0:0x0]: returning size 0 00010000:00010000:3.0:1786002690.804195:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6200/0x7cee4af5784179a6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b303 expref: 86 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.804218:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7e00/0x7cee4af5784179ad lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b303 expref: 85 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.804232:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b0:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:3.0:1786002690.804234:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002690.804238:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca7e00, rc 0) 00000100:00100000:3.0:1786002690.804335:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+85:22233:x1872758531075072:12345-192.168.203.49@tcp:101:bash.0 Request processed in 439us (635us total) trans 4294968689 rc 0/0 00000100:00100000:3.0:1786002690.804342:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24291 00000100:00100000:1.0:1786002690.808028:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.808145:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531075200 00000100:00100000:2.0:1786002690.808154:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531075200 00000100:00100000:2.0:1786002690.808208:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1538 00000100:00100000:2.0:1786002690.808216:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+85:2413:x1872758531075200:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002690.808230:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002690.808251:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7e00/0x7cee4af5784179ad lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b303 expref: 85 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.808266:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b0:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:2.0:1786002690.808271:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002690.808323:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+84:2413:x1872758531075200:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 107us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002690.808330:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1538 00000100:00100000:2.0:1786002690.809508:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.809573:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531075328 00000100:00100000:0.0:1786002690.809578:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531075328 00000100:00100000:0.0:1786002690.809632:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5381 00000100:00100000:0.0:1786002690.809640:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:22233:x1872758531075328:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002690.809654:0:14686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002690.809671:0:14686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af5784179bb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b30a expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786002690.809691:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1786002690.809708:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9:0x0].0x0 since=1050s v=(0 0) 00010000:00010000:0.0:1786002690.809713:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786002690.809720:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af5784179bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b30a expref: 14 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.809734:0:14686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000622d015e/0x7cee4af5784179bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b30a expref: 14 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.809750:0:14686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717c00, rc 0) 00000100:00100000:0.0:1786002690.809795:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:22233:x1872758531075328:12345-192.168.203.49@tcp:101:bash.0 Request processed in 156us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.809801:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5381 00000100:00100000:1.0:1786002690.824702:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.824775:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531075456 00000100:00100000:0.0:1786002690.824784:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531075456 00000100:00100000:0.0:1786002690.824841:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24292 00000100:00100000:0.0:1786002690.824877:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+84:22233:x1872758531075456:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002690.824898:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002690.824917:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717600/0x7cee4af5784179c2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b311 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.824949:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717000/0x7cee4af5784179c9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.825087:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717000/0x7cee4af5784179c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.825101:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717000/0x7cee4af5784179c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.825203:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717600/0x7cee4af5784179c2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b311 expref: 86 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.825216:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717000/0x7cee4af5784179c9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b311 expref: 85 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.825226:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b0:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:0.0:1786002690.825228:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786002690.825230:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245717000, rc 0) 00000100:00100000:0.0:1786002690.825308:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+85:22233:x1872758531075456:12345-192.168.203.49@tcp:101:bash.0 Request processed in 461us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.825313:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24292 00000100:00100000:3.0:1786002690.832473:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.832642:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531075584 00000100:00100000:0.0:1786002690.832651:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531075584 00002000:00100000:0.0:1786002690.832703:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x9:0x0] (0->6) req@ffff9ed244ecc700 x1872758531075584/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/0 e 0 to 0 dl 1786002701 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.832713:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ecc700 with x1872758531075584 ext(0->6) 00002000:00010000:0.0:1786002690.832718:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed244ecc700 00000100:00100000:0.0:1786002690.832743:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 56 00000100:00100000:0.0:1786002690.832752:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2410:x1872758531075584:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:0.0:1786002690.834675:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2410:x1872758531075584:12345-192.168.203.49@tcp:4:bash.0 Request processed in 1918us (2202us total) trans 4294969959 rc 0/0 00000100:00100000:0.0:1786002690.834685:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 56 00002000:00100000:0.0:1786002690.834693:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x9:0x0] (0->6) req@ffff9ed244ecc700 x1872758531075584/t4294969959(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:371/0 lens 496/448 e 0 to 0 dl 1786002701 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002690.834702:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ecc700 with x1872758531075584 ext(0->6) 00002000:00010000:0.0:1786002690.834706:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed244ecc700 00000100:00100000:2.0:1786002690.858068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.858409:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531075712 00000100:00100000:0.0:1786002690.858418:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531075712 00000100:00100000:0.0:1786002690.858481:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5382 00000100:00100000:0.0:1786002690.858491:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531075712:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002690.870947:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969959 is committed 00000100:00100000:0.0:1786002690.877701:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2413:x1872758531075712:12345-192.168.203.49@tcp:16:bash.0 Request processed in 19201us (19640us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.877715:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5382 00000100:00100000:1.0:1786002690.883318:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002690.883780:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531075968 00000100:00100000:3.0:1786002690.883788:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531075968 00000100:00100000:3.0:1786002690.883843:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5267 00000100:00100000:3.0:1786002690.883891:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+85:22233:x1872758531075968:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:2.0:1786002690.887745:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968690 00000100:00100000:2.0:1786002690.887948:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+87:22233:x1872758531075968:12345-192.168.203.49@tcp:35:bash.0 Request processed in 4055us (4632us total) trans 4294968691 rc 0/0 00000100:00100000:2.0:1786002690.887966:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5267 00000020:00080000:2.0:1786002690.887971:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002690.932000:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002690.932093:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531076224 00000100:00100000:2.0:1786002690.932101:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531076224 00000100:00100000:2.0:1786002690.932159:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24293 00000100:00100000:2.0:1786002690.932168:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+87:22233:x1872758531076224:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002690.932190:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002690.932210:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784179d0 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b318 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.932307:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af5784179d7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.932320:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af5784179d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.932330:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af5784179d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002690.932339:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b1:0x0]: returning size 0 00010000:00010000:2.0:1786002690.932429:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784179d0 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b318 expref: 90 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.932460:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af5784179d7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b318 expref: 89 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002690.932469:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b1:0x0].0x0 (ffff9ed245644900) 00010000:00010000:2.0:1786002690.932471:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002690.932475:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2cc00, rc 0) 00000100:00100000:2.0:1786002690.932528:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+89:22233:x1872758531076224:12345-192.168.203.49@tcp:101:bash.0 Request processed in 361us (536us total) trans 4294968692 rc 0/0 00000100:00100000:2.0:1786002690.932535:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24293 00000100:00100000:1.0:1786002690.946498:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002690.946533:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.946653:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531076480 00000100:00100000:0.0:1786002690.946663:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531076480 00000100:00100000:0.0:1786002690.946724:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1539 00000100:00100000:0.0:1786002690.946734:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+89:2413:x1872758531076480:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002690.946749:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002690.946770:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af5784179d7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b318 expref: 89 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.946787:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b1:0x0].0x0 (ffff9ed245644900) 00010000:00010000:0.0:1786002690.946791:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002690.946881:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+88:2413:x1872758531076480:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 148us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.946887:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1539 00000100:00100000:3.0:1786002690.948002:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531076352 00000100:00100000:3.0:1786002690.948007:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531076352 00000100:00100000:3.0:1786002690.948044:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5383 00000100:00100000:3.0:1786002690.948059:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+13:22233:x1872758531076352:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002690.948071:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002690.948094:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009071fc17/0x7cee4af5784179e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b31f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002690.948115:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002690.948142:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=1051s v=(0 0) 00010000:00010000:3.0:1786002690.948146:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002690.948153:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009071fc17/0x7cee4af5784179e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b31f expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.948169:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009071fc17/0x7cee4af5784179e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b31f expref: 14 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002690.948179:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca6200, rc 0) 00000100:00100000:3.0:1786002690.948204:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:22233:x1872758531076352:12345-192.168.203.49@tcp:101:bash.0 Request processed in 154us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002690.948210:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5383 00000100:00100000:1.0:1786002690.982252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002690.982415:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531076608 00000100:00100000:0.0:1786002690.982425:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531076608 00000100:00100000:0.0:1786002690.982481:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24294 00000100:00100000:0.0:1786002690.982490:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+88:22233:x1872758531076608:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002690.982513:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002690.982532:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717600/0x7cee4af5784179ec lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b326 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.982563:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784179f3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.982577:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784179f3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.982587:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784179f3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.982717:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717600/0x7cee4af5784179ec lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b326 expref: 90 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.982736:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34800/0x7cee4af5784179f3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b326 expref: 89 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002690.982745:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b1:0x0].0x0 (ffff9ed245644900) 00010000:00010000:0.0:1786002690.982748:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786002690.982751:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34800, rc 0) 00000100:00100000:0.0:1786002690.982808:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+89:22233:x1872758531076608:12345-192.168.203.49@tcp:101:bash.0 Request processed in 318us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002690.982815:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24294 00000100:00100000:1.0:1786002691.018931:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002691.019020:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531076736 00000100:00100000:3.0:1786002691.019029:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531076736 00002000:00100000:3.0:1786002691.019074:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa:0x0] (0->6) req@ffff9ed37f4dc380 x1872758531076736/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 496/0 e 0 to 0 dl 1786002702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002691.019096:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f4dc380 with x1872758531076736 ext(0->6) 00002000:00010000:3.0:1786002691.019102:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f4dc380 00000100:00100000:3.0:1786002691.019132:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 57 00000100:00100000:3.0:1786002691.019149:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2410:x1872758531076736:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:3.0:1786002691.020415:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2410:x1872758531076736:12345-192.168.203.49@tcp:4:bash.0 Request processed in 1272us (1491us total) trans 4294969982 rc 0/0 00000100:00100000:3.0:1786002691.020424:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 57 00002000:00100000:3.0:1786002691.020430:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa:0x0] (0->6) req@ffff9ed37f4dc380 x1872758531076736/t4294969982(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 496/448 e 0 to 0 dl 1786002702 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002691.020438:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f4dc380 with x1872758531076736 ext(0->6) 00002000:00010000:3.0:1786002691.020442:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f4dc380 00000100:00100000:2.0:1786002691.026371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002691.026551:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531076864 00000100:00100000:3.0:1786002691.026559:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531076864 00000100:00100000:3.0:1786002691.026628:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5384 00000100:00100000:3.0:1786002691.026638:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531076864:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002691.032780:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969982 is committed 00000100:00100000:3.0:1786002691.032998:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:2412:x1872758531076864:12345-192.168.203.49@tcp:16:bash.0 Request processed in 6357us (6629us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002691.033009:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5384 00010000:00010000:3.0:1786002691.051983:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002691.053225:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.053300:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531077120 00000100:00100000:2.0:1786002691.053309:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531077120 00000100:00100000:2.0:1786002691.053369:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5268 00000100:00100000:2.0:1786002691.053379:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+89:22233:x1872758531077120:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:2.0:1786002691.053559:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968693 00000100:00100000:2.0:1786002691.053670:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+91:22233:x1872758531077120:12345-192.168.203.49@tcp:35:bash.0 Request processed in 292us (449us total) trans 4294968694 rc 0/0 00000100:00100000:2.0:1786002691.053677:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5268 00000020:00080000:2.0:1786002691.053682:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1786002691.054253:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002691.057529:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002691.057607:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531077376 00000100:00100000:0.0:1786002691.057620:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531077376 00000100:00100000:0.0:1786002691.057671:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24295 00000100:00100000:0.0:1786002691.057681:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+91:22233:x1872758531077376:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002691.057698:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002691.057718:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784179fa lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b32d expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.057806:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417a01 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.057818:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417a01 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.057828:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417a01 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002691.057838:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b2:0x0]: returning size 0 00010000:00010000:0.0:1786002691.057971:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784179fa lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b32d expref: 94 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.057992:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417a01 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b32d expref: 93 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.058001:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b2:0x0].0x0 (ffff9ed245644200) 00010000:00010000:0.0:1786002691.058004:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002691.058008:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34c00, rc 0) 00000100:00100000:0.0:1786002691.058047:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+93:22233:x1872758531077376:12345-192.168.203.49@tcp:101:bash.0 Request processed in 368us (524us total) trans 4294968695 rc 0/0 00000100:00100000:0.0:1786002691.058054:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24295 00000100:00100000:3.0:1786002691.063766:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.063886:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531077504 00000100:00100000:2.0:1786002691.063894:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531077504 00000100:00100000:2.0:1786002691.063961:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1540 00000100:00100000:2.0:1786002691.063972:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+93:2412:x1872758531077504:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002691.063987:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002691.064009:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417a01 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b32d expref: 93 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.064026:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b2:0x0].0x0 (ffff9ed245644200) 00010000:00010000:2.0:1786002691.064031:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002691.064071:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+92:2412:x1872758531077504:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 101us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002691.064079:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1540 00000100:00100000:1.0:1786002691.116367:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002691.116490:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531077632 00000100:00100000:3.0:1786002691.116500:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531077632 00000100:00100000:3.0:1786002691.116564:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5385 00000100:00100000:3.0:1786002691.116575:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:22233:x1872758531077632:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002691.116601:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002691.116627:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050d557bd/0x7cee4af578417a0f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b334 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002691.116652:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002691.116674:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=1051s v=(0 0) 00010000:00010000:3.0:1786002691.116678:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002691.116687:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050d557bd/0x7cee4af578417a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b334 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.116703:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050d557bd/0x7cee4af578417a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b334 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.116716:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca7400, rc 0) 00000100:00100000:3.0:1786002691.116771:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22233:x1872758531077632:12345-192.168.203.49@tcp:101:bash.0 Request processed in 198us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002691.116778:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5385 00000100:00080000:0.0:1786002691.117268:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002691.122811:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002691.123025:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531077760 00000100:00100000:3.0:1786002691.123036:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531077760 00000100:00100000:3.0:1786002691.123104:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24296 00000100:00100000:3.0:1786002691.123114:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+92:22233:x1872758531077760:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002691.123147:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002691.123166:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417a16 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b33b expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.123198:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7a00/0x7cee4af578417a1d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.123212:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7a00/0x7cee4af578417a1d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.123222:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7a00/0x7cee4af578417a1d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.123332:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417a16 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b33b expref: 94 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.123349:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7a00/0x7cee4af578417a1d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b33b expref: 93 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.123358:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b2:0x0].0x0 (ffff9ed245644200) 00010000:00010000:3.0:1786002691.123361:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786002691.123364:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca7a00, rc 0) 00000100:00100000:3.0:1786002691.123420:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+93:22233:x1872758531077760:12345-192.168.203.49@tcp:101:bash.0 Request processed in 308us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002691.123427:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24296 00000100:00100000:2.0:1786002691.142677:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002691.143165:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531077888 00000100:00100000:3.0:1786002691.143173:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531077888 00002000:00100000:3.0:1786002691.143220:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xa:0x0] (0->6) req@ffff9ed37137fb80 x1872758531077888/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 496/0 e 0 to 0 dl 1786002702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002691.143232:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37137fb80 with x1872758531077888 ext(0->6) 00002000:00010000:3.0:1786002691.143237:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37137fb80 00000100:00100000:3.0:1786002691.143259:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 58 00000100:00100000:3.0:1786002691.143268:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2411:x1872758531077888:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:3.0:1786002691.150016:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531077888:12345-192.168.203.49@tcp:4:bash.0 Request processed in 6740us (7339us total) trans 4294969960 rc 0/0 00000100:00100000:3.0:1786002691.150029:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 58 00002000:00100000:3.0:1786002691.150040:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xa:0x0] (0->6) req@ffff9ed37137fb80 x1872758531077888/t4294969960(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 496/448 e 0 to 0 dl 1786002702 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002691.150057:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37137fb80 with x1872758531077888 ext(0->6) 00002000:00010000:3.0:1786002691.150063:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37137fb80 00000100:00100000:1.0:1786002691.172720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002691.172819:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531078016 00000100:00100000:3.0:1786002691.172839:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531078016 00000100:00100000:3.0:1786002691.172947:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5386 00000100:00100000:3.0:1786002691.172968:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531078016:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002691.176008:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969960 is committed 00000100:00100000:3.0:1786002691.176340:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2411:x1872758531078016:12345-192.168.203.49@tcp:16:bash.0 Request processed in 3377us (3637us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002691.176353:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5386 00000100:00100000:1.0:1786002691.188319:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.189805:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531078272 00000100:00100000:2.0:1786002691.189820:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531078272 00000100:00100000:2.0:1786002691.190167:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5269 00000100:00100000:2.0:1786002691.190178:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+93:22233:x1872758531078272:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:2.0:1786002691.192302:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968696 00000100:00100000:2.0:1786002691.193775:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+95:22233:x1872758531078272:12345-192.168.203.49@tcp:35:bash.0 Request processed in 3581us (5453us total) trans 4294968697 rc 0/0 00000100:00100000:2.0:1786002691.193789:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5269 00000020:00080000:2.0:1786002691.193798:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002691.209183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.210153:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531078528 00000100:00100000:1.0:1786002691.210165:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531078528 00000100:00100000:1.0:1786002691.210244:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24297 00000100:00100000:1.0:1786002691.210257:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+95:22233:x1872758531078528:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002691.210287:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002691.210316:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af578417a24 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b342 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.211230:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417a2b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.211249:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417a2b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.211263:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417a2b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002691.211278:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b3:0x0]: returning size 0 00010000:00010000:1.0:1786002691.211407:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af578417a24 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b342 expref: 98 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.211537:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417a2b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b342 expref: 97 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.211548:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b3:0x0].0x0 (ffff9ed245735200) 00010000:00010000:1.0:1786002691.211552:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002691.211557:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998a00, rc 0) 00000100:00100000:1.0:1786002691.211815:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+97:22233:x1872758531078528:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1559us (2643us total) trans 4294968698 rc 0/0 00000100:00100000:1.0:1786002691.211824:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24297 00000100:00100000:1.0:1786002691.239332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.239381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.239460:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531078784 00000100:00100000:2.0:1786002691.239478:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531078784 00000100:00100000:2.0:1786002691.239550:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5387 00000100:00100000:2.0:1786002691.239562:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+14:22233:x1872758531078784:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002691.239596:0:14691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002691.239629:0:14691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4ad937b/0x7cee4af578417a39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b349 expref: -99 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002691.239670:0:14691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002691.239698:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=1051s v=(0 0) 00010000:00010000:2.0:1786002691.239703:0:14691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002691.239714:0:14691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4ad937b/0x7cee4af578417a39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b349 expref: 15 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.239733:0:14691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4ad937b/0x7cee4af578417a39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b349 expref: 15 pid: 14691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.239748:0:14691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2d600, rc 0) 00000100:00100000:2.0:1786002691.239819:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22233:x1872758531078784:12345-192.168.203.49@tcp:101:bash.0 Request processed in 259us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002691.239833:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5387 00000100:00100000:0.0:1786002691.240034:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531078656 00000100:00100000:0.0:1786002691.240039:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531078656 00000100:00100000:0.0:1786002691.240080:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1541 00000100:00100000:0.0:1786002691.240088:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+97:2411:x1872758531078656:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002691.240102:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002691.240124:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417a2b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b342 expref: 97 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.240141:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b3:0x0].0x0 (ffff9ed245735200) 00010000:00010000:0.0:1786002691.240146:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002691.240166:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+96:2411:x1872758531078656:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 80us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002691.240173:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1541 00000100:00100000:2.0:1786002691.251841:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.251994:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531078912 00000100:00100000:1.0:1786002691.252006:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531078912 00000100:00100000:1.0:1786002691.252082:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24298 00000100:00100000:1.0:1786002691.252094:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+96:22233:x1872758531078912:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002691.252125:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002691.252162:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af578417a40 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b350 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.252202:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999200/0x7cee4af578417a47 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.252216:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999200/0x7cee4af578417a47 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.252228:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999200/0x7cee4af578417a47 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.252368:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998e00/0x7cee4af578417a40 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b350 expref: 98 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.252390:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999200/0x7cee4af578417a47 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b350 expref: 97 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.252398:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b3:0x0].0x0 (ffff9ed245735200) 00010000:00010000:1.0:1786002691.252401:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786002691.252405:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999200, rc 0) 00000100:00100000:1.0:1786002691.252804:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+97:22233:x1872758531078912:12345-192.168.203.49@tcp:101:bash.0 Request processed in 710us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002691.252812:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24298 00000100:00100000:3.0:1786002691.272192:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.272394:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531079040 00000100:00100000:1.0:1786002691.272407:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531079040 00002000:00100000:1.0:1786002691.272465:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (0->6) req@ffff9ed245c42680 x1872758531079040/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 496/0 e 0 to 0 dl 1786002702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002691.272484:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245c42680 with x1872758531079040 ext(0->6) 00002000:00010000:1.0:1786002691.272491:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed245c42680 00000100:00100000:1.0:1786002691.272517:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 59 00000100:00100000:1.0:1786002691.272527:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2413:x1872758531079040:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:1.0:1786002691.274406:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531079040:12345-192.168.203.49@tcp:4:bash.0 Request processed in 1869us (2215us total) trans 4294969983 rc 0/0 00000100:00100000:1.0:1786002691.274420:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 59 00002000:00100000:1.0:1786002691.274434:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xb:0x0] (0->6) req@ffff9ed245c42680 x1872758531079040/t4294969983(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 496/448 e 0 to 0 dl 1786002702 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002691.274444:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245c42680 with x1872758531079040 ext(0->6) 00002000:00010000:1.0:1786002691.274450:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed245c42680 00000100:00100000:2.0:1786002691.292066:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002691.292282:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531079168 00000100:00100000:0.0:1786002691.292295:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531079168 00000100:00100000:0.0:1786002691.292361:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5388 00000100:00100000:0.0:1786002691.292372:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531079168:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002691.300662:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969983 is committed 00000100:00100000:0.0:1786002691.301022:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:2412:x1872758531079168:12345-192.168.203.49@tcp:16:bash.0 Request processed in 8643us (8961us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002691.301034:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5388 00000100:00100000:2.0:1786002691.309732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.311019:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531079424 00000100:00100000:1.0:1786002691.311033:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531079424 00000100:00100000:1.0:1786002691.311121:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5270 00000100:00100000:1.0:1786002691.311133:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+97:22233:x1872758531079424:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:1.0:1786002691.311550:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968699 00000100:00100000:1.0:1786002691.313358:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+99:22233:x1872758531079424:12345-192.168.203.49@tcp:35:bash.0 Request processed in 2218us (3630us total) trans 4294968700 rc 0/0 00000100:00100000:1.0:1786002691.313373:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5270 00000020:00080000:1.0:1786002691.313380:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002691.321152:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002691.325303:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531079680 00000100:00100000:0.0:1786002691.325320:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531079680 00000100:00100000:0.0:1786002691.325409:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24299 00000100:00100000:0.0:1786002691.325420:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+99:22233:x1872758531079680:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002691.325451:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002691.325478:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417a4e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b357 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.326045:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417a55 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.326068:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417a55 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.326081:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417a55 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002691.326094:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b4:0x0]: returning size 0 00010000:00010000:0.0:1786002691.326288:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417a4e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b357 expref: 102 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.326314:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417a55 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b357 expref: 101 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.326324:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b4:0x0].0x0 (ffff9ed245735400) 00010000:00010000:0.0:1786002691.326328:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002691.326332:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35e00, rc 0) 00000100:00100000:0.0:1786002691.326404:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+101:22233:x1872758531079680:12345-192.168.203.49@tcp:101:bash.0 Request processed in 985us (5279us total) trans 4294968701 rc 0/0 00000100:00100000:0.0:1786002691.326413:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24299 00000100:00100000:2.0:1786002691.342460:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.342511:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.342592:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531079808 00000100:00100000:1.0:1786002691.342603:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531079808 00000100:00100000:1.0:1786002691.342680:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5389 00000100:00100000:1.0:1786002691.342692:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22233:x1872758531079808:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002691.342715:0:14687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002691.342744:0:14687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578417a63 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b35e expref: -99 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002691.342776:0:14687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002691.342805:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb:0x0].0x0 since=1051s v=(0 0) 00010000:00010000:1.0:1786002691.342811:0:14687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002691.342820:0:14687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578417a63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b35e expref: 16 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.342840:0:14687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8195a3c/0x7cee4af578417a63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b35e expref: 16 pid: 14687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.343067:0:14687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998e00, rc 0) 00000100:00100000:1.0:1786002691.344058:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22233:x1872758531079808:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1361us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002691.344069:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5389 00000100:00100000:3.0:1786002691.344640:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531079936 00000100:00100000:3.0:1786002691.344649:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531079936 00000100:00100000:3.0:1786002691.344712:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1542 00000100:00100000:3.0:1786002691.344722:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+101:2411:x1872758531079936:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002691.344737:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002691.344766:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417a55 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b357 expref: 101 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.344788:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b4:0x0].0x0 (ffff9ed245735400) 00010000:00010000:3.0:1786002691.344793:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002691.344831:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+100:2411:x1872758531079936:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 111us (2319us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002691.344838:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1542 00000100:00100000:2.0:1786002691.360522:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.360627:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531080064 00000100:00100000:1.0:1786002691.360639:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531080064 00000100:00100000:1.0:1786002691.360724:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24300 00000100:00100000:1.0:1786002691.360736:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+100:22233:x1872758531080064:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002691.360767:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002691.360805:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417a6a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b365 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.360890:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999800/0x7cee4af578417a71 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.360908:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999800/0x7cee4af578417a71 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.360921:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999800/0x7cee4af578417a71 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.361506:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417a6a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b365 expref: 102 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.361528:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999800/0x7cee4af578417a71 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b365 expref: 101 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.361537:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b4:0x0].0x0 (ffff9ed245735400) 00010000:00010000:1.0:1786002691.361540:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786002691.361545:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999800, rc 0) 00000100:00100000:1.0:1786002691.361635:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+101:22233:x1872758531080064:12345-192.168.203.49@tcp:101:bash.0 Request processed in 900us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002691.361643:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24300 00000100:00100000:0.0:1786002691.374562:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002691.374919:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531080192 00000100:00100000:3.0:1786002691.374931:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531080192 00002000:00100000:3.0:1786002691.374998:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb:0x0] (0->6) req@ffff9ed37f3a3100 x1872758531080192/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 496/0 e 0 to 0 dl 1786002702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002691.375010:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a3100 with x1872758531080192 ext(0->6) 00002000:00010000:3.0:1786002691.375016:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f3a3100 00000100:00100000:3.0:1786002691.375049:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 60 00000100:00100000:3.0:1786002691.375060:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531080192:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:3.0:1786002691.380372:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2412:x1872758531080192:12345-192.168.203.49@tcp:4:bash.0 Request processed in 5299us (5809us total) trans 4294969961 rc 0/0 00000100:00100000:3.0:1786002691.380389:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 60 00002000:00100000:3.0:1786002691.380404:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb:0x0] (0->6) req@ffff9ed37f3a3100 x1872758531080192/t4294969961(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 496/448 e 0 to 0 dl 1786002702 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002691.380415:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a3100 with x1872758531080192 ext(0->6) 00002000:00010000:3.0:1786002691.380423:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f3a3100 00000100:00100000:3.0:1786002691.391351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.399243:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531080320 00000100:00100000:2.0:1786002691.399263:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531080320 00000100:00100000:2.0:1786002691.399425:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5390 00000100:00100000:2.0:1786002691.399438:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2410:x1872758531080320:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002691.407972:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969961 is committed 00000100:00100000:2.0:1786002691.408289:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2410:x1872758531080320:12345-192.168.203.49@tcp:16:bash.0 Request processed in 8845us (16941us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002691.408306:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5390 00000100:00100000:3.0:1786002691.420266:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002691.420431:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531080576 00000100:00100000:0.0:1786002691.420443:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531080576 00000100:00100000:0.0:1786002691.420511:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5271 00000100:00100000:0.0:1786002691.420522:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+101:22233:x1872758531080576:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:0.0:1786002691.420784:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968702 00000100:00100000:0.0:1786002691.420939:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+103:22233:x1872758531080576:12345-192.168.203.49@tcp:35:bash.0 Request processed in 418us (687us total) trans 4294968703 rc 0/0 00000100:00100000:0.0:1786002691.420960:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5271 00000020:00080000:0.0:1786002691.420966:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002691.434471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002691.434790:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531080832 00000100:00100000:3.0:1786002691.434804:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531080832 00000100:00100000:3.0:1786002691.434901:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24301 00000100:00100000:3.0:1786002691.434912:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+103:22233:x1872758531080832:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002691.434942:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002691.434980:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417a78 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b36c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.435122:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af578417a7f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.435150:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af578417a7f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.435163:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af578417a7f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002691.435176:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b5:0x0]: returning size 0 00010000:00010000:3.0:1786002691.435309:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417a78 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b36c expref: 106 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.435336:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af578417a7f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b36c expref: 105 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.435352:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b5:0x0].0x0 (ffff9ed2456aee00) 00010000:00010000:3.0:1786002691.435356:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002691.435361:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca6a00, rc 0) 00000100:00100000:3.0:1786002691.435434:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+105:22233:x1872758531080832:12345-192.168.203.49@tcp:101:bash.0 Request processed in 524us (976us total) trans 4294968704 rc 0/0 00000100:00100000:3.0:1786002691.435442:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24301 00000100:00100000:3.0:1786002691.455449:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002691.455526:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531080960 00000100:00100000:0.0:1786002691.455539:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531080960 00000100:00100000:0.0:1786002691.455632:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1543 00000100:00100000:0.0:1786002691.455645:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+105:2412:x1872758531080960:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002691.455665:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002691.455696:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af578417a7f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b36c expref: 105 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.455719:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b5:0x0].0x0 (ffff9ed2456aee00) 00010000:00010000:0.0:1786002691.455725:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002691.455795:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+104:2412:x1872758531080960:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 153us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002691.455803:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1543 00000100:00100000:1.0:1786002691.459663:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002691.462321:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531081088 00000100:00100000:3.0:1786002691.462339:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531081088 00000100:00100000:3.0:1786002691.462420:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5391 00000100:00100000:3.0:1786002691.462434:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+15:22233:x1872758531081088:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002691.462456:0:14678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002691.462483:0:14678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8bd2832/0x7cee4af578417a8d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b373 expref: -99 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002691.462513:0:14678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002691.462539:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=1051s v=(0 0) 00010000:00010000:3.0:1786002691.462544:0:14678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002691.462554:0:14678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8bd2832/0x7cee4af578417a8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b373 expref: 16 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.462573:0:14678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8bd2832/0x7cee4af578417a8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b373 expref: 16 pid: 14678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.462588:0:14678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca6400, rc 0) 00000100:00100000:3.0:1786002691.462690:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22233:x1872758531081088:12345-192.168.203.49@tcp:101:bash.0 Request processed in 259us (3038us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002691.462698:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5391 00000100:00100000:3.0:1786002691.496021:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.496180:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531081216 00000100:00100000:1.0:1786002691.496191:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531081216 00000100:00100000:1.0:1786002691.496268:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24302 00000100:00100000:1.0:1786002691.496279:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+104:22233:x1872758531081216:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002691.496312:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002691.496337:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999e00/0x7cee4af578417a94 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b37a expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.496377:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998800/0x7cee4af578417a9b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.496392:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998800/0x7cee4af578417a9b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.496406:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998800/0x7cee4af578417a9b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.496551:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999e00/0x7cee4af578417a94 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b37a expref: 106 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.496585:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998800/0x7cee4af578417a9b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b37a expref: 105 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.496595:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b5:0x0].0x0 (ffff9ed2456aee00) 00010000:00010000:1.0:1786002691.496599:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786002691.496603:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998800, rc 0) 00000100:00100000:1.0:1786002691.496682:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+105:22233:x1872758531081216:12345-192.168.203.49@tcp:101:bash.0 Request processed in 404us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002691.496689:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24302 00000100:00100000:2.0:1786002691.510670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.510787:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531081344 00000100:00100000:1.0:1786002691.510804:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531081344 00002000:00100000:1.0:1786002691.511039:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->6) req@ffff9ed37f47d500 x1872758531081344/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 496/0 e 0 to 0 dl 1786002702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002691.511060:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f47d500 with x1872758531081344 ext(0->6) 00002000:00010000:1.0:1786002691.511066:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f47d500 00000100:00100000:2.0:1786002691.512699:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 61 00000100:00100000:2.0:1786002691.512724:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2410:x1872758531081344:12345-192.168.203.49@tcp:4:bash.0 00000100:00100000:2.0:1786002691.521589:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2410:x1872758531081344:12345-192.168.203.49@tcp:4:bash.0 Request processed in 8853us (10904us total) trans 4294969984 rc 0/0 00000100:00100000:2.0:1786002691.521606:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 61 00002000:00100000:2.0:1786002691.521632:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc:0x0] (0->6) req@ffff9ed37f47d500 x1872758531081344/t4294969984(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 496/448 e 0 to 0 dl 1786002702 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002691.521643:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f47d500 with x1872758531081344 ext(0->6) 00002000:00010000:2.0:1786002691.521650:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f47d500 00000100:00100000:3.0:1786002691.529799:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.530122:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531081472 00000100:00100000:2.0:1786002691.530135:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531081472 00000100:00100000:2.0:1786002691.530215:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5392 00000100:00100000:2.0:1786002691.530228:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2413:x1872758531081472:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002691.531797:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969984 is committed 00000100:00100000:2.0:1786002691.532159:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531081472:12345-192.168.203.49@tcp:16:bash.0 Request processed in 1926us (2367us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002691.532171:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5392 00000100:00100000:3.0:1786002691.569594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.570206:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531081728 00000100:00100000:1.0:1786002691.570222:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531081728 00000100:00100000:1.0:1786002691.570301:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5272 00000100:00100000:1.0:1786002691.570312:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+105:22233:x1872758531081728:12345-192.168.203.49@tcp:35:bash.0 00000001:00080000:1.0:1786002691.570585:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968705 00000100:00100000:1.0:1786002691.570726:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+107:22233:x1872758531081728:12345-192.168.203.49@tcp:35:bash.0 Request processed in 414us (1139us total) trans 4294968706 rc 0/0 00000100:00100000:1.0:1786002691.570734:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5272 00000020:00080000:1.0:1786002691.570739:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002691.696289:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.696451:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531081984 00000100:00100000:2.0:1786002691.696463:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531081984 00000100:00100000:2.0:1786002691.696537:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24303 00000100:00100000:2.0:1786002691.696549:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+107:22404:x1872758531081984:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002691.696579:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002691.696618:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c400/0x7cee4af578417aa2 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b381 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.696768:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578417aa9 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.696784:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578417aa9 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.696797:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578417aa9 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.696812:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af578417ab0 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.696819:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af578417ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.696826:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af578417ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786002691.698530:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xc:0x0], index 1: 0 00010000:00010000:2.0:1786002691.698759:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417ab7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.698777:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417ab7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.698787:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417ab7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.698829:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578417aa9 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.698841:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578417aa9 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.698869:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578417aa9 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.700664:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578417aa9 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.700678:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002691.700684:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578417aa9 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.700692:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578417aa9 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.700709:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed243d0bb00) 00010000:00010000:2.0:1786002691.700713:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002691.700718:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578417aa9 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.700725:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578417aa9 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002691.700743:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5719988 reply state 000000002b8c5d0b transno 4294968707 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af578417ab0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.700755:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af578417ab0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.700761:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed243d0b000) 00010000:00010000:2.0:1786002691.700765:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002691.700769:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786002691.700820:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c400/0x7cee4af578417aa2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b381 expref: 110 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.700842:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b381 expref: 109 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.700886:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002691.700888:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002691.700891:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2d800, rc 0) 00000100:00100000:2.0:1786002691.701169:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+110:22404:x1872758531081984:12345-192.168.203.49@tcp:101:dd.0 Request processed in 4620us (4892us total) trans 4294968707 rc 0/0 00000100:00100000:2.0:1786002691.701190:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24303 00000100:00100000:3.0:1786002691.723138:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.723299:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531082112 00000100:00100000:1.0:1786002691.723312:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531082112 00000100:00100000:1.0:1786002691.723378:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5393 00000100:00100000:1.0:1786002691.723389:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22404:x1872758531082112:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002691.723410:0:14685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002691.723434:0:14685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578417ac5 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b388 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786002691.723463:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1786002691.723489:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc:0x0].0x0 since=1051s v=(0 0) 00010000:00010000:1.0:1786002691.723495:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786002691.723505:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578417ac5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b388 expref: 17 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.723530:0:14685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003dace9d1/0x7cee4af578417ac5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b388 expref: 17 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.723544:0:14685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999e00, rc 0) 00000100:00100000:1.0:1786002691.723631:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:22404:x1872758531082112:12345-192.168.203.49@tcp:101:dd.0 Request processed in 243us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002691.723638:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5393 00000100:00100000:0.0:1786002691.739011:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002691.739418:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531082240 00000100:00100000:3.0:1786002691.739433:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531082240 00002000:00100000:3.0:1786002691.739504:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f3a2680 x1872758531082240/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 8680/0 e 0 to 0 dl 1786002702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002691.739517:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a2680 with x1872758531082240 ext(0->8191) 00002000:00010000:3.0:1786002691.739524:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f3a2680 00000100:00100000:3.0:1786002691.739553:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 62 00000100:00100000:3.0:1786002691.739564:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531082240:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002691.741445:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531082240:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1871us (2438us total) trans 4294969962 rc 0/0 00000100:00100000:3.0:1786002691.741460:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 62 00002000:00100000:3.0:1786002691.741474:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f3a2680 x1872758531082240/t4294969962(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 8680/448 e 0 to 0 dl 1786002702 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002691.741485:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a2680 with x1872758531082240 ext(0->8191) 00002000:00010000:3.0:1786002691.741492:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f3a2680 00000100:00100000:2.0:1786002691.768677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002691.768780:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531082368 00000100:00100000:0.0:1786002691.768793:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531082368 00000100:00100000:0.0:1786002691.768908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24304 00000100:00100000:0.0:1786002691.768920:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+110:22404:x1872758531082368:12345-192.168.203.49@tcp:44:dd.0 00000001:00080000:2.0:1786002691.783515:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968707 is committed 00010000:00010000:0.0:1786002691.783717:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af578417ab0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.783730:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af578417ab0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.783744:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af578417ab0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.783750:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2de00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002691.783755:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af578417ab0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.783762:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af578417ab0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.783777:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed243d0b000) 00010000:00010000:0.0:1786002691.783781:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002691.783785:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af578417ab0 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002691.783792:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af578417ab0 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002691.789018:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:22404:x1872758531082368:12345-192.168.203.49@tcp:44:dd.0 Request processed in 20090us (20345us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002691.789030:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24304 00000100:00100000:0.0:1786002691.794181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.794322:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531082496 00000100:00100000:2.0:1786002691.794331:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531082496 00000100:00100000:2.0:1786002691.794376:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5394 00000100:00100000:2.0:1786002691.794386:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758531082496:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:3.0:1786002691.796510:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969962 is committed 00000100:00100000:2.0:1786002691.796797:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531082496:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2408us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002691.796809:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5394 00000100:00100000:0.0:1786002691.805140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.805271:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531082752 00000100:00100000:1.0:1786002691.805281:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531082752 00000100:00100000:1.0:1786002691.805342:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5273 00000100:00100000:1.0:1786002691.805352:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+48:22404:x1872758531082752:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002691.805685:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:22404:x1872758531082752:12345-192.168.203.49@tcp:35:dd.0 Request processed in 333us (562us total) trans 4294968708 rc 0/0 00000100:00100000:1.0:1786002691.805693:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5273 00000100:00100000:2.0:1786002691.841891:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.841988:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531083008 00000100:00100000:1.0:1786002691.841998:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531083008 00000100:00100000:1.0:1786002691.842057:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24305 00000100:00100000:1.0:1786002691.842068:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+49:22405:x1872758531083008:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002691.842090:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002691.842115:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417acc lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b38f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.842223:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.842236:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417ab7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b381 expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.842244:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 4/0,1 mode: --/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.842274:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b381 expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.842287:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417ab7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b381 expref: 50 pid: 6520 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002691.842302:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f4df800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758561085056:192.168.203.49@tcp:104: 00000100:00100000:1.0:1786002691.842383:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed245d58900 going to sleep for 11 seconds 00000100:00100000:1.0:1786002691.852196:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f4df800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6521:1872758561085056:192.168.203.49@tcp:104: 00010000:00010000:1.0:1786002691.852224:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002691.865930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002691.866326:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531083136 00000100:00100000:3.0:1786002691.866335:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531083136 00010000:00010000:3.0:1786002691.866372:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417ab7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b381 expref: 51 pid: 6520 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002691.866413:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1703 00000100:00100000:3.0:1786002691.866429:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af74050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+51:2413:x1872758531083136:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002691.866444:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002691.866451:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417ab7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b381 expref: 51 pid: 6520 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.866540:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b381 expref: 51 pid: 6520 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.866566:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417ab7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b381 expref: 51 pid: 6520 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.866581:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002691.866644:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.866655:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.866663:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002691.866694:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002691.866747:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af74050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+50:2413:x1872758531083136:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 320us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002691.866755:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1703 00010000:00010000:2.0:1786002691.866840:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.866874:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002691.866896:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:2.0:1786002691.867020:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417acc lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b38f expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.867038:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b38f expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.867044:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002691.867047:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786002691.867049:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998a00, rc 0) 00000100:00100000:2.0:1786002691.867070:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+50:22405:x1872758531083008:12345-192.168.203.49@tcp:101:dd.0 Request processed in 25006us (25226us total) trans 4294968709 rc 0/0 00000100:00100000:2.0:1786002691.867076:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24305 00000100:00100000:0.0:1786002691.876904:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.877006:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531083264 00000100:00100000:2.0:1786002691.877014:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531083264 00000100:00100000:2.0:1786002691.877063:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24306 00000100:00100000:2.0:1786002691.877072:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+50:22405:x1872758531083264:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002691.877093:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002691.877112:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c600/0x7cee4af578417ae1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b396 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.877174:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c600/0x7cee4af578417ae1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b396 expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.877194:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c600/0x7cee4af578417ae1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b396 expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002691.877213:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002691.877216:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786002691.877220:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2c600, rc 0) 00000100:00100000:2.0:1786002691.877274:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+51:22405:x1872758531083264:12345-192.168.203.49@tcp:101:dd.0 Request processed in 203us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002691.877280:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24306 00000100:00100000:0.0:1786002691.892760:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.892873:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531083392 00000100:00100000:1.0:1786002691.892882:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531083392 00000100:00100000:1.0:1786002691.892934:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24307 00000100:00100000:1.0:1786002691.892943:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+51:22405:x1872758531083392:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002691.892968:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002691.892987:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ae8 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b39d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.893016:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af578417aef lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.893027:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af578417aef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.893037:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af578417aef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.893145:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ae8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b39d expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.893161:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998200/0x7cee4af578417aef lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b39d expref: 52 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.893170:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002691.893173:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786002691.893176:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244998200, rc 0) 00000100:00100000:1.0:1786002691.893223:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+52:22405:x1872758531083392:12345-192.168.203.49@tcp:101:dd.0 Request processed in 281us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002691.893229:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24307 00000100:00100000:0.0:1786002691.913777:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.913880:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531083520 00000100:00100000:2.0:1786002691.913890:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531083520 00002000:00100000:2.0:1786002691.913932:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f692d80 x1872758531083520/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 8680/0 e 0 to 0 dl 1786002702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002691.913951:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f692d80 with x1872758531083520 ext(0->8191) 00002000:00010000:2.0:1786002691.913957:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f692d80 00000100:00100000:2.0:1786002691.913983:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 63 00000100:00100000:2.0:1786002691.913991:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531083520:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:2.0:1786002691.914794:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531083520:12345-192.168.203.49@tcp:4:dd.0 Request processed in 802us (1024us total) trans 4294969963 rc 0/0 00000100:00100000:2.0:1786002691.914803:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 63 00002000:00100000:2.0:1786002691.914810:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f692d80 x1872758531083520/t4294969963(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:372/0 lens 8680/448 e 0 to 0 dl 1786002702 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002691.914818:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f692d80 with x1872758531083520 ext(0->8191) 00002000:00010000:2.0:1786002691.914822:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f692d80 00000100:00100000:0.0:1786002691.928651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002691.929175:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531083648 00000100:00100000:1.0:1786002691.929183:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531083648 00000100:00100000:1.0:1786002691.929236:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5395 00000100:00100000:1.0:1786002691.929247:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37be05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758531083648:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002691.931500:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969963 is committed 00000100:00100000:1.0:1786002691.931646:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37be05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531083648:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2398us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002691.931657:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5395 00000100:00100000:3.0:1786002691.946293:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561085184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786002691.946357:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002691.947045:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561085184 00000100:00100000:1.0:1786002691.947053:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561085184 00000100:00100000:1.0:1786002691.947104:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1786002691.947114:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561085184:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786002691.947313:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561085312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786002691.947344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1786002691.947462:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 189028032 pending 0 free 3923484672 avail 3691962368 00000100:00100000:1.0:1786002691.947576:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561085184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 464us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002691.947642:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1786002691.947659:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561085312 00000100:00100000:1.0:1786002691.947663:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561085312 00000100:00100000:1.0:1786002691.947683:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:1.0:1786002691.947689:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561085312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002691.947698:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 189028032 pending 0 free 3923484672 avail 3691962368 00000100:00100000:1.0:1786002691.947722:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561085312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002691.947727:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00080000:2.0:1786002691.947782:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002691.948036:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561085312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1786002691.948059:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f47dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561085184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002691.961936:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.963526:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531083904 00000100:00100000:2.0:1786002691.963536:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531083904 00000100:00100000:1.0:1786002691.963702:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24308 00000100:00100000:1.0:1786002691.963714:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+52:22406:x1872758531083904:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002691.963736:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002691.963760:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417af6 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3a4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.963895:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417afd lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.963909:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417afd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.963921:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417afd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.963935:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b04 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.963943:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b04 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964012:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b04 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964065:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578417b0b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964075:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578417b0b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964082:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578417b0b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002691.964090:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:1.0:1786002691.964156:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417afd lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964164:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417afd lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964170:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417afd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964177:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417afd lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964182:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002691.964186:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417afd lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964193:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417afd lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964204:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:1.0:1786002691.964206:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002691.964210:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417afd lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964226:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417afd lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964238:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b04 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964244:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b04 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964250:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b04 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964255:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002691.964258:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b04 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964267:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b04 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964274:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed2456efc00) 00010000:00010000:1.0:1786002691.964277:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002691.964279:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b04 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964285:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b04 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964325:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417af6 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3a4 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964341:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556be00/0x7cee4af578417b0b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3a4 expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002691.964347:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002691.964350:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786002691.964352:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556be00, rc 0) 00000100:00100000:1.0:1786002691.964401:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+54:22406:x1872758531083904:12345-192.168.203.49@tcp:101:dd.0 Request processed in 690us (2474us total) trans 4294968710 rc 0/0 00000100:00100000:1.0:1786002691.964409:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24308 00000100:00100000:0.0:1786002691.979570:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002691.979709:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531084160 00000100:00100000:2.0:1786002691.979718:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531084160 00000100:00100000:2.0:1786002691.979769:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5274 00000100:00100000:2.0:1786002691.979778:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+54:22406:x1872758531084160:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:2.0:1786002691.980016:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+55:22406:x1872758531084160:12345-192.168.203.49@tcp:35:dd.0 Request processed in 237us (451us total) trans 4294968711 rc 0/0 00000100:00100000:2.0:1786002691.980024:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5274 00000100:00100000:0.0:1786002692.004323:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.005027:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531084288 00000100:00100000:3.0:1786002692.005037:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531084288 00002000:00100000:3.0:1786002692.005078:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f690380 x1872758531084288/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/0 e 0 to 0 dl 1786002703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.005087:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f690380 with x1872758531084288 ext(0->8191) 00002000:00010000:3.0:1786002692.005092:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f690380 00000100:00100000:3.0:1786002692.005118:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 64 00000100:00100000:3.0:1786002692.005126:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531084288:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002692.006043:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531084288:12345-192.168.203.49@tcp:4:dd.0 Request processed in 916us (1726us total) trans 4294969964 rc 0/0 00000100:00100000:3.0:1786002692.006051:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 64 00002000:00100000:3.0:1786002692.006057:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f690380 x1872758531084288/t4294969964(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/448 e 0 to 0 dl 1786002703 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.006064:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f690380 with x1872758531084288 ext(0->8191) 00002000:00010000:3.0:1786002692.006068:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f690380 00000100:00100000:0.0:1786002692.020114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002692.020199:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531084416 00000100:00100000:2.0:1786002692.020208:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531084416 00000100:00100000:2.0:1786002692.020259:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5396 00000100:00100000:2.0:1786002692.020268:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758531084416:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002692.021621:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969964 is committed 00000100:00100000:2.0:1786002692.021782:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531084416:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1513us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002692.021790:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5396 00000100:00100000:0.0:1786002692.049842:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.051145:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531084672 00000100:00100000:1.0:1786002692.051154:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531084672 00000100:00100000:1.0:1786002692.051215:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24309 00000100:00100000:1.0:1786002692.051224:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+55:22407:x1872758531084672:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002692.051247:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002692.051268:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b19 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3ab expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.051364:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b20 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.051376:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b20 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.051386:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b20 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.051399:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417b27 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.051421:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417b27 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.051427:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417b27 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052058:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b2e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052068:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b2e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052075:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b2e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002692.052083:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:1.0:1786002692.052165:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b20 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052172:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b20 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052177:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b20 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052182:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b20 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052187:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002692.052190:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b20 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052196:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b20 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052205:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:1.0:1786002692.052208:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002692.052211:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b20 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052217:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b20 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052227:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417b27 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052232:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417b27 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052250:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417b27 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052256:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002692.052258:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417b27 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052270:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417b27 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052277:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed2456efc00) 00010000:00010000:1.0:1786002692.052279:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002692.052282:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417b27 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052288:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417b27 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052328:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b19 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3ab expref: 58 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052343:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b2e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3ab expref: 57 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.052349:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002692.052351:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786002692.052354:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999600, rc 0) 00000100:00100000:1.0:1786002692.053576:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+57:22407:x1872758531084672:12345-192.168.203.49@tcp:101:dd.0 Request processed in 2351us (3739us total) trans 4294968712 rc 0/0 00000100:00100000:1.0:1786002692.054009:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24309 00000100:00100000:0.0:1786002692.067971:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.068034:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531084928 00000100:00100000:1.0:1786002692.068043:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531084928 00000100:00100000:0.0:1786002692.068051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.068086:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5275 00000100:00100000:1.0:1786002692.068096:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+57:22407:x1872758531084928:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:3.0:1786002692.068327:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531085056 00000100:00100000:3.0:1786002692.068332:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531085056 00000100:00100000:1.0:1786002692.068354:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+59:22407:x1872758531084928:12345-192.168.203.49@tcp:35:dd.0 Request processed in 259us (392us total) trans 4294968713 rc 0/0 00000100:00100000:1.0:1786002692.068362:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5275 00000100:00100000:3.0:1786002692.068406:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1544 00000100:00100000:3.0:1786002692.068414:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+58:2412:x1872758531085056:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002692.068426:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002692.068470:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b2e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3ab expref: 58 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.068488:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002692.068493:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002692.068514:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+57:2412:x1872758531085056:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 102us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002692.068521:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1544 00010000:00010000:3.0:1786002692.074019:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002692.099918:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.100037:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531085184 00000100:00100000:3.0:1786002692.100046:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531085184 00002000:00100000:3.0:1786002692.100089:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f47ca80 x1872758531085184/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/0 e 0 to 0 dl 1786002703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.100101:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f47ca80 with x1872758531085184 ext(0->8191) 00002000:00010000:3.0:1786002692.100106:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f47ca80 00000100:00100000:3.0:1786002692.100126:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 65 00000100:00100000:3.0:1786002692.100145:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531085184:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002692.101031:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531085184:12345-192.168.203.49@tcp:4:dd.0 Request processed in 886us (1121us total) trans 4294969965 rc 0/0 00000100:00100000:3.0:1786002692.101039:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 65 00002000:00100000:3.0:1786002692.101046:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f47ca80 x1872758531085184/t4294969965(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/448 e 0 to 0 dl 1786002703 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.101054:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f47ca80 with x1872758531085184 ext(0->8191) 00002000:00010000:3.0:1786002692.101057:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f47ca80 00000100:00100000:0.0:1786002692.112839:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.113554:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531085312 00000100:00100000:1.0:1786002692.113562:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531085312 00000100:00100000:1.0:1786002692.113625:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5397 00000100:00100000:1.0:1786002692.113723:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758531085312:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002692.114906:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969965 is committed 00000100:00100000:1.0:1786002692.115032:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531085312:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1397us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002692.115040:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5397 00000100:00100000:0.0:1786002692.134137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.134333:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531085568 00000100:00100000:3.0:1786002692.134343:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531085568 00000100:00100000:3.0:1786002692.134398:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24310 00000100:00100000:3.0:1786002692.134408:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+57:22408:x1872758531085568:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1786002692.134429:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002692.134457:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417b3c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3b2 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.134567:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417b43 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.134579:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417b43 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.134589:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417b43 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.134600:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417b4a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.134617:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417b4a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.134624:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417b4a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.134679:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417b51 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.134689:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417b51 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.134696:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417b51 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002692.134704:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:3.0:1786002692.134770:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417b43 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.134778:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417b43 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.134784:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417b43 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135143:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417b43 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135149:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002692.135153:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417b43 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135160:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417b43 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135172:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed366c05600) 00010000:00010000:3.0:1786002692.135175:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002692.135178:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417b43 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135188:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417b43 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135201:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417b4a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135207:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417b4a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135212:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417b4a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135216:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002692.135219:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417b4a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135224:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417b4a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135230:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed366c05e00) 00010000:00010000:3.0:1786002692.135232:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002692.135234:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417b4a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135239:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417b4a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135279:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417b3c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3b2 expref: 60 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135297:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417b51 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3b2 expref: 59 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.135304:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002692.135306:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786002692.135308:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca6800, rc 0) 00000100:00100000:3.0:1786002692.135351:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+59:22408:x1872758531085568:12345-192.168.203.49@tcp:101:dd.0 Request processed in 945us (1223us total) trans 4294968714 rc 0/0 00000100:00100000:3.0:1786002692.135358:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24310 00000100:00100000:2.0:1786002692.147284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.147397:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531085952 00000100:00100000:3.0:1786002692.147405:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531085952 00000100:00100000:3.0:1786002692.147511:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1545 00000100:00100000:3.0:1786002692.147521:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+59:2412:x1872758531085952:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002692.147536:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002692.147557:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417b51 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3b2 expref: 59 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.147574:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002692.147578:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002692.147642:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+58:2412:x1872758531085952:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 122us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002692.147649:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1545 00000100:00100000:0.0:1786002692.153588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.154020:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531085824 00000100:00100000:1.0:1786002692.154029:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531085824 00000100:00100000:1.0:1786002692.154078:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5276 00000100:00100000:1.0:1786002692.154088:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+58:22408:x1872758531085824:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002692.154294:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+59:22408:x1872758531085824:12345-192.168.203.49@tcp:35:dd.0 Request processed in 207us (715us total) trans 4294968715 rc 0/0 00000100:00100000:1.0:1786002692.154302:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5276 00000100:00100000:0.0:1786002692.168673:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.168894:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531086080 00000100:00100000:3.0:1786002692.168904:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531086080 00002000:00100000:3.0:1786002692.168953:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f691500 x1872758531086080/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/0 e 0 to 0 dl 1786002703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.168963:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f691500 with x1872758531086080 ext(0->8191) 00002000:00010000:3.0:1786002692.168968:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f691500 00000100:00100000:3.0:1786002692.168993:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 66 00000100:00100000:3.0:1786002692.169001:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531086080:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002692.169829:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531086080:12345-192.168.203.49@tcp:4:dd.0 Request processed in 826us (1162us total) trans 4294969966 rc 0/0 00000100:00100000:3.0:1786002692.169837:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 66 00002000:00100000:3.0:1786002692.169844:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f691500 x1872758531086080/t4294969966(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/448 e 0 to 0 dl 1786002703 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.169889:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f691500 with x1872758531086080 ext(0->8191) 00002000:00010000:3.0:1786002692.169892:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f691500 00000100:00100000:3.0:1786002692.185936:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002692.188728:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531086208 00000100:00100000:2.0:1786002692.188739:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531086208 00000100:00100000:2.0:1786002692.188899:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5398 00000100:00100000:2.0:1786002692.188909:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531086208:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002692.191032:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969966 is committed 00000100:00100000:2.0:1786002692.191723:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531086208:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2812us (5791us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002692.191732:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5398 00000100:00100000:0.0:1786002692.212437:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.212654:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531086464 00000100:00100000:1.0:1786002692.212664:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531086464 00000100:00100000:1.0:1786002692.212725:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24311 00000100:00100000:1.0:1786002692.212735:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+59:22409:x1872758531086464:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002692.212759:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002692.212794:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417b5f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.212925:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b66 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.212937:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b66 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.212957:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b66 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.212971:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b6d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.212978:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b6d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.212984:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b6d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213032:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b74 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213040:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b74 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213046:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b74 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002692.213058:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:1.0:1786002692.213122:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b66 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213140:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b66 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213146:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b66 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213152:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b66 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213158:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002692.213162:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b66 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213168:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b66 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213179:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456eff00) 00010000:00010000:1.0:1786002692.213182:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002692.213186:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b66 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213191:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417b66 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213203:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b6d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213212:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b6d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213218:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b6d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213222:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002692.213225:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b6d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213229:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b6d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213235:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed2456efc00) 00010000:00010000:1.0:1786002692.213237:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002692.213239:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b6d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213244:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417b6d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213279:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417b5f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3b9 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213293:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b74 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3b9 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.213300:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002692.213302:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786002692.213304:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b400, rc 0) 00000100:00100000:1.0:1786002692.213352:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+61:22409:x1872758531086464:12345-192.168.203.49@tcp:101:dd.0 Request processed in 618us (925us total) trans 4294968716 rc 0/0 00000100:00100000:1.0:1786002692.213360:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24311 00000100:00100000:0.0:1786002692.223509:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.223587:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531086720 00000100:00100000:1.0:1786002692.223596:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531086720 00000100:00100000:1.0:1786002692.223670:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5277 00000100:00100000:1.0:1786002692.223690:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+61:22409:x1872758531086720:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002692.223934:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+62:22409:x1872758531086720:12345-192.168.203.49@tcp:35:dd.0 Request processed in 255us (432us total) trans 4294968717 rc 0/0 00000100:00100000:1.0:1786002692.223942:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5277 00000100:00100000:2.0:1786002692.230730:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.230931:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531086848 00000100:00100000:1.0:1786002692.230940:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531086848 00000100:00100000:1.0:1786002692.231007:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1546 00000100:00100000:1.0:1786002692.231017:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+62:2412:x1872758531086848:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002692.231032:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002692.231053:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417b74 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3b9 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.231072:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002692.231077:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002692.231134:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+61:2412:x1872758531086848:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 112us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002692.231142:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1546 00000100:00100000:0.0:1786002692.237955:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.237985:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531086976 00000100:00100000:3.0:1786002692.237994:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531086976 00002000:00100000:3.0:1786002692.238040:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f691c00 x1872758531086976/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/0 e 0 to 0 dl 1786002703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.238051:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f691c00 with x1872758531086976 ext(0->8191) 00002000:00010000:3.0:1786002692.238057:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f691c00 00000100:00100000:3.0:1786002692.238088:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 67 00000100:00100000:3.0:1786002692.238097:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531086976:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002692.238934:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531086976:12345-192.168.203.49@tcp:4:dd.0 Request processed in 836us (986us total) trans 4294969967 rc 0/0 00000100:00100000:3.0:1786002692.238998:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 67 00002000:00100000:3.0:1786002692.239008:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f691c00 x1872758531086976/t4294969967(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/448 e 0 to 0 dl 1786002703 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.239017:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f691c00 with x1872758531086976 ext(0->8191) 00002000:00010000:3.0:1786002692.239022:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f691c00 00000100:00100000:0.0:1786002692.251597:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.251772:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531087104 00000100:00100000:3.0:1786002692.251781:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531087104 00000100:00100000:3.0:1786002692.251886:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5399 00000100:00100000:3.0:1786002692.251896:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758531087104:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002692.253202:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969967 is committed 00000100:00100000:3.0:1786002692.254067:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531087104:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2169us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002692.254076:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5399 00000100:00100000:2.0:1786002692.276901:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.280905:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531087360 00000100:00100000:1.0:1786002692.280919:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531087360 00000100:00100000:0.0:1786002692.281059:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24312 00000100:00100000:0.0:1786002692.281070:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+61:22410:x1872758531087360:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002692.281092:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002692.281111:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417b82 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3c0 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281220:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417b89 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281233:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417b89 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281244:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417b89 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281260:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417b90 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281267:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417b90 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281273:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417b90 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281322:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417b97 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281331:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417b97 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281338:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417b97 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002692.281347:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:0.0:1786002692.281414:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417b89 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281422:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417b89 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281429:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417b89 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281436:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417b89 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281442:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002692.281447:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417b89 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281454:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417b89 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281466:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:0.0:1786002692.281470:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002692.281474:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417b89 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281481:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417b89 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281493:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417b90 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281499:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417b90 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281505:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417b90 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281510:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002692.281513:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417b90 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281519:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417b90 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281526:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002692.281528:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002692.281532:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417b90 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281538:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417b90 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281574:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417b82 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3c0 expref: 64 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281588:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417b97 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3c0 expref: 63 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.281595:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002692.281598:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002692.281600:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:0.0:1786002692.281676:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+63:22410:x1872758531087360:12345-192.168.203.49@tcp:101:dd.0 Request processed in 607us (4783us total) trans 4294968718 rc 0/0 00000100:00100000:0.0:1786002692.281691:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24312 00000100:00100000:0.0:1786002692.284985:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.285061:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531087488 00000100:00100000:1.0:1786002692.285069:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531087488 00000100:00100000:1.0:1786002692.285122:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1547 00000100:00100000:1.0:1786002692.285132:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+63:2413:x1872758531087488:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002692.285147:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002692.285169:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417b97 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3c0 expref: 63 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.285186:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002692.285190:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002692.285239:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+62:2413:x1872758531087488:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 108us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002692.285247:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1547 00000100:00100000:1.0:1786002692.290578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.290661:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531087744 00000100:00100000:0.0:1786002692.290670:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531087744 00000100:00100000:0.0:1786002692.290724:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5278 00000100:00100000:0.0:1786002692.290732:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+62:22410:x1872758531087744:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:0.0:1786002692.290959:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+63:22410:x1872758531087744:12345-192.168.203.49@tcp:35:dd.0 Request processed in 226us (389us total) trans 4294968719 rc 0/0 00000100:00100000:0.0:1786002692.290967:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5278 00000100:00100000:2.0:1786002692.308711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.308767:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531087872 00000100:00100000:3.0:1786002692.308777:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531087872 00002000:00100000:3.0:1786002692.308833:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f47c700 x1872758531087872/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/0 e 0 to 0 dl 1786002703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.308845:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f47c700 with x1872758531087872 ext(0->8191) 00002000:00010000:3.0:1786002692.308887:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f47c700 00000100:00100000:3.0:1786002692.308909:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 68 00000100:00100000:3.0:1786002692.308918:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531087872:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002692.309569:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531087872:12345-192.168.203.49@tcp:4:dd.0 Request processed in 651us (865us total) trans 4294969968 rc 0/0 00000100:00100000:3.0:1786002692.309577:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 68 00002000:00100000:3.0:1786002692.309584:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f47c700 x1872758531087872/t4294969968(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/448 e 0 to 0 dl 1786002703 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.309598:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f47c700 with x1872758531087872 ext(0->8191) 00002000:00010000:3.0:1786002692.309601:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f47c700 00000100:00100000:2.0:1786002692.323135:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.323204:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531088000 00000100:00100000:0.0:1786002692.323213:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531088000 00000100:00100000:0.0:1786002692.323270:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5400 00000100:00100000:0.0:1786002692.323279:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531088000:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:1.0:1786002692.325069:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969968 is committed 00000100:00100000:0.0:1786002692.325211:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531088000:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1930us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002692.325221:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5400 00000100:00100000:0.0:1786002692.343009:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002692.343128:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531088256 00000100:00100000:2.0:1786002692.343138:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531088256 00000100:00100000:2.0:1786002692.343198:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24313 00000100:00100000:2.0:1786002692.343208:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+63:22411:x1872758531088256:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002692.343229:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002692.343249:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417ba5 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3c7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343344:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417bac lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343357:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417bac lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343367:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417bac lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343379:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417bb3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343386:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417bb3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343394:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417bb3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343440:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af578417bba lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343449:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af578417bba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343457:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af578417bba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002692.343466:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:2.0:1786002692.343540:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417bac lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343547:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417bac lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343555:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417bac lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343562:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417bac lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343568:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002692.343572:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417bac lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343580:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417bac lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343591:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed3465ad000) 00010000:00010000:2.0:1786002692.343594:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002692.343598:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417bac lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343668:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417bac lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343684:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417bb3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343691:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417bb3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343697:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417bb3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343701:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002692.343704:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417bb3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343710:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417bb3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343718:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed3465add00) 00010000:00010000:2.0:1786002692.343720:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002692.343722:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417bb3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343728:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417bb3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343767:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417ba5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3c7 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343782:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af578417bba lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3c7 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002692.343795:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002692.343797:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786002692.343799:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2cc00, rc 0) 00000100:00100000:2.0:1786002692.343898:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+65:22411:x1872758531088256:12345-192.168.203.49@tcp:101:dd.0 Request processed in 691us (897us total) trans 4294968720 rc 0/0 00000100:00100000:2.0:1786002692.343906:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24313 00000100:00100000:2.0:1786002692.351826:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002692.351933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.352007:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531088640 00000100:00100000:3.0:1786002692.352015:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531088640 00000100:00100000:3.0:1786002692.352073:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1548 00000100:00100000:3.0:1786002692.352083:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+65:2413:x1872758531088640:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002692.352096:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002692.352119:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af578417bba lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3c7 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.352145:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002692.352150:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002692.352201:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+64:2413:x1872758531088640:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 120us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002692.352208:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1548 00000100:00100000:1.0:1786002692.352810:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531088512 00000100:00100000:1.0:1786002692.352815:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531088512 00000100:00100000:1.0:1786002692.352881:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5279 00000100:00100000:1.0:1786002692.352888:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+64:22411:x1872758531088512:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002692.353067:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+65:22411:x1872758531088512:12345-192.168.203.49@tcp:35:dd.0 Request processed in 179us (1248us total) trans 4294968721 rc 0/0 00000100:00100000:1.0:1786002692.353073:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5279 00000100:00100000:2.0:1786002692.378342:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.378450:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531088768 00000100:00100000:3.0:1786002692.378460:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531088768 00002000:00100000:3.0:1786002692.378502:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f47f480 x1872758531088768/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/0 e 0 to 0 dl 1786002703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.378513:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f47f480 with x1872758531088768 ext(0->8191) 00002000:00010000:3.0:1786002692.378519:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f47f480 00000100:00100000:3.0:1786002692.378549:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 69 00000100:00100000:3.0:1786002692.378558:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531088768:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002692.380062:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531088768:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1498us (1722us total) trans 4294969969 rc 0/0 00000100:00100000:3.0:1786002692.380073:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 69 00002000:00100000:3.0:1786002692.380083:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f47f480 x1872758531088768/t4294969969(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/448 e 0 to 0 dl 1786002703 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.380093:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f47f480 with x1872758531088768 ext(0->8191) 00002000:00010000:3.0:1786002692.380097:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f47f480 00000100:00100000:2.0:1786002692.399459:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.399539:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531088896 00000100:00100000:1.0:1786002692.399548:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531088896 00000100:00100000:1.0:1786002692.399597:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5401 00000100:00100000:1.0:1786002692.399616:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531088896:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002692.400871:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969969 is committed 00000100:00100000:1.0:1786002692.401080:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531088896:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1473us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002692.401090:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5401 00000100:00100000:2.0:1786002692.425042:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.425171:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531089152 00000100:00100000:0.0:1786002692.425181:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531089152 00000100:00100000:0.0:1786002692.425239:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24314 00000100:00100000:0.0:1786002692.425248:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+65:22412:x1872758531089152:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002692.425270:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002692.425290:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417bc8 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3ce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425385:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417bcf lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425398:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417bcf lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425407:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417bcf lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425418:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417bd6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425425:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417bd6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425435:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417bd6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425484:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417bdd lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425492:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417bdd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425499:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417bdd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002692.425508:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:0.0:1786002692.425576:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417bcf lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425584:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417bcf lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425589:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417bcf lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425595:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417bcf lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425600:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002692.425616:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417bcf lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425624:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417bcf lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425640:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:0.0:1786002692.425643:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002692.425647:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417bcf lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425653:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417bcf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425668:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417bd6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425674:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417bd6 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425680:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417bd6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425685:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002692.425688:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417bd6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425693:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417bd6 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425700:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002692.425702:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002692.425705:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417bd6 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425709:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417bd6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425751:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578417bc8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3ce expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425767:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417bdd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3ce expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.425774:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002692.425776:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002692.425779:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34e00, rc 0) 00000100:00100000:0.0:1786002692.425842:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+67:22412:x1872758531089152:12345-192.168.203.49@tcp:101:dd.0 Request processed in 594us (808us total) trans 4294968722 rc 0/0 00000100:00100000:0.0:1786002692.425893:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24314 00000100:00100000:2.0:1786002692.430462:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.430539:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531089280 00000100:00100000:1.0:1786002692.430548:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531089280 00000100:00100000:1.0:1786002692.430619:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1549 00000100:00100000:1.0:1786002692.430631:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+67:2411:x1872758531089280:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002692.430644:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002692.430667:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af578417bdd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3ce expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.430685:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002692.430689:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002692.430741:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+66:2411:x1872758531089280:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 111us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002692.430748:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1549 00000100:00100000:3.0:1786002692.458139:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786002692.458161:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561085440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786002692.458239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002692.458398:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561085440 00000100:00100000:1.0:1786002692.458405:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561085440 00000100:00100000:1.0:1786002692.458448:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4164 00000100:00100000:1.0:1786002692.458456:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:3645:x1872758561085440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786002692.458488:0:20598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443897344 avail 1297657856 00000100:00100000:1.0:1786002692.458552:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:3645:x1872758561085440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002692.458558:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4164 00000100:00100000:3.0:1786002692.458643:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f47ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561085440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786002692.462697:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.462746:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.462794:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.462836:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002692.462925:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531089664 00000100:00100000:2.0:1786002692.462933:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531089664 00000100:00100000:2.0:1786002692.462985:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 577 00000100:00100000:2.0:1786002692.462993:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531089664:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002692.463046:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2413:x1872758531089664:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 54us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002692.463053:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 577 00000100:00100000:2.0:1786002692.463080:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531089920 00000100:00100000:2.0:1786002692.463082:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531089920 00000100:00080000:2.0:1786002692.463099:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002692.463121:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 624 00000100:00100000:2.0:1786002692.463137:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed370e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531089920:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002692.463162:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed370e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531089920:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 35us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002692.463168:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 624 00000100:00100000:1.0:1786002692.463476:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531089536 00000100:00100000:1.0:1786002692.463480:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531089536 00000100:00100000:1.0:1786002692.463511:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5280 00000100:00100000:1.0:1786002692.463517:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+66:22412:x1872758531089536:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002692.463694:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+67:22412:x1872758531089536:12345-192.168.203.49@tcp:35:dd.0 Request processed in 176us (1002us total) trans 4294968723 rc 0/0 00000100:00100000:1.0:1786002692.463701:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5280 00000100:00100000:0.0:1786002692.463763:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531089792 00000100:00100000:0.0:1786002692.463767:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531089792 00000100:00100000:0.0:1786002692.463808:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1119 00000100:00100000:0.0:1786002692.463814:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531089792:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:0.0:1786002692.463838:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531089792:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 25us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002692.463843:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1119 00000100:00080000:1.0:1786002692.464193:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786002692.515982:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.516308:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531090048 00000100:00100000:0.0:1786002692.516317:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531090048 00002000:00100000:0.0:1786002692.516357:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed2455fe680 x1872758531090048/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/0 e 0 to 0 dl 1786002703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002692.516366:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455fe680 with x1872758531090048 ext(0->8191) 00002000:00010000:0.0:1786002692.516371:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455fe680 00000100:00100000:0.0:1786002692.516408:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 70 00000100:00100000:0.0:1786002692.516416:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531090048:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:0.0:1786002692.518963:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531090048:12345-192.168.203.49@tcp:4:dd.0 Request processed in 2541us (2983us total) trans 4294969970 rc 0/0 00000100:00100000:0.0:1786002692.518973:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 70 00002000:00100000:0.0:1786002692.518982:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed2455fe680 x1872758531090048/t4294969970(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/448 e 0 to 0 dl 1786002703 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002692.518990:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455fe680 with x1872758531090048 ext(0->8191) 00002000:00010000:0.0:1786002692.518996:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455fe680 00000100:00100000:2.0:1786002692.563786:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.563876:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531090176 00000100:00100000:1.0:1786002692.563885:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531090176 00000100:00100000:1.0:1786002692.563936:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5402 00000100:00100000:1.0:1786002692.563952:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531090176:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002692.567923:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969970 is committed 00000100:00100000:1.0:1786002692.568120:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531090176:12345-192.168.203.49@tcp:16:dd.0 Request processed in 4171us (4335us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002692.568139:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5402 00000100:00100000:2.0:1786002692.591641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.591888:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531090432 00000100:00100000:1.0:1786002692.591898:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531090432 00000100:00100000:1.0:1786002692.591958:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24315 00000100:00100000:1.0:1786002692.591967:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+67:22413:x1872758531090432:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002692.591994:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002692.592013:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417beb lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3d5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592141:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417bf2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592154:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417bf2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592164:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417bf2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592179:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417bf9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592185:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417bf9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592190:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417bf9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592234:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417c00 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592241:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417c00 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592247:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417c00 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002692.592255:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:1.0:1786002692.592315:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417bf2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592321:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417bf2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592327:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417bf2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592332:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417bf2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592337:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002692.592341:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417bf2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592347:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417bf2 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592357:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef900) 00010000:00010000:1.0:1786002692.592359:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002692.592362:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417bf2 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592367:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417bf2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592379:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417bf9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592385:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417bf9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592391:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417bf9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592396:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002692.592398:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417bf9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592404:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417bf9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592410:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed2456efc00) 00010000:00010000:1.0:1786002692.592412:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002692.592415:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417bf9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592421:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417bf9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592456:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417beb lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3d5 expref: 70 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592473:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417c00 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3d5 expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.592479:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002692.592481:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786002692.592483:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999600, rc 0) 00000100:00100000:1.0:1786002692.592534:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+69:22413:x1872758531090432:12345-192.168.203.49@tcp:101:dd.0 Request processed in 568us (907us total) trans 4294968724 rc 0/0 00000100:00100000:1.0:1786002692.592540:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24315 00000100:00100000:3.0:1786002692.603146:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.603240:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531090560 00000100:00100000:1.0:1786002692.603248:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531090560 00000100:00100000:1.0:1786002692.603309:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1550 00000100:00100000:1.0:1786002692.603319:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36af77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+69:2412:x1872758531090560:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002692.603333:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002692.603356:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417c00 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3d5 expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.603373:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002692.603378:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002692.603432:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36af77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+68:2412:x1872758531090560:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002692.603439:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1550 00000100:00100000:2.0:1786002692.611824:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.611933:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531090816 00000100:00100000:0.0:1786002692.611941:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531090816 00000100:00100000:0.0:1786002692.611995:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5281 00000100:00100000:0.0:1786002692.612004:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+68:22413:x1872758531090816:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:0.0:1786002692.612239:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+69:22413:x1872758531090816:12345-192.168.203.49@tcp:35:dd.0 Request processed in 235us (422us total) trans 4294968725 rc 0/0 00000100:00100000:0.0:1786002692.612247:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5281 00000100:00100000:2.0:1786002692.633726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.634205:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531090944 00000100:00100000:3.0:1786002692.634214:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531090944 00002000:00100000:3.0:1786002692.634256:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f47df80 x1872758531090944/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/0 e 0 to 0 dl 1786002703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.634266:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f47df80 with x1872758531090944 ext(0->8191) 00002000:00010000:3.0:1786002692.634271:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f47df80 00000100:00100000:3.0:1786002692.634300:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 71 00000100:00100000:3.0:1786002692.634308:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531090944:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002692.634889:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531090944:12345-192.168.203.49@tcp:4:dd.0 Request processed in 580us (1169us total) trans 4294969971 rc 0/0 00000100:00100000:3.0:1786002692.634898:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 71 00002000:00100000:3.0:1786002692.634905:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f47df80 x1872758531090944/t4294969971(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/448 e 0 to 0 dl 1786002703 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.634914:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f47df80 with x1872758531090944 ext(0->8191) 00002000:00010000:3.0:1786002692.634918:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f47df80 00000100:00100000:3.0:1786002692.651176:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002692.651657:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531091072 00000100:00100000:2.0:1786002692.651667:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531091072 00000100:00100000:2.0:1786002692.651720:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5403 00000100:00100000:2.0:1786002692.651729:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758531091072:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002692.653316:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969971 is committed 00000100:00100000:2.0:1786002692.654147:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531091072:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2416us (2977us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002692.654156:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5403 00000100:00100000:2.0:1786002692.678661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.678963:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531091328 00000100:00100000:0.0:1786002692.678972:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531091328 00000100:00100000:0.0:1786002692.679037:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24316 00000100:00100000:0.0:1786002692.679047:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+69:22414:x1872758531091328:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002692.679069:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002692.679089:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417c0e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3dc expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679226:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c15 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679240:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c15 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679251:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c15 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679263:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c1c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679270:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c1c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679277:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c1c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679323:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417c23 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679332:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417c23 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679339:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417c23 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002692.679348:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:0.0:1786002692.679414:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c15 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679426:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c15 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679432:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c15 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679438:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c15 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679445:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002692.679449:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c15 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679456:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c15 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679467:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:0.0:1786002692.679471:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002692.679475:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c15 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679481:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c15 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679493:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c1c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679498:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c1c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679503:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c1c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679508:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002692.679511:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c1c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679515:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c1c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679520:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002692.679522:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002692.679524:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c1c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679529:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c1c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679567:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417c0e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3dc expref: 72 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679584:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417c23 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3dc expref: 71 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.679591:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002692.679593:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002692.679596:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:0.0:1786002692.680829:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+71:22414:x1872758531091328:12345-192.168.203.49@tcp:101:dd.0 Request processed in 1781us (2173us total) trans 4294968726 rc 0/0 00000100:00100000:0.0:1786002692.680838:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24316 00000100:00100000:3.0:1786002692.689798:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.689829:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002692.689901:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531091584 00000100:00100000:2.0:1786002692.689910:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531091584 00000100:00100000:2.0:1786002692.689966:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5282 00000100:00100000:2.0:1786002692.689975:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+71:22414:x1872758531091584:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002692.690206:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531091712 00000100:00100000:1.0:1786002692.690210:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531091712 00000100:00100000:1.0:1786002692.690244:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1551 00000100:00100000:1.0:1786002692.690250:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:2412:x1872758531091712:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002692.690259:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002692.690280:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417c23 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3dc expref: 73 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.690296:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002692.690301:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002692.697689:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+72:22414:x1872758531091584:12345-192.168.203.49@tcp:35:dd.0 Request processed in 7702us (7895us total) trans 4294968727 rc 0/0 00000100:00100000:2.0:1786002692.697704:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5282 00000100:00100000:1.0:1786002692.697821:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+71:2412:x1872758531091712:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 7569us (7989us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002692.697831:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1551 00000100:00100000:3.0:1786002692.721938:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.722280:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531091840 00000100:00100000:0.0:1786002692.722290:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531091840 00002000:00100000:0.0:1786002692.722332:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed244ff9f80 x1872758531091840/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/0 e 0 to 0 dl 1786002703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002692.722343:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ff9f80 with x1872758531091840 ext(0->8191) 00002000:00010000:0.0:1786002692.722347:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed244ff9f80 00000100:00100000:0.0:1786002692.722369:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 72 00000100:00100000:0.0:1786002692.722377:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531091840:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:0.0:1786002692.723325:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531091840:12345-192.168.203.49@tcp:4:dd.0 Request processed in 946us (1392us total) trans 4294969972 rc 0/0 00000100:00100000:0.0:1786002692.723333:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 72 00002000:00100000:0.0:1786002692.723340:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed244ff9f80 x1872758531091840/t4294969972(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/448 e 0 to 0 dl 1786002703 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002692.723349:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ff9f80 with x1872758531091840 ext(0->8191) 00002000:00010000:0.0:1786002692.723352:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed244ff9f80 00000100:00100000:0.0:1786002692.734500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.734568:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531091968 00000100:00100000:3.0:1786002692.734577:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531091968 00000100:00100000:3.0:1786002692.734649:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5404 00000100:00100000:3.0:1786002692.734659:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531091968:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:1.0:1786002692.736453:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969972 is committed 00000100:00100000:3.0:1786002692.736587:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531091968:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1926us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002692.736596:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5404 00000100:00100000:2.0:1786002692.772382:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.772484:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531092224 00000100:00100000:0.0:1786002692.772493:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531092224 00000100:00100000:0.0:1786002692.772547:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24317 00000100:00100000:0.0:1786002692.772557:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+71:22415:x1872758531092224:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002692.772579:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002692.772599:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417c31 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772722:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c38 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772737:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c38 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772747:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c38 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772758:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c3f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772764:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c3f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772769:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c3f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772813:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417c46 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772820:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417c46 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772825:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417c46 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002692.772833:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:0.0:1786002692.772928:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c38 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772935:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c38 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772948:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c38 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772955:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c38 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772960:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002692.772964:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c38 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772970:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c38 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772979:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:0.0:1786002692.772982:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002692.772985:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c38 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.772991:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c38 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.773001:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c3f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.773005:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c3f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.773010:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c3f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.773014:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002692.773016:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c3f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.773024:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c3f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.773030:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002692.773031:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002692.773033:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c3f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.773038:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c3f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.773072:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417c31 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3e3 expref: 74 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.773087:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417c46 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3e3 expref: 73 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.773093:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002692.773094:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002692.773096:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35000, rc 0) 00000100:00100000:0.0:1786002692.773139:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:22415:x1872758531092224:12345-192.168.203.49@tcp:101:dd.0 Request processed in 584us (765us total) trans 4294968728 rc 0/0 00000100:00100000:0.0:1786002692.773145:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24317 00000100:00100000:2.0:1786002692.777701:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002692.777738:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.777839:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531092608 00000100:00100000:3.0:1786002692.777875:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531092608 00000100:00100000:3.0:1786002692.777923:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1552 00000100:00100000:3.0:1786002692.777931:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:2411:x1872758531092608:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002692.777945:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002692.777974:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417c46 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3e3 expref: 73 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.777992:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002692.777996:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002692.778033:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+72:2411:x1872758531092608:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 103us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002692.778040:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1552 00000100:00100000:1.0:1786002692.778198:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531092480 00000100:00100000:1.0:1786002692.778203:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531092480 00000100:00100000:1.0:1786002692.778235:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5283 00000100:00100000:1.0:1786002692.778242:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+72:22415:x1872758531092480:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002692.778389:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:22415:x1872758531092480:12345-192.168.203.49@tcp:35:dd.0 Request processed in 147us (697us total) trans 4294968729 rc 0/0 00000100:00100000:1.0:1786002692.778396:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5283 00000100:00100000:2.0:1786002692.801409:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.801700:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531092736 00000100:00100000:3.0:1786002692.801709:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531092736 00002000:00100000:3.0:1786002692.801753:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37137ca80 x1872758531092736/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/0 e 0 to 0 dl 1786002703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.801765:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37137ca80 with x1872758531092736 ext(0->8191) 00002000:00010000:3.0:1786002692.801770:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37137ca80 00000100:00100000:3.0:1786002692.801796:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 73 00000100:00100000:3.0:1786002692.801805:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531092736:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002692.802668:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531092736:12345-192.168.203.49@tcp:4:dd.0 Request processed in 862us (1265us total) trans 4294969973 rc 0/0 00000100:00100000:3.0:1786002692.802677:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 73 00002000:00100000:3.0:1786002692.802685:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37137ca80 x1872758531092736/t4294969973(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/448 e 0 to 0 dl 1786002703 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002692.802694:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37137ca80 with x1872758531092736 ext(0->8191) 00002000:00010000:3.0:1786002692.802698:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37137ca80 00000100:00100000:2.0:1786002692.806274:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.806354:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531092864 00000100:00100000:0.0:1786002692.806361:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531092864 00000100:00100000:0.0:1786002692.806406:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5405 00000100:00100000:0.0:1786002692.806415:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531092864:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:1.0:1786002692.809272:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969973 is committed 00000100:00100000:0.0:1786002692.809416:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531092864:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2998us (3145us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002692.809425:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5405 00000100:00100000:2.0:1786002692.823977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.824572:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531093120 00000100:00100000:0.0:1786002692.824590:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531093120 00000100:00100000:0.0:1786002692.824744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24318 00000100:00100000:0.0:1786002692.824755:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:22416:x1872758531093120:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002692.824776:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002692.824796:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417c54 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3ea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.824931:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c5b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.824945:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c5b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.824956:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c5b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.824969:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c62 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.824976:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c62 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.824983:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c62 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825032:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417c69 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825043:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417c69 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825051:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417c69 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002692.825060:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:0.0:1786002692.825123:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c5b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825131:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c5b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825137:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c5b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825142:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c5b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825149:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002692.825153:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c5b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825160:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c5b lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825172:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:0.0:1786002692.825175:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002692.825179:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c5b lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825186:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c5b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825199:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c62 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825205:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c62 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825212:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c62 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825217:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002692.825220:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c62 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825226:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c62 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825233:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002692.825235:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002692.825238:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c62 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825244:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c62 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825279:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417c54 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3ea expref: 76 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825293:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417c69 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3ea expref: 75 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.825307:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002692.825309:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002692.825311:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34a00, rc 0) 00000100:00100000:0.0:1786002692.825366:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+75:22416:x1872758531093120:12345-192.168.203.49@tcp:101:dd.0 Request processed in 614us (1398us total) trans 4294968730 rc 0/0 00000100:00100000:0.0:1786002692.825374:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24318 00000100:00100000:2.0:1786002692.840262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.840437:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531093248 00000100:00100000:1.0:1786002692.840447:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531093248 00000100:00100000:1.0:1786002692.840519:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1553 00000100:00100000:1.0:1786002692.840529:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+75:2413:x1872758531093248:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002692.840543:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002692.840565:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417c69 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3ea expref: 75 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002692.840583:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002692.840587:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002692.840650:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+74:2413:x1872758531093248:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 122us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002692.840658:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1553 00000100:00100000:2.0:1786002692.845994:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.846101:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531093504 00000100:00100000:0.0:1786002692.846111:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531093504 00000100:00100000:0.0:1786002692.846198:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5284 00000100:00100000:0.0:1786002692.846208:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+74:22416:x1872758531093504:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:0.0:1786002692.846428:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+75:22416:x1872758531093504:12345-192.168.203.49@tcp:35:dd.0 Request processed in 221us (442us total) trans 4294968731 rc 0/0 00000100:00100000:0.0:1786002692.846435:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5284 00000100:00100000:2.0:1786002692.860613:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.860778:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531093632 00000100:00100000:0.0:1786002692.860788:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531093632 00002000:00100000:0.0:1786002692.860834:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed2454c8380 x1872758531093632/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/0 e 0 to 0 dl 1786002703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002692.860845:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2454c8380 with x1872758531093632 ext(0->8191) 00002000:00010000:0.0:1786002692.860884:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2454c8380 00000100:00100000:0.0:1786002692.860909:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 74 00000100:00100000:0.0:1786002692.860919:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531093632:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:0.0:1786002692.861544:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531093632:12345-192.168.203.49@tcp:4:dd.0 Request processed in 626us (947us total) trans 4294969974 rc 0/0 00000100:00100000:0.0:1786002692.861556:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 74 00002000:00100000:0.0:1786002692.861563:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed2454c8380 x1872758531093632/t4294969974(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/448 e 0 to 0 dl 1786002703 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002692.861573:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2454c8380 with x1872758531093632 ext(0->8191) 00002000:00010000:0.0:1786002692.861576:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2454c8380 00000100:00100000:2.0:1786002692.882088:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002692.887754:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531093760 00000100:00100000:1.0:1786002692.887768:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531093760 00000100:00100000:1.0:1786002692.887834:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5406 00000100:00100000:1.0:1786002692.887844:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531093760:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002692.888986:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969974 is committed 00000100:00100000:1.0:1786002692.891114:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed3433f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531093760:12345-192.168.203.49@tcp:16:dd.0 Request processed in 3265us (9028us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002692.891124:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5406 00000100:00100000:2.0:1786002692.907317:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.907410:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531094016 00000100:00100000:0.0:1786002692.907419:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531094016 00000100:00100000:0.0:1786002692.907481:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24319 00000100:00100000:0.0:1786002692.907492:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+75:22417:x1872758531094016:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002692.907515:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002692.907535:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417c77 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3f1 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907647:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c7e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907661:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c7e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907670:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c7e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907682:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c85 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907687:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c85 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907698:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c85 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907749:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417c8c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907758:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417c8c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907765:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417c8c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002692.907773:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:0.0:1786002692.907841:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c7e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907884:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c7e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907891:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c7e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907898:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c7e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907904:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002692.907907:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c7e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907914:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c7e lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.907930:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:0.0:1786002692.907933:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002692.907937:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c7e lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.908110:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417c7e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.908125:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c85 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.908132:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c85 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.908138:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c85 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.908143:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002692.908146:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c85 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.908153:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c85 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.908161:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002692.908164:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002692.908167:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c85 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.908173:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417c85 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.908212:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417c77 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3f1 expref: 78 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.908227:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417c8c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3f1 expref: 77 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002692.908235:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002692.908237:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002692.908240:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35600, rc 0) 00000100:00100000:0.0:1786002692.908329:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+77:22417:x1872758531094016:12345-192.168.203.49@tcp:101:dd.0 Request processed in 840us (1020us total) trans 4294968732 rc 0/0 00000100:00100000:0.0:1786002692.908335:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24319 00000100:00100000:2.0:1786002692.928146:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002692.928230:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531094272 00000100:00100000:0.0:1786002692.928239:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531094272 00000100:00100000:0.0:1786002692.928296:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5285 00000100:00100000:0.0:1786002692.928307:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+77:22417:x1872758531094272:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:0.0:1786002692.928515:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+78:22417:x1872758531094272:12345-192.168.203.49@tcp:35:dd.0 Request processed in 209us (376us total) trans 4294968733 rc 0/0 00000100:00100000:0.0:1786002692.928523:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5285 00000100:00100000:2.0:1786002692.936051:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.936246:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531094400 00000100:00100000:3.0:1786002692.936256:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531094400 00000100:00100000:3.0:1786002692.936314:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1554 00000100:00100000:3.0:1786002692.936324:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+78:2410:x1872758531094400:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002692.936338:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002692.936361:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417c8c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3f1 expref: 78 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002692.936378:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002692.936383:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002692.936431:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+77:2410:x1872758531094400:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 109us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002692.936438:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1554 00000100:00100000:3.0:1786002692.960574:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002692.960917:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531094528 00000100:00100000:2.0:1786002692.960925:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531094528 00002000:00100000:2.0:1786002692.960978:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed244ff9c00 x1872758531094528/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/0 e 0 to 0 dl 1786002703 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002692.960989:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ff9c00 with x1872758531094528 ext(0->8191) 00002000:00010000:2.0:1786002692.960995:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed244ff9c00 00000100:00100000:2.0:1786002692.961024:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 75 00000100:00100000:2.0:1786002692.961033:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531094528:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:2.0:1786002692.961780:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531094528:12345-192.168.203.49@tcp:4:dd.0 Request processed in 746us (1213us total) trans 4294969975 rc 0/0 00000100:00100000:2.0:1786002692.962490:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 75 00002000:00100000:2.0:1786002692.962499:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed244ff9c00 x1872758531094528/t4294969975(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:373/0 lens 8680/448 e 0 to 0 dl 1786002703 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002692.962507:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ff9c00 with x1872758531094528 ext(0->8191) 00002000:00010000:2.0:1786002692.962512:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed244ff9c00 00000100:00100000:2.0:1786002692.966368:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002692.966442:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531094656 00000100:00100000:3.0:1786002692.966451:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531094656 00000100:00100000:3.0:1786002692.966499:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5407 00000100:00100000:3.0:1786002692.966509:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531094656:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002692.973311:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969975 is committed 00000100:00100000:3.0:1786002692.973478:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531094656:12345-192.168.203.49@tcp:16:dd.0 Request processed in 6965us (7112us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002692.973490:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5407 00000100:00100000:0.0:1786002693.005125:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002693.005889:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531094912 00000100:00100000:1.0:1786002693.005904:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531094912 00000100:00100000:1.0:1786002693.006000:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24320 00000100:00100000:1.0:1786002693.006014:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+77:22419:x1872758531094912:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002693.006045:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002693.006077:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417c9a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3f8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006231:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ca1 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006249:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ca1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006265:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ca1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006281:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417ca8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006289:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417ca8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006296:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417ca8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006361:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417caf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006370:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417caf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006377:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417caf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002693.006387:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:1.0:1786002693.006465:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ca1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006477:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ca1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006484:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ca1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006490:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ca1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006496:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002693.006501:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ca1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006509:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ca1 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006522:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef900) 00010000:00010000:1.0:1786002693.006525:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002693.006529:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ca1 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006535:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417ca1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006549:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417ca8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006556:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417ca8 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006562:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417ca8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006568:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002693.006571:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417ca8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006577:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417ca8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006584:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed2456efc00) 00010000:00010000:1.0:1786002693.006586:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002693.006589:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417ca8 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006594:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417ca8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006649:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417c9a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3f8 expref: 80 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006666:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417caf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3f8 expref: 79 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.006675:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002693.006678:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786002693.006680:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b400, rc 0) 00000100:00100000:1.0:1786002693.006759:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+79:22419:x1872758531094912:12345-192.168.203.49@tcp:101:dd.0 Request processed in 749us (1645us total) trans 4294968734 rc 0/0 00000100:00100000:1.0:1786002693.006767:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24320 00000100:00080000:2.0:1786002693.007085:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1786002693.018260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002693.018339:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002693.018403:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531095296 00000100:00100000:2.0:1786002693.018413:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531095296 00000100:00100000:2.0:1786002693.018465:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5286 00000100:00100000:2.0:1786002693.018474:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+79:22419:x1872758531095296:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:2.0:1786002693.018718:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+80:22419:x1872758531095296:12345-192.168.203.49@tcp:35:dd.0 Request processed in 244us (377us total) trans 4294968735 rc 0/0 00000100:00100000:2.0:1786002693.018726:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5286 00000100:00100000:1.0:1786002693.018925:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531095040 00000100:00100000:1.0:1786002693.018930:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531095040 00000100:00100000:1.0:1786002693.018961:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1555 00000100:00100000:1.0:1786002693.018967:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+80:2412:x1872758531095040:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002693.018977:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002693.018998:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417caf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3f8 expref: 80 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.019014:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002693.019018:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002693.019037:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f47c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+79:2412:x1872758531095040:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 70us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002693.019043:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1555 00000100:00100000:2.0:1786002693.043237:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002693.043610:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531095424 00000100:00100000:0.0:1786002693.043620:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531095424 00000100:00080000:2.0:1786002693.043693:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:0.0:1786002693.043697:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed34b5a9500 x1872758531095424/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:374/0 lens 8680/0 e 0 to 0 dl 1786002704 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002693.043708:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5a9500 with x1872758531095424 ext(0->8191) 00002000:00010000:0.0:1786002693.043713:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5a9500 00000100:00100000:0.0:1786002693.043747:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 76 00000100:00100000:0.0:1786002693.043758:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531095424:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:0.0:1786002693.045156:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531095424:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1396us (1924us total) trans 4294969976 rc 0/0 00000100:00100000:0.0:1786002693.045165:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 76 00002000:00100000:0.0:1786002693.045174:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed34b5a9500 x1872758531095424/t4294969976(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:374/0 lens 8680/448 e 0 to 0 dl 1786002704 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002693.045183:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5a9500 with x1872758531095424 ext(0->8191) 00002000:00010000:0.0:1786002693.045187:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5a9500 00000100:00100000:3.0:1786002693.055905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002693.056014:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531095552 00000100:00100000:1.0:1786002693.056023:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531095552 00000100:00100000:1.0:1786002693.056088:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5408 00000100:00100000:1.0:1786002693.056097:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531095552:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002693.058067:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969976 is committed 00000100:00100000:1.0:1786002693.058308:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531095552:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2208us (2406us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002693.058316:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5408 00010000:00010000:3.0:1786002693.102873:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002693.111282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002693.111664:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531095808 00000100:00100000:3.0:1786002693.111682:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531095808 00000100:00100000:3.0:1786002693.111734:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24321 00000100:00100000:3.0:1786002693.111743:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+79:22420:x1872758531095808:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1786002693.111763:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002693.111782:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417cbd lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b3ff expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.111906:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417cc4 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.111921:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417cc4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.111931:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417cc4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.111953:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417ccb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.111959:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417ccb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.111965:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417ccb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112012:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417cd2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112019:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112025:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417cd2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002693.112032:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:3.0:1786002693.112103:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417cc4 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112110:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417cc4 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112115:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417cc4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112120:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417cc4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112287:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002693.112291:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417cc4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112298:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417cc4 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112308:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed366c05600) 00010000:00010000:3.0:1786002693.112311:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002693.112315:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417cc4 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112320:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417cc4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112331:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417ccb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112336:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417ccb lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112341:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417ccb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112345:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002693.112348:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417ccb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112356:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417ccb lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112362:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed366c05e00) 00010000:00010000:3.0:1786002693.112364:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002693.112366:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417ccb lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112370:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417ccb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112409:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417cbd lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3ff expref: 82 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112435:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3ff expref: 81 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.112441:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002693.112443:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786002693.112445:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca7000, rc 0) 00000100:00100000:3.0:1786002693.112552:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+81:22420:x1872758531095808:12345-192.168.203.49@tcp:101:dd.0 Request processed in 809us (1277us total) trans 4294968736 rc 0/0 00000100:00100000:3.0:1786002693.112559:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24321 00000100:00100000:2.0:1786002693.126668:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002693.127192:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531096064 00000100:00100000:0.0:1786002693.127201:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531096064 00000100:00100000:0.0:1786002693.127256:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5287 00000100:00100000:0.0:1786002693.127265:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+81:22420:x1872758531096064:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:0.0:1786002693.127508:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+82:22420:x1872758531096064:12345-192.168.203.49@tcp:35:dd.0 Request processed in 243us (848us total) trans 4294968737 rc 0/0 00000100:00100000:0.0:1786002693.127514:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5287 00000100:00100000:2.0:1786002693.128808:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002693.128919:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531096192 00000100:00100000:1.0:1786002693.128925:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531096192 00000100:00100000:1.0:1786002693.128975:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1556 00000100:00100000:1.0:1786002693.128983:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+82:2413:x1872758531096192:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002693.128994:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002693.129017:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af578417cd2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b3ff expref: 82 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.129049:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002693.129055:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002693.129079:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+81:2413:x1872758531096192:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 97us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002693.129085:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1556 00000100:00100000:0.0:1786002693.144545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002693.144692:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531096320 00000100:00100000:1.0:1786002693.144701:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531096320 00002000:00100000:1.0:1786002693.144753:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed2419af480 x1872758531096320/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:374/0 lens 8680/0 e 0 to 0 dl 1786002704 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002693.144764:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2419af480 with x1872758531096320 ext(0->8191) 00002000:00010000:1.0:1786002693.144770:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2419af480 00000100:00100000:1.0:1786002693.144805:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 77 00000100:00100000:1.0:1786002693.144816:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531096320:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002693.149382:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531096320:12345-192.168.203.49@tcp:4:dd.0 Request processed in 4560us (4839us total) trans 4294969977 rc 0/0 00000100:00100000:3.0:1786002693.149394:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 77 00002000:00100000:3.0:1786002693.149405:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed2419af480 x1872758531096320/t4294969977(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:374/0 lens 8680/448 e 0 to 0 dl 1786002704 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002693.149415:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2419af480 with x1872758531096320 ext(0->8191) 00002000:00010000:3.0:1786002693.149421:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2419af480 00000100:00100000:3.0:1786002693.170367:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002693.170515:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531096448 00000100:00100000:2.0:1786002693.170523:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531096448 00000100:00100000:2.0:1786002693.170584:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5409 00000100:00100000:2.0:1786002693.170594:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531096448:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:1.0:1786002693.172063:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969977 is committed 00000100:00100000:2.0:1786002693.172260:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531096448:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1665us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002693.172269:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5409 00000100:00100000:2.0:1786002693.220755:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002693.220887:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531096704 00000100:00100000:0.0:1786002693.220897:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531096704 00000100:00100000:0.0:1786002693.220967:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24322 00000100:00100000:0.0:1786002693.220978:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+81:22421:x1872758531096704:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002693.221002:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002693.221024:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578417ce0 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b406 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221153:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417ce7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221167:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417ce7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221179:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417ce7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221192:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417cee lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221199:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417cee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221206:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417cee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221259:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417cf5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221268:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221275:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002693.221285:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:0.0:1786002693.221358:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417ce7 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221367:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417ce7 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221373:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417ce7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221380:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417ce7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221386:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002693.221390:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417ce7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221398:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417ce7 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221410:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:0.0:1786002693.221413:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002693.221418:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417ce7 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221424:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417ce7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221436:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417cee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221442:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417cee lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221452:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417cee lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221457:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002693.221460:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417cee lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221466:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417cee lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221473:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002693.221476:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002693.221478:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417cee lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221484:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417cee lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221521:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578417ce0 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b406 expref: 84 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221535:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b406 expref: 83 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.221542:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002693.221544:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002693.221546:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35200, rc 0) 00000100:00100000:0.0:1786002693.221618:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+83:22421:x1872758531096704:12345-192.168.203.49@tcp:101:dd.0 Request processed in 642us (872us total) trans 4294968738 rc 0/0 00000100:00100000:0.0:1786002693.221627:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24322 00000100:00100000:0.0:1786002693.230147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002693.230202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002693.230333:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531097088 00000100:00100000:1.0:1786002693.230358:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531097088 00000100:00100000:1.0:1786002693.230423:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1557 00000100:00100000:1.0:1786002693.230433:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed347f54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+83:2411:x1872758531097088:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002693.230447:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002693.230483:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417cf5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b406 expref: 83 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002693.230507:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002693.230517:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002693.230604:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed347f54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+82:2411:x1872758531097088:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 166us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002693.230617:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1557 00000100:00100000:2.0:1786002693.230944:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531096960 00000100:00100000:2.0:1786002693.230949:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531096960 00000100:00100000:2.0:1786002693.230987:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5288 00000100:00100000:2.0:1786002693.230994:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+82:22421:x1872758531096960:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:2.0:1786002693.231207:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+83:22421:x1872758531096960:12345-192.168.203.49@tcp:35:dd.0 Request processed in 213us (1069us total) trans 4294968739 rc 0/0 00000100:00100000:2.0:1786002693.231214:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5288 00000100:00100000:3.0:1786002693.253362:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002693.253445:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531097216 00000100:00100000:0.0:1786002693.253455:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531097216 00002000:00100000:0.0:1786002693.253496:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed244ffaa00 x1872758531097216/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:374/0 lens 8680/0 e 0 to 0 dl 1786002704 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002693.253507:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ffaa00 with x1872758531097216 ext(0->8191) 00002000:00010000:0.0:1786002693.253512:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed244ffaa00 00000100:00100000:0.0:1786002693.253542:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 78 00000100:00100000:0.0:1786002693.253551:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531097216:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:0.0:1786002693.254357:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531097216:12345-192.168.203.49@tcp:4:dd.0 Request processed in 805us (1001us total) trans 4294969978 rc 0/0 00000100:00100000:0.0:1786002693.254366:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 78 00002000:00100000:0.0:1786002693.254374:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed244ffaa00 x1872758531097216/t4294969978(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:374/0 lens 8680/448 e 0 to 0 dl 1786002704 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002693.254383:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ffaa00 with x1872758531097216 ext(0->8191) 00002000:00010000:0.0:1786002693.254387:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed244ffaa00 00000100:00100000:0.0:1786002693.289461:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002693.289534:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531097344 00000100:00100000:3.0:1786002693.289543:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531097344 00000100:00100000:3.0:1786002693.289611:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5410 00000100:00100000:3.0:1786002693.289620:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531097344:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002693.291875:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969978 is committed 00000100:00100000:3.0:1786002693.292022:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531097344:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2400us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002693.292032:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5410 00000100:00100000:2.0:1786002693.321814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002693.321936:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531097600 00000100:00100000:0.0:1786002693.321956:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531097600 00000100:00100000:0.0:1786002693.322017:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24323 00000100:00100000:0.0:1786002693.322028:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+83:22422:x1872758531097600:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002693.322064:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002693.322087:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417d03 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b40d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322205:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417d0a lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322219:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417d0a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322232:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417d0a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322244:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417d11 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322251:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417d11 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322257:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417d11 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322313:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578417d18 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322322:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578417d18 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322329:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578417d18 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002693.322338:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:0.0:1786002693.322412:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417d0a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322420:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417d0a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322426:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417d0a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322433:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417d0a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322439:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002693.322443:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417d0a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322450:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417d0a lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322461:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:0.0:1786002693.322464:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002693.322481:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417d0a lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322488:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417d0a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322501:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417d11 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322507:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417d11 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322518:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417d11 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322523:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002693.322526:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417d11 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322532:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417d11 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322540:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002693.322542:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002693.322545:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417d11 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322551:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417d11 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322614:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417d03 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b40d expref: 86 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322631:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578417d18 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b40d expref: 85 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.322638:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002693.322641:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002693.322643:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35a00, rc 0) 00000100:00100000:0.0:1786002693.322706:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+85:22422:x1872758531097600:12345-192.168.203.49@tcp:101:dd.0 Request processed in 680us (901us total) trans 4294968740 rc 0/0 00000100:00100000:0.0:1786002693.322717:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24323 00000100:00100000:2.0:1786002693.338679:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002693.338774:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002693.338904:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531097984 00000100:00100000:3.0:1786002693.338913:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531097984 00000100:00100000:3.0:1786002693.338981:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1558 00000100:00100000:3.0:1786002693.338992:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+85:2413:x1872758531097984:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002693.339007:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002693.339032:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578417d18 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b40d expref: 85 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.339061:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002693.339066:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002693.339130:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+84:2413:x1872758531097984:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 131us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002693.339138:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1558 00000100:00100000:1.0:1786002693.339531:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531097856 00000100:00100000:1.0:1786002693.339536:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531097856 00000100:00100000:1.0:1786002693.339583:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5289 00000100:00100000:1.0:1786002693.339590:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+84:22422:x1872758531097856:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002693.339796:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+85:22422:x1872758531097856:12345-192.168.203.49@tcp:35:dd.0 Request processed in 206us (1125us total) trans 4294968741 rc 0/0 00000100:00100000:1.0:1786002693.339803:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5289 00000100:00100000:1.0:1786002693.358488:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002693.358639:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531098112 00000100:00100000:3.0:1786002693.358648:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531098112 00002000:00100000:3.0:1786002693.358696:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f4de300 x1872758531098112/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:374/0 lens 8680/0 e 0 to 0 dl 1786002704 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002693.358706:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f4de300 with x1872758531098112 ext(0->8191) 00002000:00010000:3.0:1786002693.358712:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f4de300 00000100:00100000:3.0:1786002693.358741:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 79 00000100:00100000:3.0:1786002693.358750:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531098112:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002693.361412:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531098112:12345-192.168.203.49@tcp:4:dd.0 Request processed in 2657us (2928us total) trans 4294969979 rc 0/0 00000100:00100000:3.0:1786002693.361430:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 79 00002000:00100000:3.0:1786002693.361439:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37f4de300 x1872758531098112/t4294969979(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:374/0 lens 8680/448 e 0 to 0 dl 1786002704 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002693.361449:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f4de300 with x1872758531098112 ext(0->8191) 00002000:00010000:3.0:1786002693.361454:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f4de300 00000100:00100000:2.0:1786002693.398026:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002693.398254:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531098240 00000100:00100000:0.0:1786002693.398264:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531098240 00000100:00100000:0.0:1786002693.398320:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5411 00000100:00100000:0.0:1786002693.398329:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531098240:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:1.0:1786002693.403260:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969979 is committed 00000100:00100000:0.0:1786002693.403435:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531098240:12345-192.168.203.49@tcp:16:dd.0 Request processed in 5093us (5405us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002693.403447:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5411 00000100:00100000:2.0:1786002693.444939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002693.450911:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531098496 00000100:00100000:3.0:1786002693.450925:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531098496 00000100:00100000:3.0:1786002693.451000:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24324 00000100:00100000:3.0:1786002693.451012:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+85:22423:x1872758531098496:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1786002693.451034:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002693.451055:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d26 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b414 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451158:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d2d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451171:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d2d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451182:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d2d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451196:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d34 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451204:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d34 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451211:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d34 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451258:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d3b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451267:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d3b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451273:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d3b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002693.451281:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:3.0:1786002693.451347:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d2d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451354:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d2d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451360:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d2d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451367:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d2d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451373:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002693.451377:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d2d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451383:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d2d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451393:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed366c05600) 00010000:00010000:3.0:1786002693.451396:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002693.451399:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d2d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451405:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d2d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451416:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d34 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451422:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d34 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451427:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d34 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451431:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002693.451434:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d34 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451439:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d34 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451448:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed366c05e00) 00010000:00010000:3.0:1786002693.451450:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002693.451453:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d34 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451458:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d34 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451498:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d26 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b414 expref: 88 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451525:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d3b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b414 expref: 87 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.451532:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002693.451534:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786002693.451536:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca7600, rc 0) 00000100:00100000:3.0:1786002693.451609:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+87:22423:x1872758531098496:12345-192.168.203.49@tcp:101:dd.0 Request processed in 590us (6670us total) trans 4294968742 rc 0/0 00000100:00100000:3.0:1786002693.451616:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24324 00000100:00100000:1.0:1786002693.473101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002693.473191:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531098624 00000100:00100000:3.0:1786002693.473200:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531098624 00000100:00100000:3.0:1786002693.473262:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1559 00000100:00100000:3.0:1786002693.473272:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+87:2413:x1872758531098624:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002693.473285:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002693.473308:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d3b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b414 expref: 87 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.473329:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002693.473334:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002693.473388:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+86:2413:x1872758531098624:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 118us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002693.473396:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1559 00000100:00100000:2.0:1786002693.483905:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561085824:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.483969:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002693.484029:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561086336:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.484052:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002693.484067:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561086848:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.484086:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002693.484109:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1786002693.484114:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758561085696:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.484140:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002693.484159:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561086208:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.484182:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002693.484199:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561086720:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.484221:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002693.484237:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561087232:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.484255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002693.484284:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561085824 00000100:00100000:2.0:1786002693.484290:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561085824 00000100:00100000:2.0:1786002693.484331:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561086336 00000100:00100000:2.0:1786002693.484335:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561086336 00000100:00100000:2.0:1786002693.484359:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561086848 00000100:00100000:2.0:1786002693.484361:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561086848 00000100:00100000:2.0:1786002693.484378:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:2.0:1786002693.484387:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561085824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.484436:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561085824:12345-0@lo:400:kworker.0 Request processed in 50us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002693.484444:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:2.0:1786002693.484460:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1786002693.484467:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561086336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.484494:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561086336:12345-0@lo:400:kworker.0 Request processed in 28us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002693.484500:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1786002693.484511:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1786002693.484518:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561086848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.484543:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561086848:12345-0@lo:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002693.484548:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1786002693.484567:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561085696 00000100:00100000:2.0:1786002693.484570:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561085696 00000100:00100000:2.0:1786002693.484618:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1786002693.484786:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758561085696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.484822:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3647:x1872758561085696:12345-0@lo:400:kworker.0 Request processed in 198us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002693.484828:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1786002693.484872:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561086208 00000100:00100000:2.0:1786002693.484876:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561086208 00000100:00100000:2.0:1786002693.484901:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4165 00000100:00100000:2.0:1786002693.484907:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561086208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.484937:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561086208:12345-0@lo:400:kworker.0 Request processed in 30us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002693.484943:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4165 00000100:00100000:2.0:1786002693.484960:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561086720 00000100:00100000:2.0:1786002693.484962:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561086720 00000100:00100000:2.0:1786002693.484981:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561087232 00000100:00100000:2.0:1786002693.484984:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561087232 00000100:00100000:2.0:1786002693.485001:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1786002693.485007:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561086720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.485037:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561086720:12345-0@lo:400:kworker.0 Request processed in 30us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002693.485042:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1786002693.485053:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1786002693.485058:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561087232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.485080:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561087232:12345-0@lo:400:kworker.0 Request processed in 23us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002693.485085:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00080000:2.0:1786002693.485103:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786002693.485107:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786002693.485109:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002693.485140:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:338407c0-17ce-47f6-a10f-807d82c493cd:3647:1872758561085696:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.485150:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561086208:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.485158:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561086720:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.485166:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561087232:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.485173:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561085824:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.485182:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561086336:0@lo:400:kworker.0 00000100:00100000:2.0:1786002693.485190:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561086848:0@lo:400:kworker.0 00000100:00100000:3.0:1786002693.485824:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561085568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786002693.485874:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002693.485896:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561086080:0@lo:400:kworker.0 00000100:00100000:3.0:1786002693.485918:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002693.485930:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786002693.485931:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561086592:0@lo:400:kworker.0 00000100:00100000:1.0:1786002693.485938:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f4df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561087360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002693.485964:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002693.485964:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002693.485981:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561087104:0@lo:400:kworker.0 00000100:00100000:3.0:1786002693.486000:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002693.486028:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1786002693.486034:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561085952:0@lo:400:kworker.0 00000100:00100000:0.0:1786002693.486045:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561086080 00000100:00100000:0.0:1786002693.486049:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561086080 00000100:00100000:3.0:1786002693.486067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002693.486079:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1786002693.486083:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561086464:0@lo:400:kworker.0 00000100:00100000:0.0:1786002693.486085:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561086080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002693.486101:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002693.486116:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561086080:12345-0@lo:400:kworker.0 Request processed in 32us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002693.486117:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561086976:0@lo:400:kworker.0 00000100:00100000:0.0:1786002693.486122:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1786002693.486135:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561086464 00000100:00100000:0.0:1786002693.486138:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561086464 00000100:00080000:0.0:1786002693.486154:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786002693.486164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002693.486174:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561086976 00000100:00100000:0.0:1786002693.486178:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561086976 00000100:00100000:3.0:1786002693.486189:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561086080:0@lo:400:kworker.0 00000100:00100000:0.0:1786002693.486198:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1786002693.486203:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561086464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002693.486208:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561085568 00000100:00100000:3.0:1786002693.486211:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561085568 00000100:00100000:3.0:1786002693.486235:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561087360 00000100:00100000:0.0:1786002693.486236:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561086464:12345-0@lo:400:kworker.0 Request processed in 32us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002693.486238:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561087360 00000100:00100000:0.0:1786002693.486242:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1786002693.486251:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1786002693.486253:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1786002693.486256:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561085568:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002693.486259:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561086976:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1786002693.486270:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 319645376 pending 0 free 3923439616 avail 3691360256 00000100:00100000:0.0:1786002693.486282:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561086976:12345-0@lo:400:kworker.0 Request processed in 23us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002693.486288:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1786002693.486294:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561085568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002693.486300:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1786002693.486311:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:0.0:1786002693.486311:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561086464:0@lo:400:kworker.0 00000100:00100000:3.0:1786002693.486317:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561087360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002693.486320:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561086976:0@lo:400:kworker.0 00002000:00000024:3.0:1786002693.486326:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 319645376 pending 0 free 3923439616 avail 3691360256 00000100:00100000:0.0:1786002693.486332:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561085568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1786002693.486352:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561087360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (388us total) trans 0 rc 0/0 00000100:00080000:0.0:1786002693.486354:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786002693.486356:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786002693.486357:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1786002693.486375:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561086592 00000100:00100000:3.0:1786002693.486379:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561086592 00000100:00100000:1.0:1786002693.486406:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561087104 00000100:00100000:1.0:1786002693.486410:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561087104 00000100:00100000:3.0:1786002693.486412:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1786002693.486417:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561086592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002693.486431:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1786002693.486436:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561087104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002693.486451:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561086592:12345-0@lo:400:kworker.0 Request processed in 33us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002693.486456:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:1.0:1786002693.486462:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561087104:12345-0@lo:400:kworker.0 Request processed in 26us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002693.486472:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561085952 00000100:00100000:3.0:1786002693.486476:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561085952 00000100:00100000:1.0:1786002693.486480:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1786002693.486497:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4166 00000100:00100000:3.0:1786002693.486503:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:3645:x1872758561085952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002693.486533:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:3645:x1872758561085952:12345-0@lo:400:kworker.0 Request processed in 31us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002693.486541:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4166 00000100:00100000:3.0:1786002693.486570:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561085952:0@lo:400:kworker.0 00000100:00100000:3.0:1786002693.486580:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561086592:0@lo:400:kworker.0 00000100:00100000:3.0:1786002693.486587:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561087104:0@lo:400:kworker.0 00000100:00100000:3.0:1786002693.486627:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f4df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561087360:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786002693.487416:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002693.508817:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002693.508938:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531098880 00000100:00100000:1.0:1786002693.508948:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531098880 00000100:00100000:1.0:1786002693.509006:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5290 00000100:00100000:1.0:1786002693.509017:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+86:22423:x1872758531098880:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002693.509240:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+87:22423:x1872758531098880:12345-192.168.203.49@tcp:35:dd.0 Request processed in 224us (430us total) trans 4294968743 rc 0/0 00000100:00100000:1.0:1786002693.509248:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5290 00000100:00100000:0.0:1786002693.530290:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002693.530610:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531099008 00000100:00100000:3.0:1786002693.530620:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531099008 00002000:00100000:3.0:1786002693.530665:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37137ed80 x1872758531099008/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:374/0 lens 8680/0 e 0 to 0 dl 1786002704 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002693.530675:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37137ed80 with x1872758531099008 ext(0->8191) 00002000:00010000:3.0:1786002693.530681:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37137ed80 00000100:00100000:3.0:1786002693.530708:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 80 00000100:00100000:3.0:1786002693.530718:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531099008:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002693.532238:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531099008:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1517us (1953us total) trans 4294969980 rc 0/0 00000100:00100000:3.0:1786002693.532248:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 80 00002000:00100000:3.0:1786002693.532257:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed37137ed80 x1872758531099008/t4294969980(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:374/0 lens 8680/448 e 0 to 0 dl 1786002704 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002693.532267:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37137ed80 with x1872758531099008 ext(0->8191) 00002000:00010000:3.0:1786002693.532272:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37137ed80 00000100:00100000:0.0:1786002693.547998:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002693.548715:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531099136 00000100:00100000:2.0:1786002693.548725:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531099136 00000100:00100000:2.0:1786002693.548788:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5412 00000100:00100000:2.0:1786002693.548798:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531099136:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:1.0:1786002693.550743:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969980 is committed 00000100:00100000:2.0:1786002693.551092:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531099136:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2292us (3099us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002693.551102:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5412 00000100:00100000:2.0:1786002693.591663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002693.591894:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531099392 00000100:00100000:0.0:1786002693.591903:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531099392 00000100:00100000:0.0:1786002693.591974:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24325 00000100:00100000:0.0:1786002693.591985:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+87:22424:x1872758531099392:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002693.592008:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002693.592029:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417d49 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b41b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592145:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417d50 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592158:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417d50 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592169:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417d50 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592182:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417d57 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592190:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417d57 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592197:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417d57 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592248:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417d5e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592258:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417d5e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592265:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417d5e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002693.592273:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:0.0:1786002693.592347:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417d50 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592355:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417d50 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592362:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417d50 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592369:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417d50 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592376:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002693.592380:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417d50 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592388:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417d50 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592399:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:0.0:1786002693.592403:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002693.592406:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417d50 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592412:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417d50 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592425:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417d57 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592431:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417d57 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592437:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417d57 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592443:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002693.592445:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417d57 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592451:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417d57 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592458:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002693.592460:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002693.592463:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417d57 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592475:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417d57 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592512:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417d49 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b41b expref: 90 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592526:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417d5e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b41b expref: 89 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002693.592534:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002693.592536:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002693.592539:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34c00, rc 0) 00000100:00100000:0.0:1786002693.592777:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+89:22424:x1872758531099392:12345-192.168.203.49@tcp:101:dd.0 Request processed in 793us (1123us total) trans 4294968744 rc 0/0 00000100:00100000:0.0:1786002693.592786:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24325 00000100:00100000:0.0:1786002693.616184:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002693.616257:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531099520 00000100:00100000:3.0:1786002693.616266:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531099520 00000100:00100000:3.0:1786002693.616323:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1560 00000100:00100000:3.0:1786002693.616332:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+89:2411:x1872758531099520:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002693.616346:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002693.616368:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417d5e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b41b expref: 89 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.616383:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002693.616387:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002693.616436:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+88:2411:x1872758531099520:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 105us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002693.616442:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1560 00000100:00100000:1.0:1786002693.631356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002693.631448:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531099776 00000100:00100000:0.0:1786002693.631457:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531099776 00000100:00100000:0.0:1786002693.631525:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5291 00000100:00100000:0.0:1786002693.631536:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+88:22424:x1872758531099776:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:0.0:1786002693.632060:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+89:22424:x1872758531099776:12345-192.168.203.49@tcp:35:dd.0 Request processed in 525us (712us total) trans 4294968745 rc 0/0 00000100:00100000:0.0:1786002693.632068:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5291 00000100:00100000:2.0:1786002693.653344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002693.653435:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531099904 00000100:00100000:3.0:1786002693.653444:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531099904 00002000:00100000:3.0:1786002693.653499:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed34b5ad500 x1872758531099904/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:374/0 lens 8680/0 e 0 to 0 dl 1786002704 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002693.653509:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5ad500 with x1872758531099904 ext(0->8191) 00002000:00010000:3.0:1786002693.653514:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5ad500 00000100:00100000:3.0:1786002693.653545:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 81 00000100:00100000:3.0:1786002693.653555:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531099904:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002693.655104:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531099904:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1548us (1765us total) trans 4294969981 rc 0/0 00000100:00100000:3.0:1786002693.655113:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 81 00002000:00100000:3.0:1786002693.655131:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (0->8191) req@ffff9ed34b5ad500 x1872758531099904/t4294969981(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:374/0 lens 8680/448 e 0 to 0 dl 1786002704 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002693.655139:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5ad500 with x1872758531099904 ext(0->8191) 00002000:00010000:3.0:1786002693.655144:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5ad500 00000100:00100000:2.0:1786002693.695899:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002693.696109:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531100032 00000100:00100000:0.0:1786002693.696118:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531100032 00000100:00100000:0.0:1786002693.696177:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5413 00000100:00100000:0.0:1786002693.696188:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531100032:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:1.0:1786002693.697896:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969981 is committed 00000100:00100000:0.0:1786002693.698112:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531100032:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1922us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002693.698129:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5413 00000100:00100000:1.0:1786002693.981216:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002693.981291:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531100288 00000100:00100000:3.0:1786002693.981300:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531100288 00000100:00100000:3.0:1786002693.981358:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24326 00000100:00100000:3.0:1786002693.981367:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+89:22431:x1872758531100288:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1786002693.981387:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002693.981407:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d6c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b422 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981513:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d73 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981527:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d73 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981540:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d73 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981553:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d7a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981560:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d7a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981566:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d7a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981643:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d81 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981653:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d81 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981664:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d81 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002693.981674:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:3.0:1786002693.981753:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d73 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981928:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d73 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981942:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d73 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981949:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d73 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981955:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002693.981959:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d73 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981966:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d73 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981979:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed366c05600) 00010000:00010000:3.0:1786002693.981982:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002693.981986:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d73 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.981992:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417d73 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.982008:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d7a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.982014:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d7a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.982019:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d7a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.982023:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002693.982025:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d7a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.982030:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d7a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.982036:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed366c05e00) 00010000:00010000:3.0:1786002693.982038:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002693.982040:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d7a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.982045:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d7a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.982083:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d6c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b422 expref: 92 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.982096:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d81 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b422 expref: 91 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.982108:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002693.982110:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786002693.982112:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca6e00, rc 0) 00000100:00100000:3.0:1786002693.982167:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+91:22431:x1872758531100288:12345-192.168.203.49@tcp:101:dd.0 Request processed in 800us (958us total) trans 4294968746 rc 0/0 00000100:00100000:3.0:1786002693.982173:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24326 00000100:00100000:2.0:1786002693.993103:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002693.993150:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002693.993258:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531100544 00000100:00100000:1.0:1786002693.993268:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531100544 00000100:00100000:1.0:1786002693.993320:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5292 00000100:00100000:1.0:1786002693.993328:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+91:22431:x1872758531100544:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002693.993533:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+92:22431:x1872758531100544:12345-192.168.203.49@tcp:35:dd.0 Request processed in 204us (437us total) trans 4294968747 rc 0/0 00000100:00100000:1.0:1786002693.993540:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5292 00000100:00100000:3.0:1786002693.997481:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531100672 00000100:00100000:3.0:1786002693.997493:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531100672 00000100:00100000:3.0:1786002693.997557:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1561 00000100:00100000:3.0:1786002693.997568:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+92:2411:x1872758531100672:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002693.997580:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002693.997621:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d81 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b422 expref: 92 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002693.997637:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002693.997641:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002693.997695:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+91:2411:x1872758531100672:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 120us (4534us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002693.997703:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1561 00000100:00100000:2.0:1786002694.022620:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002694.022815:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531100800 00000100:00100000:3.0:1786002694.022824:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531100800 00002000:00100000:3.0:1786002694.022897:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (4096->12287) req@ffff9ed34b5ae680 x1872758531100800/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/0 e 0 to 0 dl 1786002705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002694.022908:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5ae680 with x1872758531100800 ext(4096->12287) 00002000:00010000:3.0:1786002694.022914:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5ae680 00000100:00100000:3.0:1786002694.022945:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 82 00000100:00100000:3.0:1786002694.022955:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531100800:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002694.024908:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758531100800:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1948us (2307us total) trans 4294969983 rc 0/0 00000100:00100000:3.0:1786002694.024918:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 82 00002000:00100000:3.0:1786002694.024928:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (4096->12287) req@ffff9ed34b5ae680 x1872758531100800/t4294969983(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/448 e 0 to 0 dl 1786002705 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002694.024946:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5ae680 with x1872758531100800 ext(4096->12287) 00002000:00010000:3.0:1786002694.024951:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5ae680 00000100:00100000:0.0:1786002694.035505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.035601:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531100928 00000100:00100000:2.0:1786002694.035611:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531100928 00000100:00100000:2.0:1786002694.035666:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5414 00000100:00100000:2.0:1786002694.035676:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758531100928:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:1.0:1786002694.039472:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969983 is committed 00000100:00100000:2.0:1786002694.039673:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531100928:12345-192.168.203.49@tcp:16:dd.0 Request processed in 3993us (4171us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002694.039685:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5414 00000100:00100000:2.0:1786002694.077334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002694.077404:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531101184 00000100:00100000:3.0:1786002694.077413:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531101184 00000100:00100000:3.0:1786002694.077476:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24327 00000100:00100000:3.0:1786002694.077486:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+91:22432:x1872758531101184:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1786002694.077507:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002694.077529:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d8f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b429 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077658:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d96 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077672:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d96 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077682:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d96 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077695:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d9d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077703:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d9d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077710:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d9d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077759:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417da4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077769:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417da4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077776:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417da4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002694.077786:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 8192 00010000:00010000:3.0:1786002694.077883:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d96 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077890:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d96 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077895:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d96 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077901:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d96 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077906:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002694.077909:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d96 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077918:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d96 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.077928:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed366c05600) 00010000:00010000:3.0:1786002694.078228:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002694.078233:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d96 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.078239:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af578417d96 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.078251:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d9d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.078256:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d9d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.078261:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d9d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.078265:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002694.078268:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d9d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.078272:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d9d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.078278:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed366c05e00) 00010000:00010000:3.0:1786002694.078280:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002694.078282:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d9d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.078288:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578417d9d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.078405:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578417d8f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b429 expref: 94 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.078422:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417da4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b429 expref: 93 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.078428:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002694.078431:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786002694.078433:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca6800, rc 0) 00000100:00100000:2.0:1786002694.078524:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+93:22432:x1872758531101184:12345-192.168.203.49@tcp:101:dd.0 Request processed in 1038us (1196us total) trans 4294968748 rc 0/0 00000100:00100000:2.0:1786002694.078531:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24327 00000100:00100000:0.0:1786002694.093072:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002694.093109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.093201:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531101440 00000100:00100000:1.0:1786002694.093211:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531101440 00000100:00100000:1.0:1786002694.093263:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5293 00000100:00100000:1.0:1786002694.093271:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+93:22432:x1872758531101440:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:1.0:1786002694.093472:0:14493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968749 00000100:00100000:1.0:1786002694.093558:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+95:22432:x1872758531101440:12345-192.168.203.49@tcp:35:dd.0 Request processed in 287us (494us total) trans 4294968750 rc 0/0 00000100:00100000:1.0:1786002694.093565:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5293 00000020:00080000:1.0:1786002694.093580:0:14493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002694.102206:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531101568 00000100:00100000:3.0:1786002694.102220:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531101568 00000100:00100000:2.0:1786002694.102424:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1562 00000100:00100000:2.0:1786002694.102435:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+95:2410:x1872758531101568:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002694.102450:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002694.102473:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578417da4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b429 expref: 95 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.102489:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002694.102494:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002694.102558:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+94:2410:x1872758531101568:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 124us (9448us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002694.102565:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1562 00000100:00100000:2.0:1786002694.108000:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002694.108113:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531101696 00000100:00100000:3.0:1786002694.108130:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531101696 00002000:00100000:3.0:1786002694.108175:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (8192->16383) req@ffff9ed34b5af800 x1872758531101696/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/0 e 0 to 0 dl 1786002705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002694.108185:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5af800 with x1872758531101696 ext(8192->16383) 00002000:00010000:3.0:1786002694.108190:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5af800 00000100:00100000:3.0:1786002694.108218:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 83 00000100:00100000:3.0:1786002694.108227:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531101696:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002694.111226:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758531101696:12345-192.168.203.49@tcp:4:dd.0 Request processed in 2991us (3226us total) trans 4294969985 rc 0/0 00000100:00100000:1.0:1786002694.111243:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 83 00002000:00100000:1.0:1786002694.111254:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (8192->16383) req@ffff9ed34b5af800 x1872758531101696/t4294969985(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/448 e 0 to 0 dl 1786002705 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002694.111264:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5af800 with x1872758531101696 ext(8192->16383) 00002000:00010000:1.0:1786002694.111270:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5af800 00010000:00010000:3.0:1786002694.124212:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002694.126322:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002694.126490:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531101824 00000100:00100000:3.0:1786002694.126498:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531101824 00000100:00100000:3.0:1786002694.126550:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5415 00000100:00100000:3.0:1786002694.126559:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2411:x1872758531101824:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002694.129238:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969985 is committed 00000100:00100000:3.0:1786002694.129401:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531101824:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2838us (3082us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002694.129412:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5415 00000100:00100000:0.0:1786002694.154490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.156225:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531102080 00000100:00100000:2.0:1786002694.156236:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531102080 00000100:00100000:2.0:1786002694.156302:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24328 00000100:00100000:2.0:1786002694.156312:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+94:22433:x1872758531102080:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002694.156334:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002694.156354:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c200/0x7cee4af578417db2 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b430 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.156454:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417db9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.156477:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417db9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.156488:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417db9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.156501:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417dc0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.156507:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.156513:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.156560:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578417dc7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157020:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578417dc7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157032:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578417dc7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002694.157042:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 12288 00010000:00010000:2.0:1786002694.157112:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417db9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157130:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417db9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157136:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417db9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157142:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417db9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157148:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002694.157152:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417db9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157158:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417db9 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157170:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed243d0b000) 00010000:00010000:2.0:1786002694.157173:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002694.157177:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417db9 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157183:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417db9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157195:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417dc0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157201:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417dc0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157210:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417dc0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157215:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2dc00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002694.157217:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417dc0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157222:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417dc0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157228:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed243d0b200) 00010000:00010000:2.0:1786002694.157230:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002694.157232:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417dc0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157238:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417dc0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157273:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c200/0x7cee4af578417db2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b430 expref: 97 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157286:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578417dc7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b430 expref: 96 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.157293:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002694.157295:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786002694.157297:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2da00, rc 0) 00000100:00100000:2.0:1786002694.157359:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+96:22433:x1872758531102080:12345-192.168.203.49@tcp:101:dd.0 Request processed in 1048us (2877us total) trans 4294968751 rc 0/0 00000100:00100000:2.0:1786002694.157369:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24328 00000100:00100000:2.0:1786002694.162303:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.162381:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.163889:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531102464 00000100:00100000:1.0:1786002694.163899:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531102464 00000100:00100000:1.0:1786002694.163968:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1563 00000100:00100000:1.0:1786002694.163977:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+96:2410:x1872758531102464:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002694.163992:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002694.164014:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578417dc7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b430 expref: 96 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002694.164033:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002694.164037:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002694.164089:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+95:2410:x1872758531102464:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 112us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002694.164096:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1563 00000100:00100000:3.0:1786002694.164440:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531102336 00000100:00100000:3.0:1786002694.164444:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531102336 00000100:00100000:3.0:1786002694.164487:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5294 00000100:00100000:3.0:1786002694.164495:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+95:22433:x1872758531102336:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:3.0:1786002694.164761:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+96:22433:x1872758531102336:12345-192.168.203.49@tcp:35:dd.0 Request processed in 260us (2459us total) trans 4294968752 rc 0/0 00000100:00100000:3.0:1786002694.164768:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5294 00000100:00100000:2.0:1786002694.202511:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002694.202585:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531102592 00000100:00100000:3.0:1786002694.202604:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531102592 00002000:00100000:3.0:1786002694.202650:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (12288->20479) req@ffff9ed34b5af100 x1872758531102592/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/0 e 0 to 0 dl 1786002705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002694.202662:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5af100 with x1872758531102592 ext(12288->20479) 00002000:00010000:3.0:1786002694.202678:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5af100 00000100:00100000:3.0:1786002694.202705:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 84 00000100:00100000:3.0:1786002694.202714:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531102592:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002694.204121:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758531102592:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1396us (1607us total) trans 4294969987 rc 0/0 00000100:00100000:3.0:1786002694.204129:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 84 00002000:00100000:3.0:1786002694.204138:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (12288->20479) req@ffff9ed34b5af100 x1872758531102592/t4294969987(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/448 e 0 to 0 dl 1786002705 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002694.204146:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5af100 with x1872758531102592 ext(12288->20479) 00002000:00010000:3.0:1786002694.204150:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5af100 00000100:00100000:3.0:1786002694.217485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.217652:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531102720 00000100:00100000:1.0:1786002694.217662:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531102720 00000100:00100000:1.0:1786002694.217730:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5416 00000100:00100000:1.0:1786002694.217740:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758531102720:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002694.219549:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969987 is committed 00000100:00100000:1.0:1786002694.219711:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531102720:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1970us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002694.219723:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5416 00000100:00100000:1.0:1786002694.243299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002694.243381:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531102976 00000100:00100000:0.0:1786002694.243390:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531102976 00000100:00100000:0.0:1786002694.243449:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24329 00000100:00100000:0.0:1786002694.243458:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+96:22434:x1872758531102976:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002694.243489:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002694.243508:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417dd5 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b437 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243623:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417ddc lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243636:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417ddc lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243646:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417ddc lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243657:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417de3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243673:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417de3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243680:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417de3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243730:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417dea lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243740:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417dea lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243748:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417dea lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002694.243757:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 16384 00010000:00010000:0.0:1786002694.243827:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417ddc lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243835:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417ddc lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243841:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417ddc lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243881:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417ddc lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243887:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002694.243891:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417ddc lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243901:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417ddc lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243911:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35d00) 00010000:00010000:0.0:1786002694.243914:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002694.243917:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417ddc lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.243922:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578417ddc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.244179:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417de3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.244186:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417de3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.244191:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417de3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.244195:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002694.244198:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417de3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.244203:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417de3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.244210:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002694.244212:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002694.244215:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417de3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.244220:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417de3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002694.244307:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417dd5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b437 expref: 99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002694.244323:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417dea lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b437 expref: 98 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002694.244329:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002694.244331:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786002694.244333:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:1.0:1786002694.244385:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+98:22434:x1872758531102976:12345-192.168.203.49@tcp:101:dd.0 Request processed in 929us (1095us total) trans 4294968753 rc 0/0 00000100:00100000:1.0:1786002694.244391:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24329 00000100:00100000:2.0:1786002694.251877:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.251962:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531103232 00000100:00100000:1.0:1786002694.251970:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531103232 00000100:00100000:1.0:1786002694.252019:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5295 00000100:00100000:1.0:1786002694.252029:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+98:22434:x1872758531103232:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002694.252275:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+99:22434:x1872758531103232:12345-192.168.203.49@tcp:35:dd.0 Request processed in 247us (438us total) trans 4294968754 rc 0/0 00000100:00100000:1.0:1786002694.252283:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5295 00000100:00100000:3.0:1786002694.260552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.261910:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531103360 00000100:00100000:2.0:1786002694.261920:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531103360 00000100:00100000:2.0:1786002694.261992:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1564 00000100:00100000:2.0:1786002694.262001:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed347f56450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+99:2410:x1872758531103360:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002694.262016:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002694.262039:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417dea lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b437 expref: 99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.262056:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002694.262061:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002694.262123:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed347f56450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+98:2410:x1872758531103360:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 116us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002694.262131:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1564 00000100:00100000:0.0:1786002694.290224:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.290312:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531103488 00000100:00100000:1.0:1786002694.290322:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531103488 00002000:00100000:1.0:1786002694.290363:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (16384->24575) req@ffff9ed37f690a80 x1872758531103488/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/0 e 0 to 0 dl 1786002705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002694.290382:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f690a80 with x1872758531103488 ext(16384->24575) 00002000:00010000:1.0:1786002694.290387:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f690a80 00000100:00100000:1.0:1786002694.290416:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 85 00000100:00100000:1.0:1786002694.290424:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531103488:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002694.292043:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758531103488:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1615us (1823us total) trans 4294969989 rc 0/0 00000100:00100000:1.0:1786002694.292052:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 85 00002000:00100000:1.0:1786002694.292061:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (16384->24575) req@ffff9ed37f690a80 x1872758531103488/t4294969989(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/448 e 0 to 0 dl 1786002705 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002694.292070:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f690a80 with x1872758531103488 ext(16384->24575) 00002000:00010000:1.0:1786002694.292074:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f690a80 00000100:00100000:3.0:1786002694.300210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002694.300306:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531103616 00000100:00100000:0.0:1786002694.300315:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531103616 00000100:00100000:0.0:1786002694.300367:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5417 00000100:00100000:0.0:1786002694.300377:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758531103616:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002694.309394:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969989 is committed 00000100:00100000:3.0:1786002694.309619:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531103616:12345-192.168.203.49@tcp:16:dd.0 Request processed in 9238us (9413us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002694.309631:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5417 00000100:00100000:1.0:1786002694.329045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.331121:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531103872 00000100:00100000:2.0:1786002694.331132:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531103872 00000100:00100000:2.0:1786002694.331249:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24330 00000100:00100000:2.0:1786002694.331260:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+98:22435:x1872758531103872:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002694.331284:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002694.331303:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417df8 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b43e expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.331423:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417dff lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.331436:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417dff lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.331446:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417dff lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.331458:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e06 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.331464:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e06 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.332885:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e06 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333058:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af578417e0d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333070:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af578417e0d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333079:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af578417e0d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002694.333088:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 20480 00010000:00010000:2.0:1786002694.333170:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417dff lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333183:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417dff lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333189:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417dff lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333195:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417dff lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333201:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002694.333205:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417dff lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333212:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417dff lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333223:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed243d0b000) 00010000:00010000:2.0:1786002694.333226:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002694.333231:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417dff lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333237:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417dff lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333250:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e06 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333256:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e06 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333262:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e06 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333268:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002694.333271:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e06 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333277:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e06 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333284:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed243d0b200) 00010000:00010000:2.0:1786002694.333286:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002694.333289:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e06 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333295:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e06 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333336:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417df8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b43e expref: 101 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333351:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af578417e0d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b43e expref: 100 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.333359:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002694.333361:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786002694.333363:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2c800, rc 0) 00000100:00100000:2.0:1786002694.333484:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+100:22435:x1872758531103872:12345-192.168.203.49@tcp:101:dd.0 Request processed in 2226us (4446us total) trans 4294968755 rc 0/0 00000100:00100000:2.0:1786002694.333492:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24330 00000100:00100000:0.0:1786002694.344530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002694.344614:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531104256 00000100:00100000:3.0:1786002694.344622:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531104256 00000100:00100000:3.0:1786002694.344680:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1565 00000100:00100000:3.0:1786002694.344690:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+100:2410:x1872758531104256:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002694.344704:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002694.344730:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af578417e0d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b43e expref: 100 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.344750:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002694.344768:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002694.344823:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+99:2410:x1872758531104256:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 135us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002694.344830:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1565 00000100:00100000:0.0:1786002694.347687:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.347780:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531104128 00000100:00100000:2.0:1786002694.347789:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531104128 00000100:00100000:2.0:1786002694.347843:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5296 00000100:00100000:2.0:1786002694.347884:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+99:22435:x1872758531104128:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:2.0:1786002694.348154:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+100:22435:x1872758531104128:12345-192.168.203.49@tcp:35:dd.0 Request processed in 272us (473us total) trans 4294968756 rc 0/0 00000100:00100000:2.0:1786002694.348162:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5296 00000100:00100000:0.0:1786002694.362424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002694.362607:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531104384 00000100:00100000:3.0:1786002694.362616:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531104384 00002000:00100000:3.0:1786002694.362661:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (20480->28671) req@ffff9ed37f691180 x1872758531104384/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/0 e 0 to 0 dl 1786002705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002694.362672:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f691180 with x1872758531104384 ext(20480->28671) 00002000:00010000:3.0:1786002694.362678:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f691180 00000100:00100000:3.0:1786002694.362709:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 86 00000100:00100000:3.0:1786002694.362719:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531104384:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002694.364320:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758531104384:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1125us (1428us total) trans 4294969991 rc 0/0 00000100:00100000:3.0:1786002694.364330:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 86 00002000:00100000:3.0:1786002694.364339:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (20480->28671) req@ffff9ed37f691180 x1872758531104384/t4294969991(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/448 e 0 to 0 dl 1786002705 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002694.364354:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f691180 with x1872758531104384 ext(20480->28671) 00002000:00010000:3.0:1786002694.364359:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f691180 00000100:00100000:0.0:1786002694.375575:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.375653:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531104512 00000100:00100000:2.0:1786002694.375664:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531104512 00000100:00100000:2.0:1786002694.375722:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5418 00000100:00100000:2.0:1786002694.375733:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2411:x1872758531104512:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002694.377335:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969991 is committed 00000100:00100000:2.0:1786002694.377478:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531104512:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1736us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002694.377488:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5418 00000100:00100000:0.0:1786002694.389282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.389366:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531104768 00000100:00100000:2.0:1786002694.389375:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531104768 00000100:00100000:2.0:1786002694.389430:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24331 00000100:00100000:2.0:1786002694.389440:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+100:22436:x1872758531104768:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002694.389462:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002694.389490:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417e1b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b445 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389588:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e22 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389610:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e22 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389621:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e22 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389634:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417e29 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389641:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417e29 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389648:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417e29 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389701:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af578417e30 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389710:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af578417e30 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389718:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af578417e30 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002694.389728:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 24576 00010000:00010000:2.0:1786002694.389812:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e22 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389820:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e22 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389827:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e22 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389833:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e22 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389839:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002694.389843:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e22 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389885:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e22 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389897:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed243d0b000) 00010000:00010000:2.0:1786002694.389900:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002694.389904:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e22 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389911:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417e22 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.389923:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417e29 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.390172:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417e29 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.390181:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417e29 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.390186:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002694.390189:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417e29 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.390195:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417e29 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.390204:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed243d0b200) 00010000:00010000:2.0:1786002694.390206:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002694.390210:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417e29 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.390215:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417e29 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.391396:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af578417e1b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b445 expref: 103 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.391419:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af578417e30 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b445 expref: 102 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002694.391427:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002694.391429:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786002694.391432:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2ca00, rc 0) 00000100:00100000:3.0:1786002694.391572:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+102:22436:x1872758531104768:12345-192.168.203.49@tcp:101:dd.0 Request processed in 2132us (2296us total) trans 4294968757 rc 0/0 00000100:00100000:3.0:1786002694.391581:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24331 00000100:00100000:0.0:1786002694.402204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002694.402325:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.402786:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531105152 00000100:00100000:2.0:1786002694.402796:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531105152 00000100:00100000:2.0:1786002694.402894:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1566 00000100:00100000:2.0:1786002694.402905:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+102:2410:x1872758531105152:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002694.402920:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002694.402956:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af578417e30 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b445 expref: 102 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.402975:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002694.402979:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002694.403031:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+101:2410:x1872758531105152:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 128us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002694.403038:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1566 00000100:00100000:3.0:1786002694.414918:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531105024 00000100:00100000:3.0:1786002694.414983:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531105024 00000100:00100000:2.0:1786002694.421302:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5297 00000100:00100000:2.0:1786002694.421316:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+101:22436:x1872758531105024:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:2.0:1786002694.421619:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+102:22436:x1872758531105024:12345-192.168.203.49@tcp:35:dd.0 Request processed in 305us (19423us total) trans 4294968758 rc 0/0 00000100:00100000:2.0:1786002694.421626:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5297 00000100:00100000:0.0:1786002694.429391:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.429462:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531105280 00000100:00100000:1.0:1786002694.429472:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531105280 00002000:00100000:1.0:1786002694.429515:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (24576->32767) req@ffff9ed37baac450 x1872758531105280/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/0 e 0 to 0 dl 1786002705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002694.429527:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37baac450 with x1872758531105280 ext(24576->32767) 00002000:00010000:1.0:1786002694.429532:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37baac450 00000100:00100000:1.0:1786002694.429560:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 87 00000100:00100000:1.0:1786002694.429568:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37baac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531105280:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002694.435015:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37baac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758531105280:12345-192.168.203.49@tcp:4:dd.0 Request processed in 5438us (5623us total) trans 4294969993 rc 0/0 00000100:00100000:1.0:1786002694.435027:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 87 00002000:00100000:1.0:1786002694.435038:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (24576->32767) req@ffff9ed37baac450 x1872758531105280/t4294969993(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/448 e 0 to 0 dl 1786002705 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002694.435047:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37baac450 with x1872758531105280 ext(24576->32767) 00002000:00010000:1.0:1786002694.435053:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37baac450 00000100:00100000:0.0:1786002694.468128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.468763:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531105408 00000100:00100000:2.0:1786002694.468772:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531105408 00000100:00100000:2.0:1786002694.468834:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5419 00000100:00100000:2.0:1786002694.468878:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758531105408:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:1.0:1786002694.471795:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969993 is committed 00000100:00100000:2.0:1786002694.472184:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531105408:12345-192.168.203.49@tcp:16:dd.0 Request processed in 3336us (4059us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002694.472194:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5419 00000100:00100000:2.0:1786002694.523123:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002694.523241:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531105664 00000100:00100000:0.0:1786002694.523250:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531105664 00000100:00100000:0.0:1786002694.523314:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24332 00000100:00100000:0.0:1786002694.523324:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+102:22437:x1872758531105664:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002694.523346:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002694.523367:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417e3e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b44c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523475:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e45 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523488:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e45 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523498:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e45 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523512:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e4c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523518:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e4c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523524:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e4c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523577:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417e53 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523587:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417e53 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523606:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417e53 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002694.523615:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 28672 00010000:00010000:0.0:1786002694.523688:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e45 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523701:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e45 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523707:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e45 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523713:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e45 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523719:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002694.523723:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e45 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523730:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e45 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523742:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35800) 00010000:00010000:0.0:1786002694.523745:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002694.523749:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e45 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523756:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e45 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523770:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e4c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523776:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e4c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523783:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e4c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523788:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002694.523791:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e4c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523795:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e4c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523802:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35100) 00010000:00010000:0.0:1786002694.523805:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002694.523807:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e4c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523812:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e4c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523903:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417e3e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b44c expref: 105 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523919:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417e53 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b44c expref: 104 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.523926:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002694.523929:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002694.523932:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35200, rc 0) 00000100:00100000:0.0:1786002694.523995:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+104:22437:x1872758531105664:12345-192.168.203.49@tcp:101:dd.0 Request processed in 671us (880us total) trans 4294968759 rc 0/0 00000100:00100000:0.0:1786002694.524002:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24332 00000100:00100000:0.0:1786002694.564736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002694.564784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.564946:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531105792 00000100:00100000:1.0:1786002694.564956:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531105792 00000100:00100000:3.0:1786002694.564966:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531106048 00000100:00100000:3.0:1786002694.564970:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531106048 00000100:00100000:3.0:1786002694.565005:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5298 00000100:00100000:1.0:1786002694.565005:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1567 00000100:00100000:3.0:1786002694.565014:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+105:22437:x1872758531106048:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002694.565014:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+105:2412:x1872758531105792:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002694.565030:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002694.565054:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417e53 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b44c expref: 105 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002694.565072:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002694.565076:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002694.565121:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+104:2412:x1872758531105792:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 108us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002694.565128:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1567 00000100:00100000:3.0:1786002694.565255:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+104:22437:x1872758531106048:12345-192.168.203.49@tcp:35:dd.0 Request processed in 242us (531us total) trans 4294968760 rc 0/0 00000100:00100000:3.0:1786002694.565261:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5298 00000100:00100000:2.0:1786002694.592940:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.593158:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531106176 00000100:00100000:1.0:1786002694.593168:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531106176 00002000:00100000:1.0:1786002694.593213:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (28672->36863) req@ffff9ed34b5af480 x1872758531106176/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/0 e 0 to 0 dl 1786002705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002694.593225:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5af480 with x1872758531106176 ext(28672->36863) 00002000:00010000:1.0:1786002694.593230:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5af480 00000100:00100000:1.0:1786002694.593263:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 88 00000100:00100000:1.0:1786002694.593272:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531106176:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002694.594507:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758531106176:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1233us (1572us total) trans 4294969995 rc 0/0 00000100:00100000:1.0:1786002694.594516:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 88 00002000:00100000:1.0:1786002694.594524:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xc:0x0] (28672->36863) req@ffff9ed34b5af480 x1872758531106176/t4294969995(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/448 e 0 to 0 dl 1786002705 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002694.594533:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5af480 with x1872758531106176 ext(28672->36863) 00002000:00010000:1.0:1786002694.594537:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5af480 00000100:00100000:3.0:1786002694.599802:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.599893:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531106304 00000100:00100000:2.0:1786002694.599901:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531106304 00000100:00100000:2.0:1786002694.599965:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5420 00000100:00100000:2.0:1786002694.599976:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758531106304:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002694.601933:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969995 is committed 00000100:00100000:3.0:1786002694.602174:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531106304:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2196us (2376us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002694.602184:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5420 00000100:00100000:2.0:1786002694.643451:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002694.643537:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531106560 00000100:00100000:0.0:1786002694.643546:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531106560 00000100:00100000:0.0:1786002694.643611:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24333 00000100:00100000:0.0:1786002694.643621:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+104:22438:x1872758531106560:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002694.643643:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002694.643673:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417e61 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b453 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.643799:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e68 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.643812:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e68 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.643822:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e68 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.643834:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e6f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.643841:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e6f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.643870:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e6f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.643918:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417e76 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.643931:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417e76 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.643938:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417e76 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002694.643947:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 32768 00010000:00010000:0.0:1786002694.644012:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e68 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644019:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e68 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644025:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e68 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644031:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e68 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644037:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002694.644040:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e68 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644047:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e68 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644057:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35500) 00010000:00010000:0.0:1786002694.644060:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002694.644063:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e68 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644073:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e68 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644085:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e6f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644091:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e6f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644097:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e6f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644101:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002694.644103:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e6f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644108:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e6f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644125:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35700) 00010000:00010000:0.0:1786002694.644128:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002694.644130:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e6f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644136:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e6f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644171:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417e61 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b453 expref: 107 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644190:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417e76 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b453 expref: 106 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.644197:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002694.644199:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002694.644201:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34c00, rc 0) 00000100:00100000:0.0:1786002694.644256:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+106:22438:x1872758531106560:12345-192.168.203.49@tcp:101:dd.0 Request processed in 637us (814us total) trans 4294968761 rc 0/0 00000100:00100000:0.0:1786002694.644264:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24333 00000100:00100000:2.0:1786002694.658276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.658376:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531106816 00000100:00100000:1.0:1786002694.658385:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531106816 00000100:00100000:1.0:1786002694.658441:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5299 00000100:00100000:1.0:1786002694.658453:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+106:22438:x1872758531106816:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002694.658751:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+107:22438:x1872758531106816:12345-192.168.203.49@tcp:35:dd.0 Request processed in 300us (485us total) trans 4294968762 rc 0/0 00000100:00100000:1.0:1786002694.658759:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5299 00000100:00100000:3.0:1786002694.670064:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.670214:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531106944 00000100:00100000:2.0:1786002694.670222:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531106944 00000100:00100000:2.0:1786002694.670279:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1568 00000100:00100000:2.0:1786002694.670288:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+107:2410:x1872758531106944:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002694.670302:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002694.670323:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417e76 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b453 expref: 107 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.670339:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002694.670343:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002694.670396:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+106:2410:x1872758531106944:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 109us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002694.670402:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1568 00000100:00100000:2.0:1786002694.687456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.687543:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531107072 00000100:00100000:1.0:1786002694.687553:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531107072 00002000:00100000:1.0:1786002694.687611:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (32768->40959) req@ffff9ed34b5ad180 x1872758531107072/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/0 e 0 to 0 dl 1786002705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002694.687622:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5ad180 with x1872758531107072 ext(32768->40959) 00002000:00010000:1.0:1786002694.687628:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5ad180 00000100:00100000:1.0:1786002694.687671:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 89 00000100:00100000:1.0:1786002694.687681:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531107072:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002694.689263:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758531107072:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1578us (1809us total) trans 4294969997 rc 0/0 00000100:00100000:1.0:1786002694.689276:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 89 00002000:00100000:1.0:1786002694.689285:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (32768->40959) req@ffff9ed34b5ad180 x1872758531107072/t4294969997(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/448 e 0 to 0 dl 1786002705 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002694.689295:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5ad180 with x1872758531107072 ext(32768->40959) 00002000:00010000:1.0:1786002694.689300:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5ad180 00000100:00100000:3.0:1786002694.695685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.695816:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531107200 00000100:00100000:1.0:1786002694.695825:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531107200 00000100:00100000:1.0:1786002694.695911:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5421 00000100:00100000:1.0:1786002694.695922:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2411:x1872758531107200:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002694.697262:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969997 is committed 00000100:00100000:1.0:1786002694.699148:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531107200:12345-192.168.203.49@tcp:16:dd.0 Request processed in 3220us (3464us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002694.699159:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5421 00000100:00100000:3.0:1786002694.726840:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002694.727613:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531107456 00000100:00100000:0.0:1786002694.727622:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531107456 00000100:00100000:0.0:1786002694.727690:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24334 00000100:00100000:0.0:1786002694.727699:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+106:22439:x1872758531107456:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002694.727721:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002694.727742:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e84 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b45a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.727896:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e8b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.727911:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e8b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.727923:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e8b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.727940:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417e92 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.727947:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417e92 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.727953:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417e92 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728008:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417e99 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728019:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417e99 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728027:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417e99 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002694.728037:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 36864 00010000:00010000:0.0:1786002694.728106:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e8b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728114:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e8b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728121:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e8b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728127:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e8b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728132:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002694.728136:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e8b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728144:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e8b lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728156:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35800) 00010000:00010000:0.0:1786002694.728160:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002694.728164:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e8b lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728171:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417e8b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728184:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417e92 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728191:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417e92 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728198:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417e92 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728203:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002694.728206:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417e92 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728213:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417e92 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728220:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35100) 00010000:00010000:0.0:1786002694.728222:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002694.728225:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417e92 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728232:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417e92 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728279:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417e84 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b45a expref: 109 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728294:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417e99 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b45a expref: 108 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002694.728302:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002694.728304:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002694.728306:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35c00, rc 0) 00000100:00100000:0.0:1786002694.728362:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+108:22439:x1872758531107456:12345-192.168.203.49@tcp:101:dd.0 Request processed in 664us (1530us total) trans 4294968763 rc 0/0 00000100:00100000:0.0:1786002694.728369:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24334 00000100:00100000:0.0:1786002694.742225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.742314:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531107712 00000100:00100000:2.0:1786002694.742325:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531107712 00000100:00100000:2.0:1786002694.742378:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5300 00000100:00100000:2.0:1786002694.742389:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+108:22439:x1872758531107712:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:2.0:1786002694.742673:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+109:22439:x1872758531107712:12345-192.168.203.49@tcp:35:dd.0 Request processed in 278us (448us total) trans 4294968764 rc 0/0 00000100:00100000:2.0:1786002694.742680:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5300 00000100:00100000:3.0:1786002694.751551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.751642:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531107840 00000100:00100000:1.0:1786002694.751651:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531107840 00000100:00100000:1.0:1786002694.751727:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1569 00000100:00100000:1.0:1786002694.751736:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+109:2412:x1872758531107840:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002694.751751:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002694.751784:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417e99 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b45a expref: 109 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002694.751804:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002694.751809:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002694.751910:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+108:2412:x1872758531107840:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 174us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002694.751922:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1569 00000100:00100000:3.0:1786002694.779803:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002694.779980:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531107968 00000100:00100000:0.0:1786002694.779990:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531107968 00002000:00100000:0.0:1786002694.780039:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (36864->45055) req@ffff9ed37f552680 x1872758531107968/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/0 e 0 to 0 dl 1786002705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002694.780051:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f552680 with x1872758531107968 ext(36864->45055) 00002000:00010000:0.0:1786002694.780056:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f552680 00000100:00100000:0.0:1786002694.780090:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 90 00000100:00100000:0.0:1786002694.780099:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531107968:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:0.0:1786002694.788978:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758531107968:12345-192.168.203.49@tcp:4:dd.0 Request processed in 8871us (9178us total) trans 4294969999 rc 0/0 00000100:00100000:0.0:1786002694.788993:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 90 00002000:00100000:0.0:1786002694.789005:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (36864->45055) req@ffff9ed37f552680 x1872758531107968/t4294969999(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/448 e 0 to 0 dl 1786002705 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002694.789015:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f552680 with x1872758531107968 ext(36864->45055) 00002000:00010000:0.0:1786002694.789021:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f552680 00000100:00100000:0.0:1786002694.816064:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.816198:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531108096 00000100:00100000:1.0:1786002694.816209:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531108096 00000100:00100000:1.0:1786002694.816263:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5422 00000100:00100000:1.0:1786002694.816273:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758531108096:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002694.818277:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969999 is committed 00000100:00100000:1.0:1786002694.840392:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531108096:12345-192.168.203.49@tcp:16:dd.0 Request processed in 24110us (24326us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002694.840406:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5422 00000100:00100000:3.0:1786002694.870432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.870556:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531108352 00000100:00100000:2.0:1786002694.870566:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531108352 00000100:00100000:2.0:1786002694.870632:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24335 00000100:00100000:2.0:1786002694.870643:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+108:22440:x1872758531108352:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002694.871010:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002694.871035:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af578417ea7 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b461 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871256:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417eae lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871270:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417eae lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871281:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417eae lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871293:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417eb5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871299:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417eb5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871305:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417eb5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871353:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417ebc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871361:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417ebc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871367:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417ebc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002694.871376:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 40960 00010000:00010000:2.0:1786002694.871441:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417eae lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871448:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417eae lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871454:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417eae lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871460:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417eae lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871465:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002694.871469:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417eae lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871476:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417eae lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871487:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed243d0b200) 00010000:00010000:2.0:1786002694.871490:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002694.871494:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417eae lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871500:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417eae lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871513:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417eb5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871519:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417eb5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871524:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417eb5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871528:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2ce00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002694.871531:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417eb5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871536:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417eb5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871542:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed243d0bc00) 00010000:00010000:2.0:1786002694.871544:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002694.871546:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417eb5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871551:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417eb5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871597:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af578417ea7 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b461 expref: 111 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871617:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417ebc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b461 expref: 110 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.871625:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002694.871627:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786002694.871629:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2c000, rc 0) 00000100:00100000:2.0:1786002694.873811:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+110:22440:x1872758531108352:12345-192.168.203.49@tcp:101:dd.0 Request processed in 3162us (3378us total) trans 4294968765 rc 0/0 00000100:00100000:2.0:1786002694.873822:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24335 00000100:00100000:3.0:1786002694.882146:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.882360:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531108608 00000100:00100000:1.0:1786002694.882370:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531108608 00000100:00100000:1.0:1786002694.882424:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5301 00000100:00100000:1.0:1786002694.882434:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+110:22440:x1872758531108608:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002694.882996:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+111:22440:x1872758531108608:12345-192.168.203.49@tcp:35:dd.0 Request processed in 562us (856us total) trans 4294968766 rc 0/0 00000100:00100000:1.0:1786002694.883005:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5301 00000100:00100000:1.0:1786002694.905298:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002694.905364:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531108736 00000100:00100000:2.0:1786002694.905372:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531108736 00000100:00100000:2.0:1786002694.905418:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1570 00000100:00100000:2.0:1786002694.905426:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+111:2412:x1872758531108736:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002694.905441:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002694.905463:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578417ebc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b461 expref: 111 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002694.905480:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002694.905485:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002694.905534:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+110:2412:x1872758531108736:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 108us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002694.905541:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1570 00000100:00100000:3.0:1786002694.948526:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002694.948615:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531108864 00000100:00100000:1.0:1786002694.948624:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531108864 00002000:00100000:1.0:1786002694.948678:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (40960->49151) req@ffff9ed37f553480 x1872758531108864/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/0 e 0 to 0 dl 1786002705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002694.948690:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f553480 with x1872758531108864 ext(40960->49151) 00002000:00010000:1.0:1786002694.948696:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f553480 00000100:00100000:1.0:1786002694.948727:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 91 00000100:00100000:1.0:1786002694.948737:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531108864:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002694.954190:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758531108864:12345-192.168.203.49@tcp:4:dd.0 Request processed in 5446us (5664us total) trans 4294970001 rc 0/0 00000100:00100000:1.0:1786002694.954203:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 91 00002000:00100000:1.0:1786002694.954215:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (40960->49151) req@ffff9ed37f553480 x1872758531108864/t4294970001(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:375/0 lens 8680/448 e 0 to 0 dl 1786002705 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002694.954226:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f553480 with x1872758531108864 ext(40960->49151) 00002000:00010000:1.0:1786002694.954232:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f553480 00000100:00100000:3.0:1786002694.965171:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002694.965465:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531108992 00000100:00100000:0.0:1786002694.965475:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531108992 00000100:00100000:0.0:1786002694.965528:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5423 00000100:00100000:0.0:1786002694.965538:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2411:x1872758531108992:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:2.0:1786002694.967081:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970001 is committed 00000100:00100000:0.0:1786002694.967252:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531108992:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1713us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002694.967261:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5423 00000100:00100000:0.0:1786002695.002455:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.002602:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531109248 00000100:00100000:1.0:1786002695.002611:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531109248 00000100:00100000:1.0:1786002695.002686:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24336 00000100:00100000:1.0:1786002695.002697:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+110:22441:x1872758531109248:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002695.002718:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002695.002738:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417eca lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b468 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.002883:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417ed1 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.002898:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417ed1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.002909:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417ed1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.002924:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417ed8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.002941:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.002949:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003004:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417edf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003012:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417edf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003019:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417edf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002695.003028:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 45056 00010000:00010000:1.0:1786002695.003098:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417ed1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003106:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417ed1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003124:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417ed1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003130:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417ed1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003137:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556b400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002695.003140:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417ed1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003148:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417ed1 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003163:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef100) 00010000:00010000:1.0:1786002695.003166:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002695.003170:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417ed1 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003176:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417ed1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003189:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003194:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003199:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003204:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002695.003206:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003211:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417ed8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003217:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed2456ef000) 00010000:00010000:1.0:1786002695.003219:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002695.003221:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417ed8 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003226:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417ed8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003262:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417eca lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b468 expref: 113 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003276:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417edf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b468 expref: 112 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.003283:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002695.003285:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786002695.003287:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244999400, rc 0) 00000100:00100000:1.0:1786002695.003334:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+112:22441:x1872758531109248:12345-192.168.203.49@tcp:101:dd.0 Request processed in 640us (888us total) trans 4294968767 rc 0/0 00000100:00100000:1.0:1786002695.003341:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24336 00000100:00080000:0.0:1786002695.003573:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786002695.007361:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.007485:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531109376 00000100:00100000:1.0:1786002695.007495:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531109376 00000100:00100000:1.0:1786002695.007557:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1571 00000100:00100000:1.0:1786002695.007568:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed347f55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+112:2413:x1872758531109376:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002695.007583:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002695.007618:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417edf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b468 expref: 112 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.007636:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002695.007641:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002695.007697:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed347f55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+111:2413:x1872758531109376:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 131us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002695.007704:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1571 00000100:00100000:3.0:1786002695.022866:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786002695.022886:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561087488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1786002695.022959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002695.023022:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561087488 00000100:00100000:3.0:1786002695.023029:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561087488 00000100:00100000:3.0:1786002695.023070:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4167 00000100:00100000:3.0:1786002695.023078:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561087488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1786002695.023106:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445036032 avail 1298796544 00000100:00100000:3.0:1786002695.023156:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561087488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002695.023163:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4167 00000100:00100000:3.0:1786002695.023205:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561087488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002695.023404:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.023469:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531109632 00000100:00100000:0.0:1786002695.023474:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531109632 00000100:00100000:0.0:1786002695.023509:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5302 00000100:00100000:0.0:1786002695.023515:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+111:22441:x1872758531109632:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:0.0:1786002695.023755:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+112:22441:x1872758531109632:12345-192.168.203.49@tcp:35:dd.0 Request processed in 239us (352us total) trans 4294968768 rc 0/0 00000100:00100000:0.0:1786002695.023763:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5302 00000001:00080000:0.0:1786002695.025339:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984172 is committed 00000100:00100000:0.0:1786002695.041384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.041477:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531109760 00000100:00100000:1.0:1786002695.041486:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531109760 00002000:00100000:1.0:1786002695.041540:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (45056->53247) req@ffff9ed37f3a3b80 x1872758531109760/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/0 e 0 to 0 dl 1786002706 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002695.041550:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a3b80 with x1872758531109760 ext(45056->53247) 00002000:00010000:1.0:1786002695.041555:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f3a3b80 00000100:00100000:1.0:1786002695.041595:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 92 00000100:00100000:1.0:1786002695.041604:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531109760:12345-192.168.203.49@tcp:4:dd.0 00000100:00080000:0.0:1786002695.042209:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002695.042934:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2411:x1872758531109760:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1319us (1547us total) trans 4294970003 rc 0/0 00000100:00100000:1.0:1786002695.042944:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 92 00002000:00100000:1.0:1786002695.042952:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (45056->53247) req@ffff9ed37f3a3b80 x1872758531109760/t4294970003(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/448 e 0 to 0 dl 1786002706 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002695.042962:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f3a3b80 with x1872758531109760 ext(45056->53247) 00002000:00010000:1.0:1786002695.042966:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f3a3b80 00000100:00100000:3.0:1786002695.063101:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.063188:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531109888 00000100:00100000:2.0:1786002695.063197:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531109888 00000100:00100000:2.0:1786002695.063253:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5424 00000100:00100000:2.0:1786002695.063264:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758531109888:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:3.0:1786002695.066315:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970003 is committed 00000100:00100000:2.0:1786002695.066461:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531109888:12345-192.168.203.49@tcp:16:dd.0 Request processed in 3194us (3363us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002695.066471:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5424 00000100:00100000:2.0:1786002695.092204:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.092295:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531110144 00000100:00100000:0.0:1786002695.092305:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531110144 00000100:00100000:0.0:1786002695.092360:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24337 00000100:00100000:0.0:1786002695.092370:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+112:22442:x1872758531110144:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002695.092392:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002695.092412:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578417eed lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b46f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092521:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417ef4 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092534:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417ef4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092545:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417ef4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092559:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417efb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092566:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417efb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092573:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417efb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092635:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417f02 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092645:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417f02 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092654:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417f02 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002695.092675:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 49152 00010000:00010000:0.0:1786002695.092746:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417ef4 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092755:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417ef4 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092762:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417ef4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092769:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417ef4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092775:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002695.092779:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417ef4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092786:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417ef4 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092797:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:0.0:1786002695.092800:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002695.092804:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417ef4 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092811:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578417ef4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092828:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417efb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092835:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417efb lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092840:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417efb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092893:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002695.092897:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417efb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092904:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417efb lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.092911:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002695.092914:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002695.092917:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417efb lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.093012:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578417efb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.093052:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578417eed lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b46f expref: 115 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.093066:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417f02 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b46f expref: 114 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.093079:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002695.093082:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002695.093084:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34000, rc 0) 00000100:00100000:0.0:1786002695.093134:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+114:22442:x1872758531110144:12345-192.168.203.49@tcp:101:dd.0 Request processed in 765us (938us total) trans 4294968769 rc 0/0 00000100:00100000:0.0:1786002695.093141:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24337 00000100:00100000:0.0:1786002695.103028:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.103106:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002695.103221:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531110528 00000100:00100000:3.0:1786002695.103231:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531110528 00000100:00100000:3.0:1786002695.103284:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5303 00000100:00100000:3.0:1786002695.103293:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+114:22442:x1872758531110528:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:3.0:1786002695.103490:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968770 00000100:00100000:3.0:1786002695.103578:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+116:22442:x1872758531110528:12345-192.168.203.49@tcp:35:dd.0 Request processed in 285us (471us total) trans 4294968771 rc 0/0 00000100:00100000:3.0:1786002695.103596:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5303 00000020:00080000:3.0:1786002695.103601:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002695.105216:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531110272 00000100:00100000:2.0:1786002695.105224:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531110272 00000100:00100000:2.0:1786002695.105273:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1572 00000100:00100000:2.0:1786002695.105282:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+116:2412:x1872758531110272:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002695.105294:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002695.105318:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578417f02 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b46f expref: 116 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.105335:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002695.105340:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002695.105366:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+115:2412:x1872758531110272:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 86us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002695.105373:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1572 00000100:00100000:1.0:1786002695.125822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002695.126013:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531110656 00000100:00100000:3.0:1786002695.126022:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531110656 00002000:00100000:3.0:1786002695.126067:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (49152->57343) req@ffff9ed37f4dc380 x1872758531110656/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/0 e 0 to 0 dl 1786002706 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002695.126078:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f4dc380 with x1872758531110656 ext(49152->57343) 00002000:00010000:3.0:1786002695.126084:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f4dc380 00000100:00100000:3.0:1786002695.126124:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 93 00000100:00100000:3.0:1786002695.126134:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531110656:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002695.127297:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758531110656:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1161us (1482us total) trans 4294970005 rc 0/0 00000100:00100000:3.0:1786002695.127306:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 93 00002000:00100000:3.0:1786002695.127313:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (49152->57343) req@ffff9ed37f4dc380 x1872758531110656/t4294970005(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/448 e 0 to 0 dl 1786002706 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002695.127321:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f4dc380 with x1872758531110656 ext(49152->57343) 00002000:00010000:3.0:1786002695.127325:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f4dc380 00000100:00100000:1.0:1786002695.143340:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.143430:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531110784 00000100:00100000:2.0:1786002695.143440:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531110784 00000100:00100000:2.0:1786002695.143497:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5425 00000100:00100000:2.0:1786002695.143506:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758531110784:12345-192.168.203.49@tcp:16:dd.0 00010000:00010000:3.0:1786002695.146069:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786002695.146631:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970005 is committed 00000100:00100000:2.0:1786002695.146840:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531110784:12345-192.168.203.49@tcp:16:dd.0 Request processed in 3331us (3505us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002695.146885:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5425 00000100:00100000:0.0:1786002695.178929:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.179022:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531111040 00000100:00100000:2.0:1786002695.179031:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531111040 00000100:00100000:2.0:1786002695.179077:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24338 00000100:00100000:2.0:1786002695.179087:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+115:22443:x1872758531111040:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002695.179119:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002695.179138:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417f10 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b476 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179235:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f17 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179248:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f17 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179260:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f17 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179272:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f1e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179279:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f1e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179286:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f1e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179331:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af578417f25 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179345:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af578417f25 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179352:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af578417f25 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002695.179361:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 53248 00010000:00010000:2.0:1786002695.179429:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f17 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179437:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f17 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179443:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f17 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179450:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f17 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179456:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002695.179459:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f17 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179466:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f17 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179478:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456f9600) 00010000:00010000:2.0:1786002695.179482:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002695.179485:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f17 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179495:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f17 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179508:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f1e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179513:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f1e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179519:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f1e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179523:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002695.179526:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f1e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179531:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f1e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179537:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed2456f9300) 00010000:00010000:2.0:1786002695.179540:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002695.179542:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f1e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179547:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f1e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179582:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417f10 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b476 expref: 118 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179615:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af578417f25 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b476 expref: 117 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.179622:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002695.179624:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786002695.179627:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2ca00, rc 0) 00000100:00100000:2.0:1786002695.180007:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+117:22443:x1872758531111040:12345-192.168.203.49@tcp:101:dd.0 Request processed in 919us (1085us total) trans 4294968772 rc 0/0 00000100:00100000:2.0:1786002695.180015:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24338 00000100:00100000:1.0:1786002695.184144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002695.185022:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531111168 00000100:00100000:3.0:1786002695.185032:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531111168 00000100:00100000:3.0:1786002695.185092:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1573 00000100:00100000:3.0:1786002695.185103:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+117:2411:x1872758531111168:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002695.185131:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002695.185156:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af578417f25 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b476 expref: 117 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002695.185175:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:3.0:1786002695.185180:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002695.205242:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+116:2411:x1872758531111168:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 20128us (21092us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002695.205258:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1573 00000100:00100000:0.0:1786002695.209255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.209556:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531111424 00000100:00100000:2.0:1786002695.209565:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531111424 00000100:00100000:2.0:1786002695.209625:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5304 00000100:00100000:2.0:1786002695.209636:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+116:22443:x1872758531111424:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:2.0:1786002695.209903:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2457f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+117:22443:x1872758531111424:12345-192.168.203.49@tcp:35:dd.0 Request processed in 268us (655us total) trans 4294968773 rc 0/0 00000100:00100000:2.0:1786002695.209911:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5304 00000100:00100000:1.0:1786002695.243187:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.243262:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531111552 00000100:00100000:0.0:1786002695.243271:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531111552 00002000:00100000:0.0:1786002695.243315:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (53248->61439) req@ffff9ed37f4dc700 x1872758531111552/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/0 e 0 to 0 dl 1786002706 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002695.243326:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f4dc700 with x1872758531111552 ext(53248->61439) 00002000:00010000:0.0:1786002695.243331:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f4dc700 00000100:00100000:0.0:1786002695.243371:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 94 00000100:00100000:0.0:1786002695.243381:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531111552:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002695.245115:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758531111552:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1729us (1930us total) trans 4294970007 rc 0/0 00000100:00100000:1.0:1786002695.245125:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 94 00002000:00100000:1.0:1786002695.245133:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (53248->61439) req@ffff9ed37f4dc700 x1872758531111552/t4294970007(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/448 e 0 to 0 dl 1786002706 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002695.245142:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f4dc700 with x1872758531111552 ext(53248->61439) 00002000:00010000:1.0:1786002695.245147:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f4dc700 00000100:00100000:0.0:1786002695.261651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002695.261748:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531111680 00000100:00100000:3.0:1786002695.261757:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531111680 00000100:00100000:3.0:1786002695.261816:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5426 00000100:00100000:3.0:1786002695.261827:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758531111680:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002695.263439:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970007 is committed 00000100:00100000:3.0:1786002695.263639:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531111680:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1811us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002695.263648:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5426 00000100:00100000:3.0:1786002695.293988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.294248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531111936 00000100:00100000:0.0:1786002695.294257:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531111936 00000100:00100000:0.0:1786002695.294315:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24339 00000100:00100000:0.0:1786002695.294324:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+117:22444:x1872758531111936:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002695.294349:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002695.294370:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417f33 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b47d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294484:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f3a lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294497:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f3a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294508:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f3a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294520:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417f41 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294527:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417f41 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294533:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417f41 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294581:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417f48 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294601:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417f48 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294608:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417f48 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002695.294617:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 57344 00010000:00010000:0.0:1786002695.294686:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f3a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294694:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f3a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294701:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f3a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294707:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f3a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294714:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002695.294718:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f3a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294726:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f3a lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294737:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35800) 00010000:00010000:0.0:1786002695.294740:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002695.294744:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f3a lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294751:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f3a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294764:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417f41 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294770:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417f41 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294780:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417f41 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294785:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002695.294788:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417f41 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294795:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417f41 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294802:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35100) 00010000:00010000:0.0:1786002695.294805:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002695.294808:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417f41 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294814:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af578417f41 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294901:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578417f33 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b47d expref: 120 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.294918:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417f48 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b47d expref: 119 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.295084:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002695.295088:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002695.295091:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34c00, rc 0) 00000100:00100000:0.0:1786002695.295229:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+119:22444:x1872758531111936:12345-192.168.203.49@tcp:101:dd.0 Request processed in 905us (1248us total) trans 4294968774 rc 0/0 00000100:00100000:0.0:1786002695.295240:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24339 00000100:00100000:1.0:1786002695.315498:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.315623:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.315951:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531112320 00000100:00100000:2.0:1786002695.315960:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531112320 00000100:00100000:2.0:1786002695.316020:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1574 00000100:00100000:2.0:1786002695.316030:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+119:2412:x1872758531112320:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002695.316043:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002695.316066:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af578417f48 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b47d expref: 119 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.316089:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002695.316094:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002695.316151:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+118:2412:x1872758531112320:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 123us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002695.316159:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1574 00000100:00100000:0.0:1786002695.318569:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531112192 00000100:00100000:0.0:1786002695.318579:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531112192 00000100:00100000:0.0:1786002695.319546:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5305 00000100:00100000:0.0:1786002695.319558:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+118:22444:x1872758531112192:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:0.0:1786002695.319823:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+119:22444:x1872758531112192:12345-192.168.203.49@tcp:35:dd.0 Request processed in 268us (4334us total) trans 4294968775 rc 0/0 00000100:00100000:0.0:1786002695.319831:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5305 00000100:00100000:1.0:1786002695.340739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002695.340827:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531112448 00000100:00100000:3.0:1786002695.340838:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531112448 00002000:00100000:3.0:1786002695.340915:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (57344->65535) req@ffff9ed37f4df800 x1872758531112448/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/0 e 0 to 0 dl 1786002706 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002695.340937:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f4df800 with x1872758531112448 ext(57344->65535) 00002000:00010000:3.0:1786002695.340944:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f4df800 00000100:00100000:3.0:1786002695.340972:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 95 00000100:00100000:3.0:1786002695.340981:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531112448:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002695.342187:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2411:x1872758531112448:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1203us (1452us total) trans 4294970009 rc 0/0 00000100:00100000:3.0:1786002695.342196:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 95 00002000:00100000:3.0:1786002695.342203:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (57344->65535) req@ffff9ed37f4df800 x1872758531112448/t4294970009(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/448 e 0 to 0 dl 1786002706 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002695.342212:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f4df800 with x1872758531112448 ext(57344->65535) 00002000:00010000:3.0:1786002695.342216:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f4df800 00000100:00100000:1.0:1786002695.357386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002695.357467:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531112576 00000100:00100000:3.0:1786002695.357477:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531112576 00000100:00100000:3.0:1786002695.357536:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5427 00000100:00100000:3.0:1786002695.357547:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758531112576:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002695.358837:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970009 is committed 00000100:00100000:3.0:1786002695.359077:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531112576:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1530us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002695.359086:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5427 00000100:00100000:1.0:1786002695.398288:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.398432:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531112832 00000100:00100000:2.0:1786002695.398441:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531112832 00000100:00100000:2.0:1786002695.398520:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24340 00000100:00100000:2.0:1786002695.398530:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f4dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+119:22445:x1872758531112832:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002695.398552:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002695.398574:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417f56 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b484 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.398683:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f5d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.398697:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f5d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.398708:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f5d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.398720:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f64 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.398727:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f64 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.398738:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f64 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.398790:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417f6b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.398799:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417f6b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.398806:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417f6b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002695.398816:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 61440 00010000:00010000:2.0:1786002695.399307:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f5d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399317:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f5d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399324:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f5d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399331:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f5d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399337:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002695.399342:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f5d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399350:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f5d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399367:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456f9600) 00010000:00010000:2.0:1786002695.399369:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002695.399374:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f5d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399379:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578417f5d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399392:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f64 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399399:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f64 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399405:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f64 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399410:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002695.399414:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f64 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399420:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f64 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399427:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed2456f9300) 00010000:00010000:2.0:1786002695.399430:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002695.399432:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f64 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.399438:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578417f64 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.399550:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af578417f56 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b484 expref: 122 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.399569:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417f6b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b484 expref: 121 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.399577:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002695.399580:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786002695.399592:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2d000, rc 0) 00000100:00100000:1.0:1786002695.399650:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f4dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+121:22445:x1872758531112832:12345-192.168.203.49@tcp:101:dd.0 Request processed in 1120us (1369us total) trans 4294968776 rc 0/0 00000100:00100000:1.0:1786002695.399658:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24340 00000100:00100000:1.0:1786002695.404795:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.404833:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002695.405028:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531113088 00000100:00100000:3.0:1786002695.405038:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531113088 00000100:00100000:3.0:1786002695.405088:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5306 00000100:00100000:3.0:1786002695.405098:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+121:22445:x1872758531113088:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:3.0:1786002695.405350:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+122:22445:x1872758531113088:12345-192.168.203.49@tcp:35:dd.0 Request processed in 252us (562us total) trans 4294968777 rc 0/0 00000100:00100000:3.0:1786002695.405357:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5306 00000100:00100000:2.0:1786002695.405955:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531113216 00000100:00100000:2.0:1786002695.405961:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531113216 00000100:00100000:2.0:1786002695.406000:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1575 00000100:00100000:2.0:1786002695.406008:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+122:2412:x1872758531113216:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002695.406019:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002695.406040:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578417f6b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b484 expref: 122 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.406057:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002695.406061:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002695.406083:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+121:2412:x1872758531113216:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 76us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002695.406090:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1575 00000100:00100000:1.0:1786002695.427266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.431184:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531113344 00000100:00100000:2.0:1786002695.431197:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531113344 00002000:00100000:2.0:1786002695.431249:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (61440->69631) req@ffff9ed2448ff800 x1872758531113344/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/0 e 0 to 0 dl 1786002706 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002695.431261:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2448ff800 with x1872758531113344 ext(61440->69631) 00002000:00010000:2.0:1786002695.431267:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2448ff800 00000100:00100000:2.0:1786002695.431341:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 96 00000100:00100000:2.0:1786002695.431351:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531113344:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:2.0:1786002695.434450:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758531113344:12345-192.168.203.49@tcp:4:dd.0 Request processed in 3092us (7184us total) trans 4294970011 rc 0/0 00000100:00100000:2.0:1786002695.434462:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 96 00002000:00100000:2.0:1786002695.434473:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (61440->69631) req@ffff9ed2448ff800 x1872758531113344/t4294970011(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/448 e 0 to 0 dl 1786002706 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002695.434483:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2448ff800 with x1872758531113344 ext(61440->69631) 00002000:00010000:2.0:1786002695.434488:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2448ff800 00000100:00100000:3.0:1786002695.437738:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002695.437784:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531113472 00000100:00100000:3.0:1786002695.437793:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531113472 00000100:00100000:3.0:1786002695.437838:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5428 00000100:00100000:3.0:1786002695.437863:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37be05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758531113472:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:3.0:1786002695.440389:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970011 is committed 00000100:00100000:0.0:1786002695.440562:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37be05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531113472:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2711us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002695.440573:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5428 00000100:00100000:3.0:1786002695.459537:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.459708:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531113728 00000100:00100000:1.0:1786002695.459718:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531113728 00000100:00100000:1.0:1786002695.459785:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24341 00000100:00100000:1.0:1786002695.459796:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+121:22446:x1872758531113728:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002695.459816:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002695.459836:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417f79 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b48b expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.459976:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417f80 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.459989:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417f80 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460000:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417f80 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460014:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417f87 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460021:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417f87 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460028:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417f87 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460073:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417f8e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460081:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417f8e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460088:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417f8e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002695.460097:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 65536 00010000:00010000:1.0:1786002695.460171:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417f80 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460184:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417f80 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460190:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417f80 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460197:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417f80 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460203:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244999600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002695.460207:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417f80 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460215:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417f80 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460226:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef100) 00010000:00010000:1.0:1786002695.460229:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002695.460233:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417f80 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460240:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999600/0x7cee4af578417f80 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460252:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417f87 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460259:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417f87 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460265:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417f87 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460271:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed34556a800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002695.460274:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417f87 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460280:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417f87 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460287:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed2456ef000) 00010000:00010000:1.0:1786002695.460289:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002695.460292:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417f87 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460297:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a800/0x7cee4af578417f87 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460331:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999400/0x7cee4af578417f79 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b48b expref: 124 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460345:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417f8e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b48b expref: 123 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.460353:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002695.460355:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786002695.460358:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed34556b400, rc 0) 00000100:00100000:1.0:1786002695.460411:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+123:22446:x1872758531113728:12345-192.168.203.49@tcp:101:dd.0 Request processed in 617us (884us total) trans 4294968778 rc 0/0 00000100:00100000:1.0:1786002695.460417:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24341 00000100:00100000:3.0:1786002695.465416:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002695.465452:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.465577:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531114112 00000100:00100000:2.0:1786002695.465594:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531114112 00000100:00100000:2.0:1786002695.465651:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1576 00000100:00100000:2.0:1786002695.465661:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+123:2411:x1872758531114112:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002695.465674:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002695.465696:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b400/0x7cee4af578417f8e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b48b expref: 123 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.465713:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002695.465717:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002695.465767:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+122:2411:x1872758531114112:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 107us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002695.465774:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1576 00000100:00100000:0.0:1786002695.466976:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531113984 00000100:00100000:0.0:1786002695.466982:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531113984 00000100:00100000:0.0:1786002695.467020:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5307 00000100:00100000:0.0:1786002695.467028:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+122:22446:x1872758531113984:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:0.0:1786002695.467263:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+123:22446:x1872758531113984:12345-192.168.203.49@tcp:35:dd.0 Request processed in 234us (1855us total) trans 4294968779 rc 0/0 00000100:00100000:0.0:1786002695.467270:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5307 00000100:00100000:3.0:1786002695.480368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.480795:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531114240 00000100:00100000:1.0:1786002695.480805:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531114240 00002000:00100000:1.0:1786002695.480884:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (65536->73727) req@ffff9ed37f551c00 x1872758531114240/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/0 e 0 to 0 dl 1786002706 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002695.480896:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f551c00 with x1872758531114240 ext(65536->73727) 00002000:00010000:1.0:1786002695.480902:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f551c00 00000100:00100000:1.0:1786002695.480939:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 97 00000100:00100000:1.0:1786002695.480949:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531114240:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002695.482004:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758531114240:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1054us (1643us total) trans 4294970013 rc 0/0 00000100:00100000:1.0:1786002695.482013:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 97 00002000:00100000:1.0:1786002695.482021:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (65536->73727) req@ffff9ed37f551c00 x1872758531114240/t4294970013(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/448 e 0 to 0 dl 1786002706 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002695.482029:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f551c00 with x1872758531114240 ext(65536->73727) 00002000:00010000:1.0:1786002695.482032:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f551c00 00000100:00100000:2.0:1786002695.487678:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.487770:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531114368 00000100:00100000:0.0:1786002695.487780:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531114368 00000100:00100000:0.0:1786002695.487840:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5429 00000100:00100000:0.0:1786002695.487900:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758531114368:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:3.0:1786002695.489553:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970013 is committed 00000100:00100000:0.0:1786002695.489765:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531114368:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1914us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002695.489775:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5429 00000100:00100000:3.0:1786002695.498144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.498224:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531114624 00000100:00100000:0.0:1786002695.498233:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531114624 00000100:00100000:0.0:1786002695.498290:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24342 00000100:00100000:0.0:1786002695.498300:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+123:22447:x1872758531114624:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002695.498322:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002695.498341:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f9c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b492 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.498438:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417fa3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.498451:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417fa3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.498462:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417fa3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.498486:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417faa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.498493:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417faa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.498500:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417faa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.498549:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417fb1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.498562:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417fb1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.498569:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417fb1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002695.498579:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 69632 00010000:00010000:0.0:1786002695.499026:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417fa3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499034:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417fa3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499041:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417fa3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499048:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417fa3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499054:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002695.499058:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417fa3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499065:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417fa3 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499077:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:0.0:1786002695.499080:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002695.499084:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417fa3 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499091:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417fa3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499105:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417faa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499112:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417faa lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499118:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417faa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499123:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002695.499126:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417faa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499132:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417faa lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499138:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002695.499141:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002695.499144:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417faa lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499149:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417faa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499186:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417f9c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b492 expref: 126 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499200:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417fb1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b492 expref: 125 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.499213:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002695.499215:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002695.499218:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34600, rc 0) 00000100:00100000:0.0:1786002695.499308:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+125:22447:x1872758531114624:12345-192.168.203.49@tcp:101:dd.0 Request processed in 1009us (1172us total) trans 4294968780 rc 0/0 00000100:00100000:0.0:1786002695.499315:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24342 00000100:00100000:3.0:1786002695.516789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002695.516829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.516933:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531114880 00000100:00100000:0.0:1786002695.516943:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531114880 00000100:00100000:0.0:1786002695.516995:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5308 00000100:00100000:0.0:1786002695.517004:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+125:22447:x1872758531114880:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:0.0:1786002695.517255:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+126:22447:x1872758531114880:12345-192.168.203.49@tcp:35:dd.0 Request processed in 251us (472us total) trans 4294968781 rc 0/0 00000100:00100000:0.0:1786002695.517263:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5308 00000100:00100000:2.0:1786002695.517402:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531115008 00000100:00100000:2.0:1786002695.517406:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531115008 00000100:00100000:2.0:1786002695.517442:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1577 00000100:00100000:2.0:1786002695.517449:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+126:2413:x1872758531115008:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002695.517459:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002695.517488:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af578417fb1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b492 expref: 126 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.517511:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002695.517515:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002695.517533:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+125:2413:x1872758531115008:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 85us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002695.517540:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1577 00000100:00100000:3.0:1786002695.536782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.536919:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531115136 00000100:00100000:2.0:1786002695.536936:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531115136 00002000:00100000:2.0:1786002695.536981:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (69632->77823) req@ffff9ed37f551180 x1872758531115136/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/0 e 0 to 0 dl 1786002706 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002695.536991:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f551180 with x1872758531115136 ext(69632->77823) 00002000:00010000:2.0:1786002695.536997:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f551180 00000100:00100000:2.0:1786002695.537028:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 98 00000100:00100000:2.0:1786002695.537038:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531115136:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:2.0:1786002695.538500:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758531115136:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1460us (1724us total) trans 4294970015 rc 0/0 00000100:00100000:2.0:1786002695.538508:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 98 00002000:00100000:2.0:1786002695.538516:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (69632->77823) req@ffff9ed37f551180 x1872758531115136/t4294970015(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/448 e 0 to 0 dl 1786002706 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002695.538525:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f551180 with x1872758531115136 ext(69632->77823) 00002000:00010000:2.0:1786002695.538530:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f551180 00000100:00100000:3.0:1786002695.546433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.546783:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531115264 00000100:00100000:2.0:1786002695.546793:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531115264 00000100:00100000:2.0:1786002695.546884:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5430 00000100:00100000:2.0:1786002695.546893:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2411:x1872758531115264:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:3.0:1786002695.550985:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970015 is committed 00000100:00100000:2.0:1786002695.551201:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531115264:12345-192.168.203.49@tcp:16:dd.0 Request processed in 4303us (4770us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002695.551212:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5430 00000100:00100000:3.0:1786002695.583381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.583555:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531115520 00000100:00100000:1.0:1786002695.583563:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531115520 00000100:00100000:1.0:1786002695.583633:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24343 00000100:00100000:1.0:1786002695.583643:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+125:22448:x1872758531115520:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:1.0:1786002695.583674:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002695.583696:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af578417fbf lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b499 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.583799:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578417fc6 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.583812:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578417fc6 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.583823:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578417fc6 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.583836:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578417fcd lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.583842:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578417fcd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.583877:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578417fcd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.583959:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af578417fd4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.583969:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af578417fd4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.583976:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af578417fd4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002695.583986:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 73728 00010000:00010000:1.0:1786002695.584058:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578417fc6 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584066:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578417fc6 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584072:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578417fc6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584078:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578417fc6 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584085:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002695.584088:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578417fc6 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584095:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578417fc6 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584106:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef100) 00010000:00010000:1.0:1786002695.584109:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002695.584114:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578417fc6 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584120:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578417fc6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584132:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578417fcd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584138:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578417fcd lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584144:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578417fcd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584149:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002695.584151:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578417fcd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584157:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578417fcd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584169:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed2456ef000) 00010000:00010000:1.0:1786002695.584171:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002695.584174:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578417fcd lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584180:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578417fcd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584227:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af578417fbf lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b499 expref: 128 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584264:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af578417fd4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b499 expref: 127 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.584272:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002695.584275:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786002695.584277:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1800, rc 0) 00000100:00100000:1.0:1786002695.584336:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+127:22448:x1872758531115520:12345-192.168.203.49@tcp:101:dd.0 Request processed in 694us (973us total) trans 4294968782 rc 0/0 00000100:00100000:1.0:1786002695.584343:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24343 00000100:00100000:3.0:1786002695.593606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.593881:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531115776 00000100:00100000:0.0:1786002695.593890:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531115776 00000100:00100000:0.0:1786002695.593957:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5309 00000100:00100000:0.0:1786002695.593968:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+127:22448:x1872758531115776:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:0.0:1786002695.594226:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+128:22448:x1872758531115776:12345-192.168.203.49@tcp:35:dd.0 Request processed in 260us (628us total) trans 4294968783 rc 0/0 00000100:00100000:0.0:1786002695.594234:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5309 00000100:00100000:2.0:1786002695.608359:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.608592:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531115904 00000100:00100000:1.0:1786002695.608601:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531115904 00000100:00100000:1.0:1786002695.608666:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1578 00000100:00100000:1.0:1786002695.608676:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed347f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+128:2413:x1872758531115904:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002695.608690:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002695.608713:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af578417fd4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b499 expref: 128 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.608736:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002695.608741:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002695.608805:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed347f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+127:2413:x1872758531115904:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 130us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002695.608812:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1578 00000100:00100000:3.0:1786002695.616957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.617035:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531116032 00000100:00100000:1.0:1786002695.617044:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531116032 00002000:00100000:1.0:1786002695.617085:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (73728->81919) req@ffff9ed37f550700 x1872758531116032/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/0 e 0 to 0 dl 1786002706 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002695.617095:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f550700 with x1872758531116032 ext(73728->81919) 00002000:00010000:1.0:1786002695.617100:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f550700 00000100:00100000:1.0:1786002695.617139:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 99 00000100:00100000:1.0:1786002695.617147:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531116032:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002695.619021:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758531116032:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1870us (2068us total) trans 4294970017 rc 0/0 00000100:00100000:1.0:1786002695.619031:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 99 00002000:00100000:1.0:1786002695.619039:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (73728->81919) req@ffff9ed37f550700 x1872758531116032/t4294970017(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/448 e 0 to 0 dl 1786002706 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002695.619048:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f550700 with x1872758531116032 ext(73728->81919) 00002000:00010000:1.0:1786002695.619053:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f550700 00000100:00100000:2.0:1786002695.627142:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.627220:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531116160 00000100:00100000:0.0:1786002695.627228:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531116160 00000100:00100000:0.0:1786002695.627276:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5431 00000100:00100000:0.0:1786002695.627285:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2411:x1872758531116160:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:3.0:1786002695.628952:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970017 is committed 00000100:00100000:0.0:1786002695.632717:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531116160:12345-192.168.203.49@tcp:16:dd.0 Request processed in 5426us (5576us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002695.632730:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5431 00000100:00100000:2.0:1786002695.646537:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.646641:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531116416 00000100:00100000:0.0:1786002695.646649:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531116416 00000100:00100000:0.0:1786002695.646710:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24344 00000100:00100000:0.0:1786002695.646720:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+127:22449:x1872758531116416:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002695.646743:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002695.646763:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417fe2 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4a0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.646895:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417fe9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.646908:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417fe9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.646918:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417fe9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.646940:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417ff0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.646946:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417ff0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.646952:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417ff0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647000:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417ff7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647009:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647015:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002695.647023:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 77824 00010000:00010000:0.0:1786002695.647090:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417fe9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647098:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417fe9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647230:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417fe9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647239:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417fe9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647244:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002695.647248:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417fe9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647256:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417fe9 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647268:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:0.0:1786002695.647271:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002695.647275:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417fe9 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647280:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578417fe9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647293:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417ff0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647299:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647305:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417ff0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647309:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002695.647311:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417ff0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647316:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417ff0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647322:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:0.0:1786002695.647323:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002695.647326:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417ff0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647331:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af578417ff0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647368:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578417fe2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4a0 expref: 130 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647382:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417ff7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4a0 expref: 129 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.647394:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002695.647404:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786002695.647408:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:0.0:1786002695.647465:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+129:22449:x1872758531116416:12345-192.168.203.49@tcp:101:dd.0 Request processed in 746us (937us total) trans 4294968784 rc 0/0 00000100:00100000:0.0:1786002695.647471:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24344 00000100:00100000:3.0:1786002695.651027:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.651181:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531116672 00000100:00100000:1.0:1786002695.651189:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531116672 00000100:00100000:1.0:1786002695.651227:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5310 00000100:00100000:1.0:1786002695.651235:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+129:22449:x1872758531116672:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:1.0:1786002695.651456:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+130:22449:x1872758531116672:12345-192.168.203.49@tcp:35:dd.0 Request processed in 220us (433us total) trans 4294968785 rc 0/0 00000100:00100000:1.0:1786002695.651463:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5310 00000100:00100000:3.0:1786002695.659718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.659877:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531116800 00000100:00100000:2.0:1786002695.659885:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531116800 00000100:00100000:2.0:1786002695.659952:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1579 00000100:00100000:2.0:1786002695.659961:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+130:2410:x1872758531116800:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002695.659976:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002695.659999:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af578417ff7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4a0 expref: 130 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002695.660017:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002695.660022:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002695.660070:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+129:2410:x1872758531116800:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 110us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002695.660078:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1579 00000100:00100000:2.0:1786002695.666285:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.666365:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531116928 00000100:00100000:1.0:1786002695.666374:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531116928 00002000:00100000:1.0:1786002695.666429:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (77824->86015) req@ffff9ed34b5af100 x1872758531116928/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/0 e 0 to 0 dl 1786002706 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002695.666440:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5af100 with x1872758531116928 ext(77824->86015) 00002000:00010000:1.0:1786002695.666446:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5af100 00000100:00100000:1.0:1786002695.666482:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 100 00000100:00100000:1.0:1786002695.666492:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531116928:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002695.668026:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758531116928:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1530us (1744us total) trans 4294970019 rc 0/0 00000100:00100000:1.0:1786002695.668036:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 100 00002000:00100000:1.0:1786002695.668045:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xc:0x0] (77824->86015) req@ffff9ed34b5af100 x1872758531116928/t4294970019(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/448 e 0 to 0 dl 1786002706 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002695.668055:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5af100 with x1872758531116928 ext(77824->86015) 00002000:00010000:1.0:1786002695.668060:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5af100 00000100:00100000:3.0:1786002695.673217:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.673340:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531117056 00000100:00100000:2.0:1786002695.673349:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531117056 00000100:00100000:2.0:1786002695.673410:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5432 00000100:00100000:2.0:1786002695.673420:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2411:x1872758531117056:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002695.675645:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970019 is committed 00000100:00100000:2.0:1786002695.675880:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531117056:12345-192.168.203.49@tcp:16:dd.0 Request processed in 2424us (2635us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002695.675894:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5432 00000100:00100000:2.0:1786002695.688010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.688130:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531117312 00000100:00100000:0.0:1786002695.688139:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531117312 00000100:00100000:0.0:1786002695.688195:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24345 00000100:00100000:0.0:1786002695.688204:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+129:22450:x1872758531117312:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:0.0:1786002695.688226:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002695.688245:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578418005 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.688341:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841800c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.688354:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841800c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.688365:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841800c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.688377:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418013 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.688383:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418013 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.688401:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418013 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.688454:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841801a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.688463:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841801a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.688825:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841801a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002695.688836:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 81920 00010000:00010000:1.0:1786002695.689087:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841800c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689097:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841800c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689113:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841800c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689121:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841800c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689127:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002695.689131:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841800c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689139:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841800c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689152:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245e35700) 00010000:00010000:1.0:1786002695.689155:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002695.689158:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841800c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689165:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af57841800c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689178:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418013 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689184:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418013 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689191:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418013 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689196:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002695.689199:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418013 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689209:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418013 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689216:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35500) 00010000:00010000:1.0:1786002695.689219:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002695.689221:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418013 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689227:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418013 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689265:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af578418005 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4a7 expref: 132 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689279:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841801a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4a7 expref: 131 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.689286:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002695.689288:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786002695.689291:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35000, rc 0) 00000100:00100000:1.0:1786002695.689345:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+131:22450:x1872758531117312:12345-192.168.203.49@tcp:101:dd.0 Request processed in 1140us (1342us total) trans 4294968786 rc 0/0 00000100:00100000:1.0:1786002695.689352:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24345 00000100:00100000:3.0:1786002695.693045:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.693189:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531117440 00000100:00100000:1.0:1786002695.693196:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531117440 00000100:00100000:1.0:1786002695.693249:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1580 00000100:00100000:1.0:1786002695.693258:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+131:2410:x1872758531117440:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002695.693276:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002695.693297:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af57841801a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4a7 expref: 131 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.693314:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002695.693318:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002695.693366:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+130:2410:x1872758531117440:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 109us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002695.693373:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1580 00000100:00100000:3.0:1786002695.706900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002695.707268:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531117696 00000100:00100000:2.0:1786002695.707277:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531117696 00000100:00100000:2.0:1786002695.707374:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5311 00000100:00100000:2.0:1786002695.707385:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+130:22450:x1872758531117696:12345-192.168.203.49@tcp:35:dd.0 00000100:00100000:2.0:1786002695.708088:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+131:22450:x1872758531117696:12345-192.168.203.49@tcp:35:dd.0 Request processed in 703us (1241us total) trans 4294968787 rc 0/0 00000100:00100000:2.0:1786002695.708096:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5311 00000100:00100000:2.0:1786002695.717831:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.718543:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531117824 00000100:00100000:1.0:1786002695.718552:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531117824 00002000:00100000:1.0:1786002695.718610:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (81920->90111) req@ffff9ed34b5adf80 x1872758531117824/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/0 e 0 to 0 dl 1786002706 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002695.718621:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5adf80 with x1872758531117824 ext(81920->90111) 00002000:00010000:1.0:1786002695.718627:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5adf80 00000100:00100000:1.0:1786002695.718717:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 101 00000100:00100000:1.0:1786002695.718728:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531117824:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002695.720685:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758531117824:12345-192.168.203.49@tcp:4:dd.0 Request processed in 1955us (2859us total) trans 4294970021 rc 0/0 00000100:00100000:1.0:1786002695.720694:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 101 00002000:00100000:1.0:1786002695.720702:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xc:0x0] (81920->90111) req@ffff9ed34b5adf80 x1872758531117824/t4294970021(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:376/0 lens 8680/448 e 0 to 0 dl 1786002706 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786002695.720711:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5adf80 with x1872758531117824 ext(81920->90111) 00002000:00010000:1.0:1786002695.720715:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5adf80 00000100:00100000:3.0:1786002695.729994:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.730120:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531117952 00000100:00100000:1.0:1786002695.730129:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531117952 00000100:00100000:1.0:1786002695.730177:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5433 00000100:00100000:1.0:1786002695.730186:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2412:x1872758531117952:12345-192.168.203.49@tcp:16:dd.0 00000001:00080000:0.0:1786002695.731532:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970021 is committed 00000100:00100000:1.0:1786002695.731718:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531117952:12345-192.168.203.49@tcp:16:dd.0 Request processed in 1530us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002695.731726:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5433 00000100:00100000:3.0:1786002695.816528:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.816751:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531118080 00000100:00100000:1.0:1786002695.816760:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531118080 00000100:00100000:1.0:1786002695.816823:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24346 00000100:00100000:1.0:1786002695.816833:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+131:22457:x1872758531118080:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002695.816878:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002695.816900:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af578418028 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4ae expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.816976:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841802f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.816990:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841802f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.817000:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841802f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002695.817046:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a1:0x0]: returning size 4096 00000004:00200000:1.0:1786002695.817050:0:14496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786002695.817066:0:14496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841802f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.817091:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af578418028 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4ae expref: 133 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.817124:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841802f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4ae expref: 132 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.817132:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:1.0:1786002695.817134:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786002695.817137:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1000, rc 0) 00000100:00100000:1.0:1786002695.817196:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+132:22457:x1872758531118080:12345-192.168.203.49@tcp:101:ls.0 Request processed in 364us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002695.817203:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24346 00000100:00100000:2.0:1786002695.824984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.825052:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531118208 00000100:00100000:0.0:1786002695.825061:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531118208 00000100:00100000:0.0:1786002695.825116:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24347 00000100:00100000:0.0:1786002695.825125:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+132:22457:x1872758531118208:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002695.825144:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002695.825163:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578418036 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4b5 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.825195:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af57841803d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.825207:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af57841803d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.825219:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af57841803d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.825323:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578418036 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4b5 expref: 134 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.825338:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34e00/0x7cee4af57841803d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4b5 expref: 133 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002695.825346:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002695.825349:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786002695.825352:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34e00, rc 0) 00000100:00100000:0.0:1786002695.825416:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+133:22457:x1872758531118208:12345-192.168.203.49@tcp:101:ls.0 Request processed in 292us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002695.825423:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24347 00000100:00100000:3.0:1786002695.850432:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.850693:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531118464 00000100:00100000:1.0:1786002695.850701:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531118464 00000100:00100000:1.0:1786002695.850761:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24348 00000100:00100000:1.0:1786002695.850771:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+133:22457:x1872758531118464:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:1.0:1786002695.850790:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002695.850813:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af578418044 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4bc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002695.850945:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a1:0x0]: returning size 4096 00010000:00010000:1.0:1786002695.851042:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af578418044 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4bc expref: 135 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.851057:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed2456ef100) 00010000:00010000:1.0:1786002695.851060:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002695.851065:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af578418044 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4bc expref: 135 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.851089:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1800, rc 0) 00000100:00100000:1.0:1786002695.851142:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+134:22457:x1872758531118464:12345-192.168.203.49@tcp:101:ls.0 Request processed in 372us (719us total) trans 4294968788 rc 301/301 00000100:00100000:1.0:1786002695.851149:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24348 00000100:00100000:3.0:1786002695.868329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002695.868425:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531118592 00000100:00100000:0.0:1786002695.868435:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531118592 00000100:00100000:0.0:1786002695.868491:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5312 00000100:00100000:0.0:1786002695.868502:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+134:22457:x1872758531118592:12345-192.168.203.49@tcp:37:ls.0 00000100:00100000:0.0:1786002695.885638:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+134:22457:x1872758531118592:12345-192.168.203.49@tcp:37:ls.0 Request processed in 17128us (17307us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002695.885651:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5312 00000100:00100000:3.0:1786002695.947761:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002695.947899:0:20598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531118720 00000100:00100000:1.0:1786002695.947908:0:20598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531118720 00000100:00100000:1.0:1786002695.947970:0:20598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 4168 00000100:00100000:1.0:1786002695.947979:0:20598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+134:2410:x1872758531118720:12345-192.168.203.49@tcp:63:ll_sa.0 00010000:00010000:1.0:1786002695.948012:0:20598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002695.948029:0:20598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af578418052 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4c3 expref: -99 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948078:0:20598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578418059 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948092:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578418059 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948112:0:20598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578418059 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948126:0:20598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418060 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948133:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418060 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948140:0:20598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418060 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948206:0:20598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1400/0x7cee4af578418067 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20598 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948215:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1400/0x7cee4af578418067 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x5a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948222:0:20598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1400/0x7cee4af578418067 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x5a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002695.948240:0:20598:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 86016 00000004:00200000:1.0:1786002695.948244:0:20598:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1786002695.948261:0:20598:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1400/0x7cee4af578418067 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x5a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948271:0:20598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1400/0x7cee4af578418067 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948280:0:20598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578418059 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948286:0:20598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578418059 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948294:0:20598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578418059 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948300:0:20598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002695.948304:0:20598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578418059 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948312:0:20598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578418059 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948323:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:1.0:1786002695.948327:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002695.948330:0:20598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578418059 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948337:0:20598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0800/0x7cee4af578418059 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948349:0:20598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418060 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948356:0:20598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418060 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948362:0:20598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418060 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948367:0:20598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002695.948370:0:20598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418060 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948376:0:20598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418060 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948382:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed2456ef100) 00010000:00010000:1.0:1786002695.948384:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002695.948387:0:20598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418060 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948393:0:20598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418060 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20598 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948417:0:20598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af578418052 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4c3 expref: 136 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948428:0:20598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1400/0x7cee4af578418067 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4c3 expref: 135 pid: 20598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002695.948436:0:20598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:1.0:1786002695.948438:0:20598:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786002695.948441:0:20598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1400, rc 0) 00000100:00100000:1.0:1786002695.948503:0:20598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+135:2410:x1872758531118720:12345-192.168.203.49@tcp:63:ll_sa.0 Request processed in 525us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002695.948511:0:20598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 4168 00000100:00100000:3.0:1786002696.056116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002696.056202:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531118848 00000100:00100000:0.0:1786002696.056211:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531118848 00000100:00100000:0.0:1786002696.056269:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24349 00000100:00100000:0.0:1786002696.056279:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+135:22457:x1872758531118848:12345-192.168.203.49@tcp:101:ls.0 00010000:00010000:0.0:1786002696.056298:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002696.056316:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af57841806e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4ca expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.056375:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578418075 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.056399:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578418075 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.056411:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578418075 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.056453:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af57841807c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.056462:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af57841807c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.056469:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af57841807c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.056514:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418083 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.056524:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b38f expref: 136 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.056533:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418083 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.056563:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b38f expref: 136 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.056593:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b38f expref: 136 pid: 6521 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002696.056607:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c43100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758561087616:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002696.056688:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243642cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786002696.084789:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c43100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758561087616:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002696.084818:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418083 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002696.088973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.089057:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531119104 00000100:00100000:2.0:1786002696.089065:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531119104 00000100:00100000:2.0:1786002696.089123:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5313 00000100:00100000:2.0:1786002696.089132:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+137:6189:x1872758531119104:12345-192.168.203.49@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1786002696.089392:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+138:6189:x1872758531119104:12345-192.168.203.49@tcp:35:ldlm_bl.0 Request processed in 253us (419us total) trans 4294968789 rc 0/0 00000100:00100000:2.0:1786002696.089401:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5313 00000100:00100000:2.0:1786002696.105017:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002696.105121:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531119232 00000100:00100000:0.0:1786002696.105132:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531119232 00010000:00010000:0.0:1786002696.105172:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b38f expref: 138 pid: 6521 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002696.105214:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1704 00000100:00100000:0.0:1786002696.105225:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+138:2412:x1872758531119232:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002696.105240:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002696.105247:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b38f expref: 138 pid: 6521 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.105261:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b38f expref: 138 pid: 6521 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.105284:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244998a00/0x7cee4af578417ad3 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1b6:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b38f expref: 138 pid: 6521 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.105306:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:0.0:1786002696.105312:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418083 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.105323:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418083 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.105331:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418083 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.105361:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002696.105422:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+137:2412:x1872758531119232:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 199us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002696.105430:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1704 00010000:00010000:2.0:1786002696.105998:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418083 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106007:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418083 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002696.106053:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b6:0x0]: returning size 90112 00000004:00200000:2.0:1786002696.106058:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1786002696.106074:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418083 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106086:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418083 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106096:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578418075 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106113:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578418075 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106120:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578418075 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106127:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578418075 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106132:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002696.106136:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578418075 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106143:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578418075 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106153:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:2.0:1786002696.106155:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002696.106158:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578418075 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106165:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af578418075 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106180:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af57841807c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106187:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af57841807c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106192:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af57841807c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106197:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002696.106200:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af57841807c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106205:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af57841807c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106211:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x1a9514bb (ffff9ed245e35900) 00010000:00010000:2.0:1786002696.106213:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002696.106216:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af57841807c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106221:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af57841807c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x1a9514bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106249:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af57841806e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4ca expref: 137 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106261:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34a00/0x7cee4af578418083 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4ca expref: 136 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.106273:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b6:0x0].0x0 (ffff9ed243d0b800) 00010000:00010000:2.0:1786002696.106276:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002696.106278:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34a00, rc 0) 00000100:00100000:2.0:1786002696.106309:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+136:22457:x1872758531118848:12345-192.168.203.49@tcp:101:ls.0 Request processed in 50032us (50212us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002696.106316:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24349 00000100:00100000:2.0:1786002696.117826:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002696.118017:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531119488 00000100:00100000:0.0:1786002696.118027:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531119488 00000100:00100000:0.0:1786002696.118080:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5314 00000100:00100000:0.0:1786002696.118091:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+136:22457:x1872758531119488:12345-192.168.203.49@tcp:35:ls.0 00000100:00100000:0.0:1786002696.118306:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+137:22457:x1872758531119488:12345-192.168.203.49@tcp:35:ls.0 Request processed in 215us (486us total) trans 4294968790 rc 0/0 00000100:00100000:0.0:1786002696.118314:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5314 00010000:00010000:3.0:1786002696.175628:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002696.323760:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.324024:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531119744 00000100:00100000:1.0:1786002696.324033:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531119744 00000100:00100000:1.0:1786002696.324091:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24350 00000100:00100000:1.0:1786002696.324108:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+137:22233:x1872758531119744:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002696.324131:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002696.324134:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786002696.324159:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841802f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4ae expref: 137 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.324178:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:1.0:1786002696.324183:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002696.324196:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af57841808a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.324319:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418091 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.324331:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418091 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.324340:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418091 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002696.324350:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a2:0x0]: returning size 6 00010000:00010000:1.0:1786002696.324441:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af57841808a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4d1 expref: 139 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.324455:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418091 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4d1 expref: 138 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.324463:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9ed245644c00) 00010000:00010000:1.0:1786002696.324480:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002696.324483:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b0e00, rc 0) 00000100:00100000:1.0:1786002696.324539:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+138:22233:x1872758531119744:12345-192.168.203.49@tcp:101:bash.0 Request processed in 440us (788us total) trans 4294968791 rc 0/0 00000100:00100000:1.0:1786002696.324547:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24350 00000100:00100000:1.0:1786002696.329075:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002696.329302:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531120000 00000100:00100000:3.0:1786002696.329312:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531120000 00000100:00100000:3.0:1786002696.329362:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24351 00000100:00100000:3.0:1786002696.329373:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+138:22233:x1872758531120000:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:3.0:1786002696.329419:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786002696.329443:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af578418091 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4d1 expref: 138 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.329463:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556a200/0x7cee4af5784174b3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b151 expref: 137 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.329487:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9ed245644c00) 00010000:00010000:3.0:1786002696.329492:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002696.330145:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841809f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.330159:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841809f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.330168:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841809f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002696.330213:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968792 00000004:00010000:3.0:1786002696.330234:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f74453d reply state 00000000be44d67c transno 4294968793 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841809f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.330245:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841809f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.330252:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9ed245644c00) 00010000:00010000:3.0:1786002696.330255:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002696.330258:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002696.330332:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+139:22233:x1872758531120000:12345-192.168.203.49@tcp:36:bash.0 Request processed in 959us (1264us total) trans 4294968793 rc 0/0 00000100:00100000:3.0:1786002696.330340:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24351 00000020:00080000:3.0:1786002696.330344:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002696.340171:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002696.340260:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531120128 00000100:00100000:0.0:1786002696.340269:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531120128 00000100:00100000:0.0:1786002696.340329:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24352 00000100:00100000:0.0:1786002696.340339:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+139:22233:x1872758531120128:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002696.340360:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002696.340377:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784180a6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4d8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.340589:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784180a6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4d8 expref: 140 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.340605:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35400/0x7cee4af5784180a6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4d8 expref: 140 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.340622:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9ed245644c00) 00010000:00010000:0.0:1786002696.340626:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786002696.340629:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35400, rc 0) 00000100:00100000:0.0:1786002696.340683:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+140:22233:x1872758531120128:12345-192.168.203.49@tcp:101:bash.0 Request processed in 345us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002696.340690:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24352 00000100:00100000:0.0:1786002696.365065:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.365152:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531120256 00000100:00100000:1.0:1786002696.365161:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531120256 00002000:00010000:1.0:1786002696.365204:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2 (0->18446744073709551615) 00002000:00100000:1.0:1786002696.365208:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245c43100 with x1872758531120256 ext(0->18446744073709551615) 00002000:00010000:1.0:1786002696.365218:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed245c43100. 00000100:00100000:1.0:1786002696.365250:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 102 00000100:00100000:1.0:1786002696.365260:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531120256:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:1.0:1786002696.365674:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786002696.365678:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1786002696 00002000:00010000:1.0:1786002696.365681:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786002696.365684:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1786002696 00002000:00010000:1.0:1786002696.365686:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1786002696.365838:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2413:x1872758531120256:12345-192.168.203.49@tcp:10:bash.0 Request processed in 578us (780us total) trans 4294970022 rc 0/0 00000100:00100000:1.0:1786002696.365887:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 102 00002000:00010000:1.0:1786002696.365891:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2 (0->18446744073709551615) 00002000:00100000:1.0:1786002696.365894:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245c43100 with x1872758531120256 ext(0->18446744073709551615) 00002000:00010000:1.0:1786002696.365899:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed245c43100. 00000100:00100000:1.0:1786002696.381027:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002696.381942:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531120384 00000100:00100000:0.0:1786002696.381952:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531120384 00000100:00100000:0.0:1786002696.382011:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5434 00000100:00100000:0.0:1786002696.382021:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2411:x1872758531120384:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002696.384331:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970022 is committed 00000100:00100000:0.0:1786002696.385161:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531120384:12345-192.168.203.49@tcp:16:bash.0 Request processed in 3137us (4138us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002696.385173:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5434 00000100:00100000:2.0:1786002696.398070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.402006:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531120640 00000100:00100000:1.0:1786002696.402019:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531120640 00000100:00100000:1.0:1786002696.402086:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5315 00000100:00100000:1.0:1786002696.402095:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+140:22233:x1872758531120640:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:1.0:1786002696.402304:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+141:22233:x1872758531120640:12345-192.168.203.49@tcp:35:bash.0 Request processed in 208us (4241us total) trans 4294968794 rc 0/0 00000100:00100000:1.0:1786002696.402311:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5315 00000100:00100000:3.0:1786002696.405997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.406202:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531120768 00000100:00100000:1.0:1786002696.406210:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531120768 00000100:00100000:1.0:1786002696.406262:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24353 00000100:00100000:1.0:1786002696.406272:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+141:22233:x1872758531120768:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:1.0:1786002696.406391:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+141:22233:x1872758531120768:12345-192.168.203.49@tcp:44:bash.0 Request processed in 120us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002696.406399:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24353 00000100:00100000:3.0:1786002696.409472:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.409623:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531120896 00000100:00100000:2.0:1786002696.409631:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531120896 00000100:00100000:2.0:1786002696.409705:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24354 00000100:00100000:2.0:1786002696.409716:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22233:x1872758531120896:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002696.409733:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002696.409751:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784180ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4df expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.409810:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784180b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.409824:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784180b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.409834:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784180b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.409877:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af5784180bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.409895:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af5784180bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.409901:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af5784180bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.409970:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784180c2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.409979:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784180c2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.409987:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784180c2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786002696.410006:0:10360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784180c2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410019:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784180b4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410027:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784180b4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410034:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784180b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410040:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784180b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410046:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002696.410050:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784180b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410058:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784180b4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410068:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed35a569000) 00010000:00010000:2.0:1786002696.410072:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002696.410076:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784180b4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410082:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2da00/0x7cee4af5784180b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410095:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af5784180bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410102:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af5784180bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410322:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af5784180bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410328:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1786002696.410331:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af5784180bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410338:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af5784180bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410347:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb45cd5d (ffff9ed2456f9300) 00010000:00010000:2.0:1786002696.410350:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786002696.410353:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af5784180bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410364:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c200/0x7cee4af5784180bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdb45cd5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410394:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2d400/0x7cee4af5784180ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4df expref: 18 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410406:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784180c2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4df expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.410414:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245644800) 00010000:00010000:2.0:1786002696.410417:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002696.410419:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2c800, rc 0) 00000100:00100000:2.0:1786002696.410472:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:22233:x1872758531120896:12345-192.168.203.49@tcp:101:bash.0 Request processed in 758us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002696.410479:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24354 00000100:00080000:0.0:1786002696.411525:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002696.423814:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.423892:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002696.424024:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531121024 00000100:00100000:0.0:1786002696.424033:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531121024 00000100:00100000:0.0:1786002696.424098:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24355 00000100:00100000:0.0:1786002696.424118:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+141:22233:x1872758531121024:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002696.424139:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002696.424160:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180c9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4e6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.424235:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784180d0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.424249:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784180d0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.424260:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784180d0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002696.424301:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a1:0x0]: returning size 4096 00000004:00200000:0.0:1786002696.424305:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1786002696.424340:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180c9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4e6 expref: 143 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.424358:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35600/0x7cee4af5784180d0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4e6 expref: 142 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.424366:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002696.424369:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1786002696.424372:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35600, rc 0) 00000100:00100000:0.0:1786002696.424436:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+142:22233:x1872758531121024:12345-192.168.203.49@tcp:101:bash.0 Request processed in 320us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002696.424442:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24355 00000100:00100000:1.0:1786002696.424954:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531121152 00000100:00100000:1.0:1786002696.424959:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531121152 00000100:00100000:1.0:1786002696.424999:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1581 00000100:00100000:1.0:1786002696.425007:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531121152:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002696.425017:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002696.425034:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed366e2c800/0x7cee4af5784180c2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4df expref: 17 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.425046:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245644800) 00010000:00010000:1.0:1786002696.425050:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002696.425085:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2410:x1872758531121152:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 79us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002696.425092:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1581 00000100:00100000:2.0:1786002696.439798:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002696.440002:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531121408 00000100:00100000:3.0:1786002696.440011:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531121408 00000100:00100000:3.0:1786002696.440070:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24356 00000100:00100000:3.0:1786002696.440080:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+142:22233:x1872758531121408:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002696.440109:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002696.440130:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af5784180d7 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4ed expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.440254:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af5784180de lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.440271:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af5784180de lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.440282:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af5784180de lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002696.440293:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a3:0x0]: returning size 6 00010000:00010000:3.0:1786002696.440393:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af5784180d7 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4ed expref: 145 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.440412:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af5784180de lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4ed expref: 144 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.440420:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9ed245644600) 00010000:00010000:3.0:1786002696.440423:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002696.440427:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca6600, rc 0) 00000100:00100000:3.0:1786002696.441390:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+144:22233:x1872758531121408:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1309us (1597us total) trans 4294968795 rc 0/0 00000100:00100000:3.0:1786002696.441399:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24356 00000100:00100000:2.0:1786002696.465735:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002696.465821:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531121664 00000100:00100000:0.0:1786002696.465829:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531121664 00000100:00100000:0.0:1786002696.465924:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24357 00000100:00100000:0.0:1786002696.465934:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+144:22233:x1872758531121664:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:0.0:1786002696.465985:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786002696.466009:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af5784180de lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4ed expref: 144 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.466029:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed34556b000/0x7cee4af5784174d6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b158 expref: 143 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.466040:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9ed245644600) 00010000:00010000:0.0:1786002696.466044:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002696.466191:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180ec lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.466204:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180ec lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.466213:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180ec lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002696.466249:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968796 00000004:00010000:0.0:1786002696.466266:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e931033b reply state 00000000e6332455 transno 4294968797 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180ec lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.466277:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180ec lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.466283:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9ed245644600) 00010000:00010000:0.0:1786002696.466285:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002696.466288:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002696.466370:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+145:22233:x1872758531121664:12345-192.168.203.49@tcp:36:bash.0 Request processed in 437us (643us total) trans 4294968797 rc 0/0 00000100:00100000:0.0:1786002696.466378:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24357 00000020:00080000:0.0:1786002696.466383:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002696.476082:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002696.476202:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531121792 00000100:00100000:3.0:1786002696.476211:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531121792 00000100:00100000:3.0:1786002696.476269:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24358 00000100:00100000:3.0:1786002696.476279:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+145:22233:x1872758531121792:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002696.476302:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002696.476320:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af5784180f3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.476376:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af5784180f3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4f4 expref: 146 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.476390:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7600/0x7cee4af5784180f3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4f4 expref: 146 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.476408:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9ed245644600) 00010000:00010000:3.0:1786002696.476411:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786002696.476415:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca7600, rc 0) 00000100:00100000:3.0:1786002696.476477:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+146:22233:x1872758531121792:12345-192.168.203.49@tcp:101:bash.0 Request processed in 191us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002696.476484:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24358 00000100:00100000:3.0:1786002696.482676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.482806:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531121920 00000100:00100000:1.0:1786002696.482814:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531121920 00002000:00010000:1.0:1786002696.482894:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1786002696.482899:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ff9f80 with x1872758531121920 ext(0->18446744073709551615) 00002000:00010000:1.0:1786002696.482909:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244ff9f80. 00000100:00100000:1.0:1786002696.482937:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 103 00000100:00100000:1.0:1786002696.482947:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531121920:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:1.0:1786002696.483191:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786002696.483195:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1786002696 00002000:00010000:1.0:1786002696.483198:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786002696.483200:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1786002696 00002000:00010000:1.0:1786002696.483202:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1786002696.483257:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531121920:12345-192.168.203.49@tcp:10:bash.0 Request processed in 311us (589us total) trans 4294969985 rc 0/0 00000100:00100000:1.0:1786002696.483264:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 103 00002000:00010000:1.0:1786002696.483268:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1786002696.483270:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ff9f80 with x1872758531121920 ext(0->18446744073709551615) 00002000:00010000:1.0:1786002696.483274:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed244ff9f80. 00000100:00080000:0.0:1786002696.483377:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002696.501945:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002696.502060:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531122048 00000100:00100000:0.0:1786002696.502069:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531122048 00000100:00100000:0.0:1786002696.502127:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5435 00000100:00100000:0.0:1786002696.502136:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531122048:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002696.504047:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969985 is committed 00000100:00100000:0.0:1786002696.504214:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531122048:12345-192.168.203.49@tcp:16:bash.0 Request processed in 2072us (2272us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002696.504224:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5435 00000100:00100000:3.0:1786002696.506799:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.506943:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531122304 00000100:00100000:2.0:1786002696.506952:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531122304 00000100:00100000:2.0:1786002696.507000:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5316 00000100:00100000:2.0:1786002696.507010:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+146:22233:x1872758531122304:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1786002696.507217:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+147:22233:x1872758531122304:12345-192.168.203.49@tcp:35:bash.0 Request processed in 208us (424us total) trans 4294968798 rc 0/0 00000100:00100000:2.0:1786002696.507226:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5316 00000100:00100000:3.0:1786002696.509981:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.510139:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531122432 00000100:00100000:1.0:1786002696.510147:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531122432 00000100:00100000:1.0:1786002696.510198:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24359 00000100:00100000:1.0:1786002696.510207:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+147:22233:x1872758531122432:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:1.0:1786002696.510314:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+147:22233:x1872758531122432:12345-192.168.203.49@tcp:44:bash.0 Request processed in 107us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002696.510322:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24359 00000100:00100000:3.0:1786002696.523481:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.523675:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531122688 00000100:00100000:2.0:1786002696.523685:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531122688 00000100:00100000:2.0:1786002696.523748:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24360 00000100:00100000:2.0:1786002696.523758:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+147:22233:x1872758531122688:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002696.523779:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002696.523799:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af5784180fa lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b4fb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.524089:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578418101 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.524111:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578418101 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.524123:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578418101 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002696.524134:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a4:0x0]: returning size 6 00010000:00010000:2.0:1786002696.524235:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af5784180fa lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4fb expref: 150 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.524254:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578418101 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4fb expref: 149 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.524263:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9ed2456f9a00) 00010000:00010000:2.0:1786002696.524266:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002696.524269:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2d200, rc 0) 00000100:00100000:2.0:1786002696.524364:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+149:22233:x1872758531122688:12345-192.168.203.49@tcp:101:bash.0 Request processed in 607us (901us total) trans 4294968799 rc 0/0 00000100:00100000:2.0:1786002696.524372:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24360 00000100:00100000:3.0:1786002696.549254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.549394:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531122944 00000100:00100000:1.0:1786002696.549403:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531122944 00000100:00100000:1.0:1786002696.549458:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24361 00000100:00100000:1.0:1786002696.549467:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+149:22233:x1872758531122944:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:1.0:1786002696.549517:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1786002696.549540:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af578418101 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b4fb expref: 149 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.549561:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3800/0x7cee4af5784174f9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b15f expref: 148 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.549587:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9ed2456f9a00) 00010000:00010000:1.0:1786002696.549593:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002696.549753:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841810f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.551482:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841810f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.551495:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841810f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002696.552128:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968800 00000004:00010000:1.0:1786002696.552168:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000156a2d7b reply state 0000000072b88c50 transno 4294968801 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841810f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.552181:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841810f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.552187:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9ed2456f9a00) 00010000:00010000:1.0:1786002696.552190:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002696.552193:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002696.552305:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+150:22233:x1872758531122944:12345-192.168.203.49@tcp:36:bash.0 Request processed in 2835us (3054us total) trans 4294968801 rc 0/0 00000100:00100000:1.0:1786002696.552313:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24361 00000020:00080000:1.0:1786002696.552319:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002696.555945:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.556108:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531123072 00000100:00100000:2.0:1786002696.556117:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531123072 00000100:00100000:2.0:1786002696.556168:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24362 00000100:00100000:2.0:1786002696.556177:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+150:22233:x1872758531123072:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002696.556197:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002696.556215:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578418116 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b502 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.556261:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578418116 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b502 expref: 151 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.556275:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d800/0x7cee4af578418116 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b502 expref: 151 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.556292:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9ed2456f9a00) 00010000:00010000:2.0:1786002696.556295:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786002696.556299:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2d800, rc 0) 00000100:00100000:2.0:1786002696.556346:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+151:22233:x1872758531123072:12345-192.168.203.49@tcp:101:bash.0 Request processed in 170us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002696.556354:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24362 00000100:00100000:3.0:1786002696.576093:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.576180:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531123200 00000100:00100000:1.0:1786002696.576190:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531123200 00002000:00010000:1.0:1786002696.576227:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/3 (0->18446744073709551615) 00002000:00100000:1.0:1786002696.576231:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37137f100 with x1872758531123200 ext(0->18446744073709551615) 00002000:00010000:1.0:1786002696.576241:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37137f100. 00000100:00100000:1.0:1786002696.576272:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 104 00000100:00100000:1.0:1786002696.576281:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531123200:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:1.0:1786002696.576492:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786002696.576496:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1786002696 00002000:00010000:1.0:1786002696.576499:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786002696.576501:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1786002696 00002000:00010000:1.0:1786002696.576503:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1786002696.576560:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2412:x1872758531123200:12345-192.168.203.49@tcp:10:bash.0 Request processed in 279us (475us total) trans 4294970023 rc 0/0 00000100:00100000:1.0:1786002696.576567:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 104 00002000:00010000:1.0:1786002696.576570:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/3 (0->18446744073709551615) 00002000:00100000:1.0:1786002696.576572:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37137f100 with x1872758531123200 ext(0->18446744073709551615) 00002000:00010000:1.0:1786002696.576586:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37137f100. 00000100:00100000:1.0:1786002696.599911:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.606491:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531123328 00000100:00100000:2.0:1786002696.606504:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531123328 00000100:00100000:2.0:1786002696.606585:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5436 00000100:00100000:2.0:1786002696.606596:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2410:x1872758531123328:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:0.0:1786002696.615077:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970023 is committed 00000100:00100000:2.0:1786002696.615251:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531123328:12345-192.168.203.49@tcp:16:bash.0 Request processed in 8650us (15344us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002696.615262:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5436 00000100:00100000:3.0:1786002696.620105:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002696.626994:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531123584 00000100:00100000:0.0:1786002696.627007:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531123584 00000100:00100000:1.0:1786002696.635068:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5317 00000100:00100000:1.0:1786002696.635082:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+151:22233:x1872758531123584:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:1.0:1786002696.635338:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+152:22233:x1872758531123584:12345-192.168.203.49@tcp:35:bash.0 Request processed in 257us (15239us total) trans 4294968802 rc 0/0 00000100:00100000:1.0:1786002696.635347:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5317 00000100:00100000:3.0:1786002696.648012:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.648202:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531123712 00000100:00100000:2.0:1786002696.648211:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531123712 00000100:00100000:2.0:1786002696.648266:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24363 00000100:00100000:2.0:1786002696.648276:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+152:22233:x1872758531123712:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:2.0:1786002696.648401:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+152:22233:x1872758531123712:12345-192.168.203.49@tcp:44:bash.0 Request processed in 126us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002696.648409:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24363 00000100:00100000:3.0:1786002696.659892:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.660061:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531123968 00000100:00100000:1.0:1786002696.660071:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531123968 00000100:00100000:1.0:1786002696.660133:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24364 00000100:00100000:1.0:1786002696.660144:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+152:22233:x1872758531123968:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002696.660164:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002696.660185:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1600/0x7cee4af57841811d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b509 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.660296:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af578418124 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.660310:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af578418124 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.660321:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af578418124 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002696.660332:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a5:0x0]: returning size 6 00010000:00010000:1.0:1786002696.660451:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1600/0x7cee4af57841811d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b509 expref: 155 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.660479:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af578418124 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b509 expref: 154 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.660488:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9ed2456ae600) 00010000:00010000:1.0:1786002696.660492:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002696.660495:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b0600, rc 0) 00000100:00100000:1.0:1786002696.660552:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37137ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+154:22233:x1872758531123968:12345-192.168.203.49@tcp:101:bash.0 Request processed in 410us (668us total) trans 4294968803 rc 0/0 00000100:00100000:1.0:1786002696.660560:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24364 00000100:00100000:2.0:1786002696.684684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.684725:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002696.684895:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531124352 00000100:00100000:3.0:1786002696.684905:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531124352 00000100:00100000:3.0:1786002696.684964:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24365 00000100:00100000:3.0:1786002696.684975:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+154:22233:x1872758531124352:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:3.0:1786002696.685029:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002696.685056:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af57841751c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b166 expref: 154 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.685074:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9ed2456ae600) 00010000:00010000:3.0:1786002696.685080:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002696.685248:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.685262:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af578418124 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b509 expref: 154 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.685271:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 4/0,1 mode: --/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.685305:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af578418124 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b509 expref: 154 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.685318:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af578418124 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b509 expref: 154 pid: 6521 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002696.685332:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758561087744:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002696.685544:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531124096 00000100:00100000:0.0:1786002696.685549:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531124096 00010000:00010000:0.0:1786002696.685569:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af578418124 lrc: 6/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b509 expref: 155 pid: 6521 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002696.685605:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1705 00000100:00100000:0.0:1786002696.685611:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+155:2411:x1872758531124096:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786002696.685619:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002696.685624:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af578418124 lrc: 6/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b509 expref: 155 pid: 6521 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.685635:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af578418124 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b509 expref: 155 pid: 6521 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.685663:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9ed2456ae600) 00010000:00010000:0.0:1786002696.685667:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.685674:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.685681:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.685694:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786002696.685719:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+155:2411:x1872758531124096:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 108us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002696.685726:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1705 00000100:00100000:3.0:1786002696.685904:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed357b4d240 going to sleep for 11 seconds 00010000:00010000:3.0:1786002696.699908:0:6520:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.49@tcp) returned -22 from blocking AST (req@00000000cce574c7 x1872758561087744) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af578418124 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b509 expref: 154 pid: 6521 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.699952:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af578418124 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b509 expref: 154 pid: 6521 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002696.699969:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6520:1872758561087744:192.168.203.49@tcp:104: 00010000:00010000:3.0:1786002696.699989:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9ed2456ae600) 00010000:00010000:3.0:1786002696.699996:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.700005:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.700011:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002696.700093:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968804 00000004:00010000:2.0:1786002696.700812:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053a3ef05 reply state 0000000094062b9e transno 4294968805 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.700829:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.700837:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9ed2456ae600) 00010000:00010000:2.0:1786002696.700840:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002696.700843:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002696.700978:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+155:22233:x1872758531124352:12345-192.168.203.49@tcp:36:bash.0 Request processed in 16003us (16251us total) trans 4294968805 rc 0/0 00000100:00100000:2.0:1786002696.700987:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24365 00000020:00080000:2.0:1786002696.700994:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002696.703969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.711533:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531124480 00000100:00100000:1.0:1786002696.711548:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531124480 00000100:00100000:1.0:1786002696.711638:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24366 00000100:00100000:1.0:1786002696.711659:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+155:22233:x1872758531124480:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002696.711685:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002696.711705:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0400/0x7cee4af578418139 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b510 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.712005:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0400/0x7cee4af578418139 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b510 expref: 156 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.712023:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0400/0x7cee4af578418139 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b510 expref: 156 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.713005:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9ed2456ae600) 00010000:00010000:2.0:1786002696.713009:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786002696.713013:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b0400, rc 0) 00000100:00100000:2.0:1786002696.713081:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+156:22233:x1872758531124480:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1433us (9167us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002696.713089:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24366 00000100:00100000:1.0:1786002696.728333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.728422:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531124608 00000100:00100000:2.0:1786002696.728431:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531124608 00002000:00010000:2.0:1786002696.728467:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:2.0:1786002696.728471:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2448fca80 with x1872758531124608 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002696.728482:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2448fca80. 00000100:00100000:2.0:1786002696.728513:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 105 00000100:00100000:2.0:1786002696.728522:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531124608:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:2.0:1786002696.728783:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002696.728787:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1786002696 00002000:00010000:2.0:1786002696.728789:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002696.728792:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1786002696 00002000:00010000:2.0:1786002696.728795:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002696.728879:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531124608:12345-192.168.203.49@tcp:10:bash.0 Request processed in 327us (524us total) trans 4294969986 rc 0/0 00000100:00100000:2.0:1786002696.728886:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 105 00002000:00010000:2.0:1786002696.728889:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:2.0:1786002696.728892:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2448fca80 with x1872758531124608 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002696.728896:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2448fca80. 00000100:00100000:3.0:1786002696.749106:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002696.749241:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531124736 00000100:00100000:0.0:1786002696.749250:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531124736 00000100:00100000:0.0:1786002696.749307:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5437 00000100:00100000:0.0:1786002696.749318:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531124736:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002696.757569:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969986 is committed 00000100:00100000:2.0:1786002696.757776:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531124736:12345-192.168.203.49@tcp:16:bash.0 Request processed in 8454us (8681us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002696.757787:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5437 00000100:00100000:3.0:1786002696.767311:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.767423:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531124992 00000100:00100000:1.0:1786002696.767432:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531124992 00000100:00100000:1.0:1786002696.767491:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5318 00000100:00100000:1.0:1786002696.767501:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+156:22233:x1872758531124992:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:1.0:1786002696.767723:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+157:22233:x1872758531124992:12345-192.168.203.49@tcp:35:bash.0 Request processed in 223us (421us total) trans 4294968806 rc 0/0 00000100:00100000:1.0:1786002696.767730:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5318 00000100:00100000:1.0:1786002696.792949:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.793881:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531125120 00000100:00100000:2.0:1786002696.793891:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531125120 00000100:00100000:2.0:1786002696.793962:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24367 00000100:00100000:2.0:1786002696.793972:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+157:22233:x1872758531125120:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:2.0:1786002696.794113:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+157:22233:x1872758531125120:12345-192.168.203.49@tcp:44:bash.0 Request processed in 142us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002696.794120:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24367 00000100:00100000:2.0:1786002696.806668:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.814237:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531125376 00000100:00100000:1.0:1786002696.814251:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531125376 00000100:00100000:1.0:1786002696.814324:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24368 00000100:00100000:1.0:1786002696.814334:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34551d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+157:22233:x1872758531125376:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002696.814353:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002696.814374:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0a00/0x7cee4af578418140 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b517 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.814974:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af578418147 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.814988:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af578418147 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.814999:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af578418147 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002696.815010:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a6:0x0]: returning size 6 00010000:00010000:1.0:1786002696.815834:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0a00/0x7cee4af578418140 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b517 expref: 160 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.816701:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af578418147 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b517 expref: 159 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002696.816714:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9ed245644a00) 00010000:00010000:1.0:1786002696.816717:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002696.816721:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b0c00, rc 0) 00000100:00100000:1.0:1786002696.816908:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34551d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+159:22233:x1872758531125376:12345-192.168.203.49@tcp:101:bash.0 Request processed in 2574us (10255us total) trans 4294968807 rc 0/0 00000100:00100000:1.0:1786002696.816924:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24368 00000001:00080000:2.0:1786002696.822173:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968807 is committed 00010000:00010000:0.0:1786002696.822369:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841809f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822393:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841809f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822402:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841809f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822409:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002696.822414:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841809f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822422:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841809f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822442:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a2:0x0].0x0 (ffff9ed245644c00) 00010000:00010000:0.0:1786002696.822445:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002696.822450:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841809f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822456:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841809f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822488:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180ec lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822495:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180ec lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822501:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180ec lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822506:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002696.822509:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180ec lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822515:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180ec lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822525:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a3:0x0].0x0 (ffff9ed245644600) 00010000:00010000:0.0:1786002696.822527:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002696.822530:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180ec lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822536:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af5784180ec lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822550:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841810f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822555:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841810f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822560:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841810f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822565:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b1000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002696.822567:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841810f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822582:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841810f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822591:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a4:0x0].0x0 (ffff9ed2456f9a00) 00010000:00010000:0.0:1786002696.822594:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002696.822597:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841810f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822603:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af57841810f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822615:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822626:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822631:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822636:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002696.822639:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822645:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822652:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a5:0x0].0x0 (ffff9ed2456ae600) 00010000:00010000:0.0:1786002696.822665:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002696.822669:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.822675:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418132 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002696.835696:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.836182:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531125504 00000100:00100000:2.0:1786002696.836190:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531125504 00000100:00100000:2.0:1786002696.836249:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1582 00000100:00100000:2.0:1786002696.836258:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+55:2413:x1872758531125504:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002696.836272:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002696.836294:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af578418147 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b517 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002696.836310:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9ed245644a00) 00010000:00010000:2.0:1786002696.836315:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002696.836359:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+54:2413:x1872758531125504:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 102us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002696.836366:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1582 00000100:00100000:2.0:1786002696.844350:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002696.844417:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531125760 00000100:00100000:3.0:1786002696.844425:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531125760 00000100:00100000:3.0:1786002696.844485:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24369 00000100:00100000:3.0:1786002696.844494:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+54:22233:x1872758531125760:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:3.0:1786002696.844543:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002696.844566:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af57841753f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b16d expref: 54 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.844594:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9ed245644a00) 00010000:00010000:3.0:1786002696.844599:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002696.845541:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7200/0x7cee4af578418155 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.845555:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7200/0x7cee4af578418155 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.845565:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7200/0x7cee4af578418155 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002696.845615:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968808 00000004:00010000:3.0:1786002696.845638:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000240ca311 reply state 000000002b3cd711 transno 4294968809 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7200/0x7cee4af578418155 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.848109:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7200/0x7cee4af578418155 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.848122:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9ed245644a00) 00010000:00010000:3.0:1786002696.848125:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002696.848128:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002696.848237:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+56:22233:x1872758531125760:12345-192.168.203.49@tcp:36:bash.0 Request processed in 3741us (3892us total) trans 4294968809 rc 0/0 00000100:00100000:3.0:1786002696.848245:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24369 00000020:00080000:3.0:1786002696.848251:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002696.872946:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002696.873062:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531125888 00000100:00100000:0.0:1786002696.873071:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531125888 00000100:00100000:0.0:1786002696.873126:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24370 00000100:00100000:0.0:1786002696.873136:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+56:22233:x1872758531125888:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002696.873157:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002696.873175:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841815c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b51e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.873232:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841815c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b51e expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.873246:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34600/0x7cee4af57841815c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b51e expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002696.873263:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9ed245644a00) 00010000:00010000:0.0:1786002696.873266:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786002696.873270:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34600, rc 0) 00000100:00100000:0.0:1786002696.873323:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+57:22233:x1872758531125888:12345-192.168.203.49@tcp:101:bash.0 Request processed in 188us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002696.873331:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24370 00000100:00100000:2.0:1786002696.893152:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002696.893226:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531126016 00000100:00100000:3.0:1786002696.893236:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531126016 00002000:00010000:3.0:1786002696.893271:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/4 (0->18446744073709551615) 00002000:00100000:3.0:1786002696.893275:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5a8380 with x1872758531126016 ext(0->18446744073709551615) 00002000:00010000:3.0:1786002696.893287:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5a8380. 00000100:00100000:3.0:1786002696.893316:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 106 00000100:00100000:3.0:1786002696.893324:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531126016:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:3.0:1786002696.893558:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786002696.893562:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1786002696 00002000:00010000:3.0:1786002696.893564:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786002696.893567:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1786002696 00002000:00010000:3.0:1786002696.893570:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1786002696.893639:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2411:x1872758531126016:12345-192.168.203.49@tcp:10:bash.0 Request processed in 314us (494us total) trans 4294970024 rc 0/0 00000100:00100000:3.0:1786002696.893654:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 106 00002000:00010000:3.0:1786002696.893657:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/4 (0->18446744073709551615) 00002000:00100000:3.0:1786002696.893660:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5a8380 with x1872758531126016 ext(0->18446744073709551615) 00002000:00010000:3.0:1786002696.893665:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5a8380. 00000100:00100000:2.0:1786002696.917366:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002696.918739:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531126144 00000100:00100000:3.0:1786002696.918748:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531126144 00000100:00100000:3.0:1786002696.918811:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5438 00000100:00100000:3.0:1786002696.918821:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2410:x1872758531126144:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:0.0:1786002696.920336:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970024 is committed 00000100:00100000:3.0:1786002696.922902:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531126144:12345-192.168.203.49@tcp:16:bash.0 Request processed in 3280us (4742us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002696.923162:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5438 00000100:00100000:0.0:1786002696.927295:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002696.927394:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531126400 00000100:00100000:2.0:1786002696.927402:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531126400 00000100:00100000:2.0:1786002696.927451:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5319 00000100:00100000:2.0:1786002696.927460:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+57:22233:x1872758531126400:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1786002696.927662:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+58:22233:x1872758531126400:12345-192.168.203.49@tcp:35:bash.0 Request processed in 201us (371us total) trans 4294968810 rc 0/0 00000100:00100000:2.0:1786002696.927670:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5319 00000100:00100000:2.0:1786002696.966089:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002696.966212:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531126528 00000100:00100000:1.0:1786002696.966221:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531126528 00000100:00100000:1.0:1786002696.966276:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24371 00000100:00100000:1.0:1786002696.966285:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+58:22233:x1872758531126528:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:1.0:1786002696.966415:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+58:22233:x1872758531126528:12345-192.168.203.49@tcp:44:bash.0 Request processed in 131us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002696.966424:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24371 00000100:00100000:0.0:1786002696.993222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002696.993726:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531126784 00000100:00100000:3.0:1786002696.993736:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531126784 00000100:00100000:3.0:1786002696.993801:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24372 00000100:00100000:3.0:1786002696.993812:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+58:22233:x1872758531126784:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002696.993834:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002696.993889:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418163 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b525 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.993991:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841816a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.994004:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841816a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.994014:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841816a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002696.994024:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a7:0x0]: returning size 6 00010000:00010000:3.0:1786002696.994113:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418163 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b525 expref: 61 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.994129:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841816a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b525 expref: 60 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002696.994139:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9ed2456f9900) 00010000:00010000:3.0:1786002696.994142:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002696.994146:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca7800, rc 0) 00000100:00100000:3.0:1786002696.994201:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+60:22233:x1872758531126784:12345-192.168.203.49@tcp:101:bash.0 Request processed in 391us (987us total) trans 4294968811 rc 0/0 00000100:00100000:3.0:1786002696.994208:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24372 00000100:00100000:0.0:1786002697.019058:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.019181:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531126912 00000100:00100000:2.0:1786002697.019190:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531126912 00000100:00100000:2.0:1786002697.019261:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1583 00000100:00100000:2.0:1786002697.019271:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed347f57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+60:2411:x1872758531126912:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002697.019286:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002697.019307:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af57841816a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b525 expref: 60 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.019324:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9ed2456f9900) 00010000:00010000:2.0:1786002697.019329:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002697.019389:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed347f57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+59:2411:x1872758531126912:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 110us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.019396:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1583 00000100:00080000:0.0:1786002697.020834:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786002697.032742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.032951:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531127168 00000100:00100000:3.0:1786002697.032961:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531127168 00000100:00100000:3.0:1786002697.033015:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24373 00000100:00100000:3.0:1786002697.033025:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+59:22233:x1872758531127168:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:3.0:1786002697.033074:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002697.033107:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3400/0x7cee4af578417562 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b174 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.033125:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9ed2456f9900) 00010000:00010000:3.0:1786002697.033129:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002697.033272:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418178 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.033285:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418178 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.033295:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418178 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002697.033330:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968812 00000004:00010000:3.0:1786002697.033348:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006df4d197 reply state 00000000984f53f2 transno 4294968813 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418178 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.033359:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418178 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.033365:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9ed2456f9900) 00010000:00010000:3.0:1786002697.033369:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002697.033371:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002697.033463:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+61:22233:x1872758531127168:12345-192.168.203.49@tcp:36:bash.0 Request processed in 438us (728us total) trans 4294968813 rc 0/0 00000100:00100000:3.0:1786002697.034077:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24373 00000020:00080000:3.0:1786002697.034082:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002697.037176:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.045588:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531127296 00000100:00100000:2.0:1786002697.045602:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531127296 00000100:00100000:2.0:1786002697.045892:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24374 00000100:00100000:2.0:1786002697.045905:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+61:22233:x1872758531127296:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002697.045935:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002697.045955:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af57841817f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b52c expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.046008:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af57841817f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b52c expref: 62 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.046022:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ce00/0x7cee4af57841817f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b52c expref: 62 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.046040:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9ed2456f9900) 00010000:00010000:2.0:1786002697.046043:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786002697.046047:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2ce00, rc 0) 00000100:00100000:2.0:1786002697.046118:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+62:22233:x1872758531127296:12345-192.168.203.49@tcp:101:bash.0 Request processed in 215us (8947us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.046125:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24374 00000100:00100000:1.0:1786002697.065037:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.066027:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561087872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786002697.066075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002697.066151:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561087872 00000100:00100000:3.0:1786002697.066158:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561087872 00000100:00100000:3.0:1786002697.066200:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:3.0:1786002697.066209:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561087872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786002697.066234:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 189028032 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1786002697.066271:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561087872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002697.066278:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00080000:3.0:1786002697.066296:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002697.066326:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561087872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002697.068829:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed245c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561088000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002697.068888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002697.069009:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561088000 00000100:00100000:0.0:1786002697.069014:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561088000 00000100:00100000:0.0:1786002697.069055:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1786002697.069062:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561088000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1786002697.069075:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 189028032 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1786002697.069116:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561088000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002697.069123:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:1.0:1786002697.071605:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed245c43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561088000:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1786002697.071634:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786002697.074628:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531127424 00000100:00100000:2.0:1786002697.074639:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531127424 00002000:00010000:2.0:1786002697.086945:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1786002697.086955:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37bc52300 with x1872758531127424 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002697.086967:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37bc52300. 00000100:00100000:2.0:1786002697.087002:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 107 00000100:00100000:2.0:1786002697.087013:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531127424:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:2.0:1786002697.087261:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002697.087265:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1786002697 00002000:00010000:2.0:1786002697.087268:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002697.087270:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1786002697 00002000:00010000:2.0:1786002697.087272:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002697.087330:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531127424:12345-192.168.203.49@tcp:10:bash.0 Request processed in 319us (22299us total) trans 4294969987 rc 0/0 00000100:00100000:2.0:1786002697.087339:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 107 00002000:00010000:2.0:1786002697.087342:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1786002697.087345:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37bc52300 with x1872758531127424 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002697.087350:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37bc52300. 00000100:00100000:0.0:1786002697.111276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002697.112546:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531127552 00000100:00100000:1.0:1786002697.112556:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531127552 00000100:00100000:1.0:1786002697.112621:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5439 00000100:00100000:1.0:1786002697.112630:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531127552:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002697.125009:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969987 is committed 00000100:00100000:1.0:1786002697.126151:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531127552:12345-192.168.203.49@tcp:16:bash.0 Request processed in 13516us (14878us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002697.126164:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5439 00000100:00100000:3.0:1786002697.139521:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002697.139621:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531127808 00000100:00100000:1.0:1786002697.139632:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531127808 00000100:00100000:1.0:1786002697.139707:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5320 00000100:00100000:1.0:1786002697.139717:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+62:22233:x1872758531127808:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:1.0:1786002697.139970:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+63:22233:x1872758531127808:12345-192.168.203.49@tcp:35:bash.0 Request processed in 253us (457us total) trans 4294968814 rc 0/0 00000100:00100000:1.0:1786002697.139978:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5320 00000100:00100000:0.0:1786002697.154479:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.154588:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531127936 00000100:00100000:2.0:1786002697.154597:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531127936 00000100:00100000:2.0:1786002697.154658:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24375 00000100:00100000:2.0:1786002697.154668:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+63:22233:x1872758531127936:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:2.0:1786002697.154812:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+63:22233:x1872758531127936:12345-192.168.203.49@tcp:44:bash.0 Request processed in 145us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.154819:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24375 00000100:00100000:0.0:1786002697.169686:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002697.169772:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531128192 00000100:00100000:1.0:1786002697.169781:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531128192 00000100:00100000:1.0:1786002697.169837:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24376 00000100:00100000:1.0:1786002697.169870:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+63:22233:x1872758531128192:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002697.169893:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002697.169912:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0a00/0x7cee4af578418186 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b533 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.170036:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af57841818d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.170050:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af57841818d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.170061:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af57841818d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002697.170070:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a8:0x0]: returning size 6 00010000:00010000:1.0:1786002697.170181:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0a00/0x7cee4af578418186 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b533 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.170196:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af57841818d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b533 expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.170204:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9ed2456aef00) 00010000:00010000:1.0:1786002697.170207:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002697.170210:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1c00, rc 0) 00000100:00100000:1.0:1786002697.170255:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+65:22233:x1872758531128192:12345-192.168.203.49@tcp:101:bash.0 Request processed in 411us (578us total) trans 4294968815 rc 0/0 00000100:00100000:1.0:1786002697.170263:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24376 00000100:00100000:0.0:1786002697.178209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.178280:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531128320 00000100:00100000:2.0:1786002697.178288:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531128320 00000100:00100000:2.0:1786002697.178345:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1584 00000100:00100000:2.0:1786002697.178353:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+65:2412:x1872758531128320:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002697.178368:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002697.178391:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af57841818d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b533 expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.178406:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9ed2456aef00) 00010000:00010000:2.0:1786002697.178411:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002697.178463:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+64:2412:x1872758531128320:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.178470:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1584 00000100:00100000:0.0:1786002697.190157:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.190317:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531128576 00000100:00100000:2.0:1786002697.190328:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531128576 00000100:00100000:2.0:1786002697.190386:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24377 00000100:00100000:2.0:1786002697.190395:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+64:22233:x1872758531128576:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:2.0:1786002697.190445:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002697.190470:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af578417585 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b17b expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.190488:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9ed2456aef00) 00010000:00010000:2.0:1786002697.190493:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002697.190656:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af57841819b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.190670:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af57841819b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.190680:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af57841819b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002697.190716:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968816 00000004:00010000:2.0:1786002697.190733:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043860202 reply state 00000000b4321378 transno 4294968817 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af57841819b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.190744:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af57841819b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.190750:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9ed2456aef00) 00010000:00010000:2.0:1786002697.190753:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002697.190768:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002697.190886:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+66:22233:x1872758531128576:12345-192.168.203.49@tcp:36:bash.0 Request processed in 455us (701us total) trans 4294968817 rc 0/0 00000100:00100000:2.0:1786002697.190894:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24377 00000020:00080000:2.0:1786002697.190899:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002697.193450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.193834:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531128704 00000100:00100000:3.0:1786002697.193841:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531128704 00000100:00100000:1.0:1786002697.197987:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24378 00000100:00100000:1.0:1786002697.198008:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+66:22233:x1872758531128704:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002697.198034:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002697.198053:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0a00/0x7cee4af5784181a2 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b53a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.198112:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0a00/0x7cee4af5784181a2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b53a expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.198127:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0a00/0x7cee4af5784181a2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b53a expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.198144:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9ed2456aef00) 00010000:00010000:1.0:1786002697.198147:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786002697.198151:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b0a00, rc 0) 00000100:00100000:1.0:1786002697.198208:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+67:22233:x1872758531128704:12345-192.168.203.49@tcp:101:bash.0 Request processed in 210us (4763us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002697.198216:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24378 00010000:00010000:1.0:1786002697.202054:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002697.203733:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.203824:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531128832 00000100:00100000:2.0:1786002697.203833:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531128832 00002000:00010000:2.0:1786002697.203923:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/5 (0->18446744073709551615) 00002000:00100000:2.0:1786002697.203928:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f693100 with x1872758531128832 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002697.203938:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f693100. 00000100:00100000:2.0:1786002697.203978:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 108 00000100:00100000:2.0:1786002697.203988:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531128832:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:2.0:1786002697.204237:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002697.204240:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1786002697 00002000:00010000:2.0:1786002697.204243:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002697.204245:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1786002697 00002000:00010000:2.0:1786002697.204247:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002697.204292:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2413:x1872758531128832:12345-192.168.203.49@tcp:10:bash.0 Request processed in 305us (564us total) trans 4294970025 rc 0/0 00000100:00100000:2.0:1786002697.204300:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 108 00002000:00010000:2.0:1786002697.204303:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/5 (0->18446744073709551615) 00002000:00100000:2.0:1786002697.204306:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f693100 with x1872758531128832 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002697.204310:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f693100. 00000100:00080000:1.0:1786002697.204461:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002697.212434:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.212520:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531128960 00000100:00100000:0.0:1786002697.212530:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531128960 00000100:00100000:0.0:1786002697.212595:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5440 00000100:00100000:0.0:1786002697.212605:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2412:x1872758531128960:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002697.217599:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970025 is committed 00000100:00100000:0.0:1786002697.217774:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531128960:12345-192.168.203.49@tcp:16:bash.0 Request processed in 5164us (5342us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002697.217785:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5440 00000100:00100000:0.0:1786002697.221508:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002697.221663:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531129216 00000100:00100000:1.0:1786002697.221672:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531129216 00000100:00100000:1.0:1786002697.221726:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5321 00000100:00100000:1.0:1786002697.221736:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+67:22233:x1872758531129216:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:1.0:1786002697.222012:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+68:22233:x1872758531129216:12345-192.168.203.49@tcp:35:bash.0 Request processed in 277us (510us total) trans 4294968818 rc 0/0 00000100:00100000:1.0:1786002697.222020:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5321 00000100:00100000:3.0:1786002697.227454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.237550:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531129344 00000100:00100000:2.0:1786002697.237564:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531129344 00000100:00100000:2.0:1786002697.237634:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24379 00000100:00100000:2.0:1786002697.237644:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+68:22233:x1872758531129344:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:2.0:1786002697.238527:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+68:22233:x1872758531129344:12345-192.168.203.49@tcp:44:bash.0 Request processed in 883us (11773us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.238539:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24379 00000100:00100000:2.0:1786002697.272555:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.272688:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531129600 00000100:00100000:0.0:1786002697.272697:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531129600 00000100:00100000:0.0:1786002697.272761:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24380 00000100:00100000:0.0:1786002697.272772:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+68:22233:x1872758531129600:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002697.272791:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002697.272810:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784181a9 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b541 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.273028:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784181b0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.273043:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784181b0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.273055:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784181b0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002697.273066:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a9:0x0]: returning size 6 00010000:00010000:0.0:1786002697.273166:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784181a9 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b541 expref: 71 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.273184:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784181b0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b541 expref: 70 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.273193:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002697.273196:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002697.273200:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34200, rc 0) 00000100:00100000:0.0:1786002697.273255:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+70:22233:x1872758531129600:12345-192.168.203.49@tcp:101:bash.0 Request processed in 485us (709us total) trans 4294968819 rc 0/0 00000100:00100000:0.0:1786002697.273262:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24380 00000100:00100000:1.0:1786002697.276995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.277185:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531129728 00000100:00100000:2.0:1786002697.277192:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531129728 00000100:00100000:2.0:1786002697.277246:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1585 00000100:00100000:2.0:1786002697.277255:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+70:2410:x1872758531129728:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002697.277268:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002697.277286:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af5784181b0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b541 expref: 70 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.277302:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002697.277307:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002697.277346:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+69:2410:x1872758531129728:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 93us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.277353:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1585 00000100:00100000:3.0:1786002697.281752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002697.281963:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531129984 00000100:00100000:1.0:1786002697.281973:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531129984 00000100:00100000:1.0:1786002697.282021:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24381 00000100:00100000:1.0:1786002697.282030:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+69:22233:x1872758531129984:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:1.0:1786002697.282080:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002697.282114:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82e00/0x7cee4af5784175a8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b182 expref: 69 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.282131:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9ed245735700) 00010000:00010000:1.0:1786002697.282135:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002697.282290:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1e00/0x7cee4af5784181be lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.282304:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1e00/0x7cee4af5784181be lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.282313:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1e00/0x7cee4af5784181be lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002697.282348:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968820 00000004:00010000:1.0:1786002697.282366:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026cfcfa1 reply state 000000008bc49e44 transno 4294968821 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1e00/0x7cee4af5784181be lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.282390:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1e00/0x7cee4af5784181be lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.282397:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9ed245735700) 00010000:00010000:1.0:1786002697.282399:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002697.282402:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002697.283494:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+71:22233:x1872758531129984:12345-192.168.203.49@tcp:36:bash.0 Request processed in 1462us (1748us total) trans 4294968821 rc 0/0 00000100:00100000:1.0:1786002697.283501:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24381 00000020:00080000:1.0:1786002697.283507:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002697.297949:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.298065:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531130112 00000100:00100000:2.0:1786002697.298074:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531130112 00000100:00100000:2.0:1786002697.298140:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24382 00000100:00100000:2.0:1786002697.298151:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+71:22233:x1872758531130112:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002697.298172:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002697.298191:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c200/0x7cee4af5784181c5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b548 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.298240:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c200/0x7cee4af5784181c5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b548 expref: 72 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.298260:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c200/0x7cee4af5784181c5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b548 expref: 72 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.298277:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9ed245735700) 00010000:00010000:2.0:1786002697.298280:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786002697.298284:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2c200, rc 0) 00000100:00100000:2.0:1786002697.298337:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+72:22233:x1872758531130112:12345-192.168.203.49@tcp:101:bash.0 Request processed in 188us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.298344:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24382 00000100:00100000:2.0:1786002697.312246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.312324:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531130240 00000100:00100000:3.0:1786002697.312334:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531130240 00002000:00010000:3.0:1786002697.312369:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/6 (0->18446744073709551615) 00002000:00100000:3.0:1786002697.312373:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5a9880 with x1872758531130240 ext(0->18446744073709551615) 00002000:00010000:3.0:1786002697.312393:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed34b5a9880. 00000100:00100000:3.0:1786002697.312420:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 109 00000100:00100000:3.0:1786002697.312429:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531130240:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:3.0:1786002697.312667:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786002697.312671:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1786002697 00002000:00010000:3.0:1786002697.312673:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786002697.312676:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1786002697 00002000:00010000:3.0:1786002697.312678:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1786002697.312733:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531130240:12345-192.168.203.49@tcp:10:bash.0 Request processed in 304us (495us total) trans 4294969988 rc 0/0 00000100:00100000:3.0:1786002697.312741:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 109 00002000:00010000:3.0:1786002697.312744:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/6 (0->18446744073709551615) 00002000:00100000:3.0:1786002697.312747:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5a9880 with x1872758531130240 ext(0->18446744073709551615) 00002000:00010000:3.0:1786002697.312751:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed34b5a9880. 00000100:00100000:3.0:1786002697.333181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.333282:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531130368 00000100:00100000:0.0:1786002697.333291:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531130368 00000100:00100000:0.0:1786002697.333345:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5441 00000100:00100000:0.0:1786002697.333354:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531130368:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002697.340018:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969988 is committed 00000100:00100000:0.0:1786002697.340187:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2410:x1872758531130368:12345-192.168.203.49@tcp:16:bash.0 Request processed in 6828us (7009us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002697.340198:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5441 00000100:00100000:0.0:1786002697.356069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.356159:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531130624 00000100:00100000:2.0:1786002697.356168:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531130624 00000100:00100000:2.0:1786002697.356223:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5322 00000100:00100000:2.0:1786002697.356232:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+72:22233:x1872758531130624:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1786002697.356440:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:22233:x1872758531130624:12345-192.168.203.49@tcp:35:bash.0 Request processed in 207us (376us total) trans 4294968822 rc 0/0 00000100:00100000:2.0:1786002697.356448:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5322 00000100:00100000:2.0:1786002697.367593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002697.367690:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531130752 00000100:00100000:1.0:1786002697.367700:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531130752 00000100:00100000:1.0:1786002697.367764:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24383 00000100:00100000:1.0:1786002697.367775:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:22233:x1872758531130752:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:1.0:1786002697.367924:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:22233:x1872758531130752:12345-192.168.203.49@tcp:44:bash.0 Request processed in 150us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002697.367932:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24383 00000100:00100000:3.0:1786002697.376615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002697.379174:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531131008 00000100:00100000:1.0:1786002697.379186:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531131008 00000100:00100000:1.0:1786002697.379252:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24384 00000100:00100000:1.0:1786002697.379262:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+73:22233:x1872758531131008:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002697.379282:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002697.379302:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784181cc lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b54f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.379405:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af5784181d3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.379419:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af5784181d3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.379430:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af5784181d3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002697.379442:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1aa:0x0]: returning size 6 00010000:00010000:1.0:1786002697.379538:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784181cc lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b54f expref: 76 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.379560:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af5784181d3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b54f expref: 75 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.379578:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9ed2456f9200) 00010000:00010000:1.0:1786002697.379582:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002697.379585:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1c00, rc 0) 00000100:00100000:1.0:1786002697.379652:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+75:22233:x1872758531131008:12345-192.168.203.49@tcp:101:bash.0 Request processed in 385us (3038us total) trans 4294968823 rc 0/0 00000100:00100000:1.0:1786002697.379660:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24384 00000100:00100000:2.0:1786002697.385370:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002697.385874:0:10399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531131136 00000100:00100000:1.0:1786002697.385882:0:10399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531131136 00000100:00100000:1.0:1786002697.385941:0:10399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1586 00000100:00100000:1.0:1786002697.385951:0:10399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+75:2411:x1872758531131136:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002697.385964:0:10399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002697.385985:0:10399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af5784181d3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b54f expref: 75 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.386002:0:10399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9ed2456f9200) 00010000:00010000:1.0:1786002697.386007:0:10399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002697.386058:0:10399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+74:2411:x1872758531131136:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 108us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002697.386065:0:10399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1586 00000100:00100000:2.0:1786002697.394237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.394321:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531131392 00000100:00100000:0.0:1786002697.394330:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531131392 00000100:00100000:0.0:1786002697.394396:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24385 00000100:00100000:0.0:1786002697.394406:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+74:22233:x1872758531131392:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:0.0:1786002697.394476:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002697.394501:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2e00/0x7cee4af5784175cb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b189 expref: 74 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.394518:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9ed2456f9200) 00010000:00010000:0.0:1786002697.394522:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002697.394680:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784181e1 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.394694:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784181e1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.394704:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784181e1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002697.394741:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968824 00000004:00010000:0.0:1786002697.394760:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001ab4b5e reply state 00000000b0b7c05e transno 4294968825 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784181e1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.394772:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784181e1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.394778:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9ed2456f9200) 00010000:00010000:0.0:1786002697.394781:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002697.394783:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002697.394903:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+76:22233:x1872758531131392:12345-192.168.203.49@tcp:36:bash.0 Request processed in 497us (674us total) trans 4294968825 rc 0/0 00000100:00100000:0.0:1786002697.394919:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24385 00000020:00080000:0.0:1786002697.394924:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002697.402619:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.402801:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531131520 00000100:00100000:0.0:1786002697.402811:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531131520 00000100:00100000:0.0:1786002697.402888:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24386 00000100:00100000:0.0:1786002697.402897:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+76:22233:x1872758531131520:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002697.402928:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002697.402947:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784181e8 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b556 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.402996:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784181e8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b556 expref: 77 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.403010:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35200/0x7cee4af5784181e8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b556 expref: 77 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.403027:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9ed2456f9200) 00010000:00010000:0.0:1786002697.403030:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786002697.403034:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35200, rc 0) 00000100:00100000:0.0:1786002697.403076:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+77:22233:x1872758531131520:12345-192.168.203.49@tcp:101:bash.0 Request processed in 181us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002697.403083:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24386 00000100:00100000:3.0:1786002697.415187:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.415411:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531131648 00000100:00100000:2.0:1786002697.415428:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531131648 00002000:00010000:2.0:1786002697.415463:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/6 (0->18446744073709551615) 00002000:00100000:2.0:1786002697.415468:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f690700 with x1872758531131648 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002697.415478:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f690700. 00000100:00100000:2.0:1786002697.415506:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 110 00000100:00100000:2.0:1786002697.415514:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531131648:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:2.0:1786002697.415740:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002697.415744:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1786002697 00002000:00010000:2.0:1786002697.415747:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002697.415749:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1786002697 00002000:00010000:2.0:1786002697.415752:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002697.415809:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2412:x1872758531131648:12345-192.168.203.49@tcp:10:bash.0 Request processed in 294us (628us total) trans 4294970026 rc 0/0 00000100:00100000:2.0:1786002697.415817:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 110 00002000:00010000:2.0:1786002697.415820:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/6 (0->18446744073709551615) 00002000:00100000:2.0:1786002697.415823:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f690700 with x1872758531131648 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002697.415827:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f690700. 00000100:00100000:2.0:1786002697.433329:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.433516:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531131776 00000100:00100000:0.0:1786002697.433528:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531131776 00000100:00100000:0.0:1786002697.433595:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5442 00000100:00100000:0.0:1786002697.433605:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2413:x1872758531131776:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002697.445417:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970026 is committed 00000100:00100000:0.0:1786002697.446324:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531131776:12345-192.168.203.49@tcp:16:bash.0 Request processed in 12715us (12997us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002697.446335:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5442 00000100:00100000:0.0:1786002697.482876:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.482989:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531132032 00000100:00100000:3.0:1786002697.482998:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531132032 00000100:00100000:3.0:1786002697.483051:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5323 00000100:00100000:3.0:1786002697.483060:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+77:22233:x1872758531132032:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:3.0:1786002697.483262:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+78:22233:x1872758531132032:12345-192.168.203.49@tcp:35:bash.0 Request processed in 203us (425us total) trans 4294968826 rc 0/0 00000100:00100000:3.0:1786002697.483270:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5323 00000100:00100000:3.0:1786002697.491307:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.491406:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531132160 00000100:00100000:2.0:1786002697.491416:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531132160 00000100:00100000:2.0:1786002697.491486:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24387 00000100:00100000:2.0:1786002697.491498:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+78:22233:x1872758531132160:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:2.0:1786002697.491638:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+78:22233:x1872758531132160:12345-192.168.203.49@tcp:44:bash.0 Request processed in 142us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.491647:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24387 00000100:00100000:0.0:1786002697.500628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002697.500716:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531132416 00000100:00100000:1.0:1786002697.500725:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531132416 00000100:00100000:1.0:1786002697.500784:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24388 00000100:00100000:1.0:1786002697.500795:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+78:22233:x1872758531132416:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002697.500815:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002697.500835:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af5784181ef lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b55d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.500967:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784181f6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.500980:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784181f6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.500991:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784181f6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786002697.501000:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ab:0x0]: returning size 6 00010000:00010000:1.0:1786002697.501113:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af5784181ef lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b55d expref: 81 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.501131:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784181f6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b55d expref: 80 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.501139:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9ed2456ae200) 00010000:00010000:1.0:1786002697.501142:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786002697.501145:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b0200, rc 0) 00000100:00100000:1.0:1786002697.501202:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+80:22233:x1872758531132416:12345-192.168.203.49@tcp:101:bash.0 Request processed in 407us (583us total) trans 4294968827 rc 0/0 00000100:00100000:1.0:1786002697.501209:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24388 00000100:00100000:3.0:1786002697.514814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.515024:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531132544 00000100:00100000:2.0:1786002697.515034:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531132544 00000100:00100000:2.0:1786002697.515098:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1587 00000100:00100000:2.0:1786002697.515110:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+80:2412:x1872758531132544:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002697.515128:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002697.515152:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784181f6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b55d expref: 80 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.515171:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9ed2456ae200) 00010000:00010000:2.0:1786002697.515176:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002697.515232:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+79:2412:x1872758531132544:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 124us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.515240:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1587 00000100:00100000:3.0:1786002697.537460:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002697.537564:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531132800 00000100:00100000:1.0:1786002697.537583:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531132800 00000100:00100000:1.0:1786002697.537642:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24389 00000100:00100000:1.0:1786002697.537652:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+79:22233:x1872758531132800:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:1.0:1786002697.537705:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002697.537731:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784175ee lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b190 expref: 79 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.537753:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9ed2456ae200) 00010000:00010000:1.0:1786002697.537757:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002697.537990:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af578418204 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.538004:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af578418204 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.538014:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af578418204 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002697.538051:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968828 00000004:00010000:1.0:1786002697.538070:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c34c7db7 reply state 00000000aca28974 transno 4294968829 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af578418204 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.538081:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af578418204 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002697.538087:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9ed2456ae200) 00010000:00010000:1.0:1786002697.538089:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002697.538092:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002697.538169:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+81:22233:x1872758531132800:12345-192.168.203.49@tcp:36:bash.0 Request processed in 518us (717us total) trans 4294968829 rc 0/0 00000100:00100000:1.0:1786002697.538176:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24389 00000020:00080000:1.0:1786002697.538181:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002697.551895:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.552369:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531132928 00000100:00100000:2.0:1786002697.552377:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531132928 00000100:00100000:2.0:1786002697.552446:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24390 00000100:00100000:2.0:1786002697.552457:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+81:22233:x1872758531132928:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002697.552479:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002697.552499:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c400/0x7cee4af57841820b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b564 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.552555:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c400/0x7cee4af57841820b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b564 expref: 82 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.552580:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c400/0x7cee4af57841820b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b564 expref: 82 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.552602:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9ed2456ae200) 00010000:00010000:2.0:1786002697.552605:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786002697.552609:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2c400, rc 0) 00000100:00100000:2.0:1786002697.552669:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+82:22233:x1872758531132928:12345-192.168.203.49@tcp:101:bash.0 Request processed in 214us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.552676:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24390 00000100:00100000:0.0:1786002697.557536:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.557589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.557669:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531133056 00000100:00100000:3.0:1786002697.557676:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531133056 00000100:00100000:3.0:1786002697.557728:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 579 00000100:00100000:3.0:1786002697.557737:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531133056:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002697.557808:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531133056:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 72us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002697.557815:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 579 00000100:00100000:2.0:1786002697.558682:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531133184 00000100:00100000:2.0:1786002697.558686:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531133184 00000100:00100000:2.0:1786002697.558729:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1126 00000100:00100000:2.0:1786002697.558737:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2410:x1872758531133184:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002697.558794:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2410:x1872758531133184:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 57us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.558800:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1126 00000100:00100000:0.0:1786002697.573229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002697.582623:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37f550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561088128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002697.582691:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002697.582842:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561088128 00000100:00100000:3.0:1786002697.582873:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561088128 00000100:00100000:3.0:1786002697.582921:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4169 00000100:00100000:3.0:1786002697.582931:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561088128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1786002697.582963:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443897344 avail 1297657856 00000100:00100000:3.0:1786002697.583016:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561088128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002697.583022:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4169 00000100:00100000:1.0:1786002697.583096:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294984172 gen 2 00000004:00080000:1.0:1786002697.583102:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294984172 committed transno 4294984172 00000100:00100000:1.0:1786002697.583144:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37f550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561088128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1786002697.585868:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531133312 00000100:00100000:2.0:1786002697.585876:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531133312 00002000:00010000:2.0:1786002697.585905:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/7 (0->18446744073709551615) 00002000:00100000:2.0:1786002697.585918:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f552d80 with x1872758531133312 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002697.585929:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f552d80. 00000100:00100000:2.0:1786002697.586046:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 111 00000100:00100000:2.0:1786002697.586055:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531133312:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:2.0:1786002697.586267:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002697.586271:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1786002697 00002000:00010000:2.0:1786002697.586274:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002697.586276:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1786002697 00002000:00010000:2.0:1786002697.586279:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002697.586374:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531133312:12345-192.168.203.49@tcp:10:bash.0 Request processed in 319us (13153us total) trans 4294969989 rc 0/0 00000100:00100000:2.0:1786002697.586394:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 111 00002000:00010000:2.0:1786002697.586398:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/7 (0->18446744073709551615) 00002000:00100000:2.0:1786002697.586400:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f552d80 with x1872758531133312 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002697.586405:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f552d80. 00000100:00100000:0.0:1786002697.602114:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.602494:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531133440 00000100:00100000:3.0:1786002697.602504:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531133440 00000100:00100000:3.0:1786002697.602561:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5443 00000100:00100000:3.0:1786002697.602581:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531133440:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:0.0:1786002697.604021:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969989 is committed 00000100:00100000:3.0:1786002697.604314:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2411:x1872758531133440:12345-192.168.203.49@tcp:16:bash.0 Request processed in 1743us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002697.604322:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5443 00000100:00100000:1.0:1786002697.613827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.617528:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531133696 00000100:00100000:0.0:1786002697.617540:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531133696 00000100:00100000:0.0:1786002697.617614:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5324 00000100:00100000:0.0:1786002697.617624:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+82:22233:x1872758531133696:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:0.0:1786002697.617878:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+83:22233:x1872758531133696:12345-192.168.203.49@tcp:35:bash.0 Request processed in 254us (4058us total) trans 4294968830 rc 0/0 00000100:00100000:0.0:1786002697.617887:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5324 00000100:00100000:2.0:1786002697.623092:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.623182:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531133824 00000100:00100000:3.0:1786002697.623193:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531133824 00000100:00100000:3.0:1786002697.623246:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24391 00000100:00100000:3.0:1786002697.623257:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+83:22233:x1872758531133824:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:3.0:1786002697.623395:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+83:22233:x1872758531133824:12345-192.168.203.49@tcp:44:bash.0 Request processed in 139us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002697.623402:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24391 00000100:00100000:1.0:1786002697.635494:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.635598:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531134080 00000100:00100000:2.0:1786002697.635608:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531134080 00000100:00100000:2.0:1786002697.635678:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24392 00000100:00100000:2.0:1786002697.635689:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+83:22233:x1872758531134080:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002697.635709:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002697.635729:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578418212 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b56b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.635837:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af578418219 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.635883:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af578418219 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.635893:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af578418219 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002697.635903:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ac:0x0]: returning size 7 00010000:00010000:2.0:1786002697.636013:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af578418212 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b56b expref: 86 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.636030:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af578418219 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b56b expref: 85 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.636037:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9ed243d0bd00) 00010000:00010000:2.0:1786002697.636040:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002697.636043:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2c800, rc 0) 00000100:00100000:2.0:1786002697.636103:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+85:22233:x1872758531134080:12345-192.168.203.49@tcp:101:bash.0 Request processed in 416us (618us total) trans 4294968831 rc 0/0 00000100:00100000:2.0:1786002697.636111:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24392 00000100:00100000:1.0:1786002697.649728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.649949:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531134336 00000100:00100000:3.0:1786002697.649959:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531134336 00000100:00100000:3.0:1786002697.650008:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24393 00000100:00100000:3.0:1786002697.650017:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+85:22233:x1872758531134336:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:3.0:1786002697.650066:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786002697.650089:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af578418219 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b56b expref: 85 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.650110:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed3000/0x7cee4af578417611 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b197 expref: 84 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.650124:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9ed243d0bd00) 00010000:00010000:3.0:1786002697.650130:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002697.650268:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af578418227 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.650282:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af578418227 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.650292:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af578418227 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002697.650326:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968832 00000004:00010000:3.0:1786002697.650343:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005915e0e9 reply state 00000000c8dd64d4 transno 4294968833 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af578418227 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.650360:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af578418227 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.650367:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9ed243d0bd00) 00010000:00010000:3.0:1786002697.650370:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002697.650372:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002697.650459:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+86:22233:x1872758531134336:12345-192.168.203.49@tcp:36:bash.0 Request processed in 442us (738us total) trans 4294968833 rc 0/0 00000100:00100000:3.0:1786002697.650466:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24393 00000020:00080000:3.0:1786002697.650471:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002697.659552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.659634:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531134464 00000100:00100000:2.0:1786002697.659650:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531134464 00000100:00100000:2.0:1786002697.659706:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24394 00000100:00100000:2.0:1786002697.659716:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+86:22233:x1872758531134464:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002697.659736:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002697.659762:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af57841822e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b572 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.659812:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af57841822e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b572 expref: 87 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.659826:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d400/0x7cee4af57841822e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b572 expref: 87 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.659843:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9ed243d0bd00) 00010000:00010000:2.0:1786002697.659872:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786002697.659876:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2d400, rc 0) 00000100:00100000:2.0:1786002697.659921:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+87:22233:x1872758531134464:12345-192.168.203.49@tcp:101:bash.0 Request processed in 207us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.659928:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24394 00000100:00100000:1.0:1786002697.663736:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.673540:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531134592 00000100:00100000:3.0:1786002697.673552:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531134592 00002000:00010000:0.0:1786002697.673694:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/7 (0->18446744073709551615) 00002000:00100000:0.0:1786002697.673700:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37bc50e00 with x1872758531134592 ext(0->18446744073709551615) 00002000:00010000:0.0:1786002697.673712:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37bc50e00. 00000100:00100000:0.0:1786002697.673750:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 112 00000100:00100000:0.0:1786002697.673767:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531134592:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:0.0:1786002697.674170:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786002697.674175:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb mtime from disk: 0 -> 1786002697 00002000:00010000:0.0:1786002697.674177:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786002697.674180:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb ctime from disk: 0 -> 1786002697 00002000:00010000:0.0:1786002697.674182:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1786002697.674235:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2410:x1872758531134592:12345-192.168.203.49@tcp:10:bash.0 Request processed in 476us (10505us total) trans 4294970027 rc 0/0 00000100:00100000:0.0:1786002697.674247:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 112 00002000:00010000:0.0:1786002697.674250:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/7 (0->18446744073709551615) 00002000:00100000:0.0:1786002697.674253:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37bc50e00 with x1872758531134592 ext(0->18446744073709551615) 00002000:00010000:0.0:1786002697.674257:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37bc50e00. 00000100:00100000:0.0:1786002697.678796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.678914:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531134720 00000100:00100000:3.0:1786002697.678923:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531134720 00000100:00100000:3.0:1786002697.678981:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5444 00000100:00100000:3.0:1786002697.678990:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2413:x1872758531134720:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002697.695306:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970027 is committed 00000100:00100000:2.0:1786002697.696962:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531134720:12345-192.168.203.49@tcp:16:bash.0 Request processed in 17967us (18169us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.696974:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5444 00000100:00100000:1.0:1786002697.704679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.704769:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531134976 00000100:00100000:2.0:1786002697.704778:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531134976 00000100:00100000:2.0:1786002697.704835:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5325 00000100:00100000:2.0:1786002697.704874:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+87:22233:x1872758531134976:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1786002697.705081:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+88:22233:x1872758531134976:12345-192.168.203.49@tcp:35:bash.0 Request processed in 237us (409us total) trans 4294968834 rc 0/0 00000100:00100000:2.0:1786002697.705824:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5325 00000100:00100000:1.0:1786002697.711304:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.711384:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531135104 00000100:00100000:0.0:1786002697.711392:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531135104 00000100:00100000:0.0:1786002697.711458:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24395 00000100:00100000:0.0:1786002697.711468:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+88:22233:x1872758531135104:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:0.0:1786002697.711603:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+88:22233:x1872758531135104:12345-192.168.203.49@tcp:44:bash.0 Request processed in 137us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002697.711610:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24395 00000100:00100000:1.0:1786002697.719792:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.720992:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531135360 00000100:00100000:0.0:1786002697.721002:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531135360 00000100:00100000:0.0:1786002697.721061:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24396 00000100:00100000:0.0:1786002697.721069:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+88:22233:x1872758531135360:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002697.721087:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002697.721114:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578418235 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b579 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.721212:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841823c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.721226:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841823c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.721236:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841823c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002697.721245:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ad:0x0]: returning size 7 00010000:00010000:0.0:1786002697.721332:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578418235 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b579 expref: 91 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.721349:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841823c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b579 expref: 90 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.721357:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9ed245735600) 00010000:00010000:0.0:1786002697.721360:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002697.721363:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34000, rc 0) 00000100:00100000:0.0:1786002697.721417:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+90:22233:x1872758531135360:12345-192.168.203.49@tcp:101:bash.0 Request processed in 348us (1634us total) trans 4294968835 rc 0/0 00000100:00100000:0.0:1786002697.721537:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24396 00000100:00100000:1.0:1786002697.730228:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.730472:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531135616 00000100:00100000:2.0:1786002697.730481:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531135616 00000100:00100000:2.0:1786002697.730531:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24397 00000100:00100000:2.0:1786002697.730540:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+90:22233:x1872758531135616:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:2.0:1786002697.730597:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786002697.730620:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841823c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b579 expref: 90 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.730636:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82a00/0x7cee4af578417634 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b19e expref: 89 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.730646:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9ed245735600) 00010000:00010000:2.0:1786002697.730651:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002697.730813:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af57841824a lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.730825:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af57841824a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.730832:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af57841824a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002697.730887:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968836 00000004:00010000:2.0:1786002697.730904:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d051ca2 reply state 000000009da3c3e7 transno 4294968837 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af57841824a lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.730923:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af57841824a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.730928:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9ed245735600) 00010000:00010000:2.0:1786002697.730931:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002697.730933:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002697.731006:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+91:22233:x1872758531135616:12345-192.168.203.49@tcp:36:bash.0 Request processed in 466us (786us total) trans 4294968837 rc 0/0 00000100:00100000:2.0:1786002697.731012:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24397 00000020:00080000:2.0:1786002697.731016:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002697.747497:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.747599:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531135744 00000100:00100000:3.0:1786002697.747607:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531135744 00000100:00100000:3.0:1786002697.747661:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24398 00000100:00100000:3.0:1786002697.747670:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+91:22233:x1872758531135744:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002697.747691:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002697.747708:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578418251 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b580 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.747757:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578418251 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ad:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b580 expref: 92 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.747776:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6800/0x7cee4af578418251 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ad:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b580 expref: 92 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.747792:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9ed245735600) 00010000:00010000:3.0:1786002697.747795:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786002697.747798:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca6800, rc 0) 00000100:00100000:3.0:1786002697.747877:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+92:22233:x1872758531135744:12345-192.168.203.49@tcp:101:bash.0 Request processed in 180us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002697.747883:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24398 00000100:00100000:1.0:1786002697.774950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.775057:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531135872 00000100:00100000:2.0:1786002697.775066:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531135872 00002000:00010000:2.0:1786002697.775111:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:2.0:1786002697.775116:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed243dd4a80 with x1872758531135872 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002697.775126:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed243dd4a80. 00000100:00100000:2.0:1786002697.775154:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 113 00000100:00100000:2.0:1786002697.775163:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531135872:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:2.0:1786002697.775378:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002697.775381:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1786002697 00002000:00010000:2.0:1786002697.775384:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002697.775386:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1786002697 00002000:00010000:2.0:1786002697.775388:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002697.775451:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531135872:12345-192.168.203.49@tcp:10:bash.0 Request processed in 288us (507us total) trans 4294969990 rc 0/0 00000100:00100000:2.0:1786002697.775459:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 113 00002000:00010000:2.0:1786002697.775462:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/8 (0->18446744073709551615) 00002000:00100000:2.0:1786002697.775464:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed243dd4a80 with x1872758531135872 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002697.775468:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed243dd4a80. 00000100:00100000:1.0:1786002697.782540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.782632:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531136000 00000100:00100000:3.0:1786002697.782641:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531136000 00000100:00100000:3.0:1786002697.782698:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5445 00000100:00100000:3.0:1786002697.782708:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531136000:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:0.0:1786002697.784338:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969990 is committed 00000100:00100000:3.0:1786002697.784468:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531136000:12345-192.168.203.49@tcp:16:bash.0 Request processed in 1758us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002697.784477:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5445 00000100:00100000:1.0:1786002697.794141:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.794251:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531136256 00000100:00100000:3.0:1786002697.794260:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531136256 00000100:00100000:3.0:1786002697.794313:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5326 00000100:00100000:3.0:1786002697.794322:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36aef4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+92:22233:x1872758531136256:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:3.0:1786002697.794524:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36aef4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+93:22233:x1872758531136256:12345-192.168.203.49@tcp:35:bash.0 Request processed in 202us (391us total) trans 4294968838 rc 0/0 00000100:00100000:3.0:1786002697.794531:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5326 00000100:00100000:1.0:1786002697.813634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.813743:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531136384 00000100:00100000:2.0:1786002697.813752:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531136384 00000100:00100000:2.0:1786002697.813809:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24399 00000100:00100000:2.0:1786002697.813819:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+93:22233:x1872758531136384:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:2.0:1786002697.813963:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+93:22233:x1872758531136384:12345-192.168.203.49@tcp:44:bash.0 Request processed in 146us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.813970:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24399 00000100:00100000:1.0:1786002697.830486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.830606:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531136640 00000100:00100000:0.0:1786002697.830615:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531136640 00000100:00100000:0.0:1786002697.830672:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24400 00000100:00100000:0.0:1786002697.830682:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+93:22233:x1872758531136640:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002697.830702:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002697.830723:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578418258 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b587 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.830826:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841825f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.830840:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841825f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.830888:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841825f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002697.830899:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1ae:0x0]: returning size 7 00010000:00010000:0.0:1786002697.831013:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af578418258 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b587 expref: 96 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.831030:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841825f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b587 expref: 95 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.831039:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9ed245735500) 00010000:00010000:0.0:1786002697.831042:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002697.831045:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34000, rc 0) 00000100:00100000:0.0:1786002697.831089:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+95:22233:x1872758531136640:12345-192.168.203.49@tcp:101:bash.0 Request processed in 408us (611us total) trans 4294968839 rc 0/0 00000100:00100000:0.0:1786002697.831108:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24400 00000100:00100000:0.0:1786002697.836464:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.836542:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531136768 00000100:00100000:3.0:1786002697.836551:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531136768 00000100:00100000:3.0:1786002697.836612:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1588 00000100:00100000:3.0:1786002697.836622:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+95:2412:x1872758531136768:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002697.836636:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002697.836661:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af57841825f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b587 expref: 95 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.836678:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9ed245735500) 00010000:00010000:3.0:1786002697.836683:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002697.836739:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+94:2412:x1872758531136768:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 118us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002697.836746:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1588 00000100:00100000:1.0:1786002697.851441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.851580:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531137024 00000100:00100000:0.0:1786002697.851590:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531137024 00000100:00100000:0.0:1786002697.851652:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24401 00000100:00100000:0.0:1786002697.851663:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+94:22233:x1872758531137024:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:0.0:1786002697.851719:0:14496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786002697.851745:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f82600/0x7cee4af578417657 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1a5 expref: 94 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.851764:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9ed245735500) 00010000:00010000:0.0:1786002697.851770:0:14496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002697.852017:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af57841826d lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.852031:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af57841826d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.852041:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af57841826d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002697.852078:0:14496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968840 00000004:00010000:0.0:1786002697.852108:0:14496:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f0bebde reply state 00000000854f24aa transno 4294968841 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af57841826d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.852120:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af57841826d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.852125:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9ed245735500) 00010000:00010000:0.0:1786002697.852128:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002697.852130:0:14496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002697.852204:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+96:22233:x1872758531137024:12345-192.168.203.49@tcp:36:bash.0 Request processed in 542us (771us total) trans 4294968841 rc 0/0 00000100:00100000:0.0:1786002697.852211:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24401 00000020:00080000:0.0:1786002697.852216:0:14496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002697.868690:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.868757:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531137152 00000100:00100000:2.0:1786002697.868766:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531137152 00000100:00100000:2.0:1786002697.868823:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24402 00000100:00100000:2.0:1786002697.868832:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+96:22233:x1872758531137152:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002697.868878:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002697.868897:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578418274 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b58e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.868957:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578418274 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b58e expref: 97 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.868971:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d000/0x7cee4af578418274 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1ae:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b58e expref: 97 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.868988:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9ed245735500) 00010000:00010000:2.0:1786002697.868992:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786002697.868995:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2d000, rc 0) 00000100:00100000:2.0:1786002697.869047:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+97:22233:x1872758531137152:12345-192.168.203.49@tcp:101:bash.0 Request processed in 216us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002697.869053:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24402 00000100:00100000:1.0:1786002697.872795:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.873021:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531137280 00000100:00100000:3.0:1786002697.873029:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531137280 00002000:00010000:3.0:1786002697.873062:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/8 (0->18446744073709551615) 00002000:00100000:3.0:1786002697.873067:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed243dd4700 with x1872758531137280 ext(0->18446744073709551615) 00002000:00010000:3.0:1786002697.873078:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed243dd4700. 00000100:00100000:3.0:1786002697.873111:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 114 00000100:00100000:3.0:1786002697.873119:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531137280:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:3.0:1786002697.873342:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786002697.873346:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb mtime from disk: 0 -> 1786002697 00002000:00010000:3.0:1786002697.873349:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786002697.873352:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb ctime from disk: 0 -> 1786002697 00002000:00010000:3.0:1786002697.873354:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1786002697.873408:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2413:x1872758531137280:12345-192.168.203.49@tcp:10:bash.0 Request processed in 288us (619us total) trans 4294970028 rc 0/0 00000100:00100000:3.0:1786002697.873419:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 114 00002000:00010000:3.0:1786002697.873423:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/8 (0->18446744073709551615) 00002000:00100000:3.0:1786002697.873426:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed243dd4700 with x1872758531137280 ext(0->18446744073709551615) 00002000:00010000:3.0:1786002697.873430:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed243dd4700. 00000100:00100000:1.0:1786002697.892254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.892336:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531137408 00000100:00100000:0.0:1786002697.892345:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531137408 00000100:00100000:0.0:1786002697.892398:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5446 00000100:00100000:0.0:1786002697.892408:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2412:x1872758531137408:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002697.894331:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970028 is committed 00000100:00100000:0.0:1786002697.894474:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531137408:12345-192.168.203.49@tcp:16:bash.0 Request processed in 2064us (2225us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002697.894484:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5446 00000100:00100000:1.0:1786002697.896828:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.896948:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531137664 00000100:00100000:2.0:1786002697.896955:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531137664 00000100:00100000:2.0:1786002697.896999:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5327 00000100:00100000:2.0:1786002697.897008:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+97:22233:x1872758531137664:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1786002697.911084:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+98:22233:x1872758531137664:12345-192.168.203.49@tcp:35:bash.0 Request processed in 14065us (14247us total) trans 4294968842 rc 0/0 00000100:00100000:2.0:1786002697.911107:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5327 00000100:00100000:1.0:1786002697.915639:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.915714:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531137792 00000100:00100000:3.0:1786002697.915723:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531137792 00000100:00100000:3.0:1786002697.915778:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24403 00000100:00100000:3.0:1786002697.915789:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+98:22233:x1872758531137792:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:3.0:1786002697.915948:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+98:22233:x1872758531137792:12345-192.168.203.49@tcp:44:bash.0 Request processed in 160us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002697.915955:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24403 00000100:00100000:1.0:1786002697.924735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002697.924814:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531138048 00000100:00100000:2.0:1786002697.924824:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531138048 00000100:00100000:2.0:1786002697.924900:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24404 00000100:00100000:2.0:1786002697.924919:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+98:22233:x1872758531138048:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002697.924938:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002697.924956:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af57841827b lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b595 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.925051:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af578418282 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.925064:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af578418282 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.925076:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af578418282 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002697.925102:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1af:0x0]: returning size 7 00010000:00010000:2.0:1786002697.925192:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af57841827b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b595 expref: 101 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.925208:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af578418282 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b595 expref: 100 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002697.925216:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1af:0x0].0x0 (ffff9ed2456f9100) 00010000:00010000:2.0:1786002697.925219:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002697.925222:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2cc00, rc 0) 00000100:00100000:2.0:1786002697.925267:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+100:22233:x1872758531138048:12345-192.168.203.49@tcp:101:bash.0 Request processed in 351us (542us total) trans 4294968843 rc 0/0 00000100:00100000:2.0:1786002697.925274:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24404 00000100:00100000:1.0:1786002697.940221:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.940351:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531138304 00000100:00100000:0.0:1786002697.940360:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531138304 00000100:00100000:0.0:1786002697.940428:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24405 00000100:00100000:0.0:1786002697.940440:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+100:22233:x1872758531138304:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:0.0:1786002697.940504:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786002697.940529:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af578418282 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b595 expref: 100 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.940549:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ed2200/0x7cee4af57841767a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1ac expref: 99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.940560:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1af:0x0].0x0 (ffff9ed2456f9100) 00010000:00010000:0.0:1786002697.940574:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002697.940732:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578418290 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.940746:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578418290 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.940755:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578418290 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002697.940794:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968844 00000004:00010000:0.0:1786002697.940815:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000510d3fa9 reply state 000000004c64e3ae transno 4294968845 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578418290 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.940826:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578418290 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002697.940833:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1af:0x0].0x0 (ffff9ed2456f9100) 00010000:00010000:0.0:1786002697.940836:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002697.940839:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002697.940973:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+101:22233:x1872758531138304:12345-192.168.203.49@tcp:36:bash.0 Request processed in 534us (760us total) trans 4294968845 rc 0/0 00000100:00100000:0.0:1786002697.940980:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24405 00000020:00080000:0.0:1786002697.940985:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002697.946989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002697.947072:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531138432 00000100:00100000:3.0:1786002697.947081:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531138432 00000100:00100000:3.0:1786002697.947151:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24406 00000100:00100000:3.0:1786002697.947160:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+101:22233:x1872758531138432:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002697.947182:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002697.947203:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578418297 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b59c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.947255:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578418297 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b59c expref: 102 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.947269:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6e00/0x7cee4af578418297 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b59c expref: 102 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002697.947291:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1af:0x0].0x0 (ffff9ed2456f9100) 00010000:00010000:3.0:1786002697.947294:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786002697.947298:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca6e00, rc 0) 00000100:00100000:3.0:1786002697.947357:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+102:22233:x1872758531138432:12345-192.168.203.49@tcp:101:bash.0 Request processed in 197us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002697.947363:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24406 00000100:00100000:1.0:1786002697.979190:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002697.979363:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531138560 00000100:00100000:0.0:1786002697.979373:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531138560 00002000:00010000:0.0:1786002697.979408:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/9 (0->18446744073709551615) 00002000:00100000:0.0:1786002697.979413:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed243dd5180 with x1872758531138560 ext(0->18446744073709551615) 00002000:00010000:0.0:1786002697.979434:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed243dd5180. 00000100:00100000:0.0:1786002697.979463:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 115 00000100:00100000:0.0:1786002697.979481:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531138560:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:0.0:1786002697.979723:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786002697.979726:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1786002697 00002000:00010000:0.0:1786002697.979728:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786002697.979730:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1786002697 00002000:00010000:0.0:1786002697.979732:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1786002697.979791:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531138560:12345-192.168.203.49@tcp:10:bash.0 Request processed in 312us (611us total) trans 4294969991 rc 0/0 00000100:00100000:0.0:1786002697.979797:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 115 00002000:00010000:0.0:1786002697.979800:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/9 (0->18446744073709551615) 00002000:00100000:0.0:1786002697.979803:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed243dd5180 with x1872758531138560 ext(0->18446744073709551615) 00002000:00010000:0.0:1786002697.979807:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed243dd5180. 00000100:00100000:1.0:1786002698.008885:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002698.009009:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531138688 00000100:00100000:0.0:1786002698.009017:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531138688 00000100:00100000:0.0:1786002698.009081:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5447 00000100:00100000:0.0:1786002698.009097:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531138688:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002698.010694:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969991 is committed 00000100:00080000:1.0:1786002698.010760:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002698.011648:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531138688:12345-192.168.203.49@tcp:16:bash.0 Request processed in 2555us (2804us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002698.011657:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5447 00000100:00100000:1.0:1786002698.034978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002698.035114:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531138944 00000100:00100000:0.0:1786002698.035123:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531138944 00000100:00100000:0.0:1786002698.035181:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5328 00000100:00100000:0.0:1786002698.035192:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+102:22233:x1872758531138944:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:0.0:1786002698.035402:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+103:22233:x1872758531138944:12345-192.168.203.49@tcp:35:bash.0 Request processed in 210us (429us total) trans 4294968846 rc 0/0 00000100:00100000:0.0:1786002698.035410:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5328 00000100:00100000:1.0:1786002698.044454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.046188:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531139072 00000100:00100000:2.0:1786002698.046198:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531139072 00000100:00100000:2.0:1786002698.046265:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24407 00000100:00100000:2.0:1786002698.046275:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed243dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+103:22233:x1872758531139072:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:2.0:1786002698.046402:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed243dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+103:22233:x1872758531139072:12345-192.168.203.49@tcp:44:bash.0 Request processed in 128us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.046410:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24407 00000100:00100000:1.0:1786002698.052685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.053316:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531139328 00000100:00100000:3.0:1786002698.053324:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531139328 00000100:00100000:3.0:1786002698.053381:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24408 00000100:00100000:3.0:1786002698.053390:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+103:22233:x1872758531139328:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002698.053409:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002698.053429:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841829e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5a3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.053528:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af5784182a5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.053542:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af5784182a5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.053553:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af5784182a5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002698.053563:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b0:0x0]: returning size 7 00010000:00010000:3.0:1786002698.053666:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841829e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5a3 expref: 106 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.053688:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af5784182a5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5a3 expref: 105 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.053697:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b0:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:3.0:1786002698.053700:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002698.053703:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca6a00, rc 0) 00000100:00100000:3.0:1786002698.053757:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+105:22233:x1872758531139328:12345-192.168.203.49@tcp:101:bash.0 Request processed in 368us (1081us total) trans 4294968847 rc 0/0 00000100:00100000:3.0:1786002698.053764:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24408 00000100:00100000:1.0:1786002698.064930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.065113:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531139584 00000100:00100000:2.0:1786002698.065123:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531139584 00000100:00100000:2.0:1786002698.065189:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24409 00000100:00100000:2.0:1786002698.065199:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+105:22233:x1872758531139584:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:2.0:1786002698.065254:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786002698.065281:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af5784182a5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5a3 expref: 105 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.065302:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83400/0x7cee4af57841769d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1b3 expref: 104 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.065312:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b0:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:2.0:1786002698.065317:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002698.065496:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784182b3 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.065510:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784182b3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.065518:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784182b3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002698.065558:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968848 00000004:00010000:2.0:1786002698.065591:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7dec961 reply state 00000000a8204a7c transno 4294968849 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784182b3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.065603:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784182b3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.065609:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b0:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:2.0:1786002698.065612:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002698.065614:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002698.065713:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+106:22233:x1872758531139584:12345-192.168.203.49@tcp:36:bash.0 Request processed in 515us (793us total) trans 4294968849 rc 0/0 00000100:00100000:2.0:1786002698.065719:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24409 00000020:00080000:2.0:1786002698.065724:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002698.089997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002698.090146:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531139712 00000100:00100000:0.0:1786002698.090156:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531139712 00000100:00100000:0.0:1786002698.090217:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24410 00000100:00100000:0.0:1786002698.090227:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+106:22233:x1872758531139712:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002698.090247:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002698.090265:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784182ba lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5aa expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.090320:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784182ba lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5aa expref: 107 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.090333:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34c00/0x7cee4af5784182ba lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5aa expref: 107 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.090356:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b0:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:0.0:1786002698.090359:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786002698.090362:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34c00, rc 0) 00000100:00100000:0.0:1786002698.090419:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+107:22233:x1872758531139712:12345-192.168.203.49@tcp:101:bash.0 Request processed in 193us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002698.090426:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24410 00000100:00100000:3.0:1786002698.098035:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.098304:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531139840 00000100:00100000:2.0:1786002698.098314:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531139840 00002000:00010000:2.0:1786002698.098358:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/9 (0->18446744073709551615) 00002000:00100000:2.0:1786002698.098363:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f693480 with x1872758531139840 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002698.098385:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f693480. 00000100:00100000:2.0:1786002698.098417:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 116 00000100:00100000:2.0:1786002698.098427:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531139840:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:2.0:1786002698.099033:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002698.099036:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb mtime from disk: 0 -> 1786002698 00002000:00010000:2.0:1786002698.099039:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002698.099042:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb ctime from disk: 0 -> 1786002698 00002000:00010000:2.0:1786002698.099044:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002698.099100:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2411:x1872758531139840:12345-192.168.203.49@tcp:10:bash.0 Request processed in 673us (1073us total) trans 4294970029 rc 0/0 00000100:00100000:2.0:1786002698.099107:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 116 00002000:00010000:2.0:1786002698.099111:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/9 (0->18446744073709551615) 00002000:00100000:2.0:1786002698.099114:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f693480 with x1872758531139840 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002698.099118:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed37f693480. 00000100:00100000:1.0:1786002698.115267:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002698.115473:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531139968 00000100:00100000:0.0:1786002698.115482:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531139968 00000100:00100000:0.0:1786002698.115538:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5448 00000100:00100000:0.0:1786002698.115548:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2410:x1872758531139968:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:1.0:1786002698.119138:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970029 is committed 00000100:00100000:0.0:1786002698.123132:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531139968:12345-192.168.203.49@tcp:16:bash.0 Request processed in 7576us (7863us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002698.123145:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5448 00000100:00100000:1.0:1786002698.139762:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.140813:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531140224 00000100:00100000:2.0:1786002698.140823:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531140224 00000100:00100000:2.0:1786002698.140917:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5329 00000100:00100000:2.0:1786002698.140928:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+107:22233:x1872758531140224:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1786002698.141290:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+108:22233:x1872758531140224:12345-192.168.203.49@tcp:35:bash.0 Request processed in 363us (1536us total) trans 4294968850 rc 0/0 00000100:00100000:2.0:1786002698.141298:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5329 00000100:00100000:3.0:1786002698.157061:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002698.157212:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531140352 00000100:00100000:0.0:1786002698.157222:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531140352 00000100:00100000:0.0:1786002698.157286:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24411 00000100:00100000:0.0:1786002698.157297:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+108:22233:x1872758531140352:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:0.0:1786002698.157430:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+108:22233:x1872758531140352:12345-192.168.203.49@tcp:44:bash.0 Request processed in 134us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002698.157438:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24411 00000100:00100000:1.0:1786002698.168272:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.168337:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531140608 00000100:00100000:2.0:1786002698.168347:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531140608 00000100:00100000:2.0:1786002698.168399:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24412 00000100:00100000:2.0:1786002698.168408:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+108:22233:x1872758531140608:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002698.168428:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002698.168445:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af5784182c1 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5b1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.168548:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af5784182c8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.168561:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af5784182c8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.168584:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af5784182c8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002698.168595:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b1:0x0]: returning size 7 00010000:00010000:2.0:1786002698.168705:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af5784182c1 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5b1 expref: 111 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.168720:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af5784182c8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5b1 expref: 110 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.168728:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b1:0x0].0x0 (ffff9ed245644900) 00010000:00010000:2.0:1786002698.168731:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002698.168734:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2cc00, rc 0) 00000100:00100000:2.0:1786002698.168791:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+110:22233:x1872758531140608:12345-192.168.203.49@tcp:101:bash.0 Request processed in 383us (526us total) trans 4294968851 rc 0/0 00000100:00100000:2.0:1786002698.168799:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24412 00000100:00100000:1.0:1786002698.177109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.177177:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531140736 00000100:00100000:2.0:1786002698.177185:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531140736 00000100:00100000:2.0:1786002698.177249:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1589 00000100:00100000:2.0:1786002698.177259:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+110:2410:x1872758531140736:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002698.177274:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002698.177299:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2cc00/0x7cee4af5784182c8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5b1 expref: 110 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.177315:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b1:0x0].0x0 (ffff9ed245644900) 00010000:00010000:2.0:1786002698.177319:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002698.177379:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+109:2410:x1872758531140736:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 122us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.177386:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1589 00000100:00100000:3.0:1786002698.189759:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002698.189897:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531140992 00000100:00100000:1.0:1786002698.189915:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531140992 00000100:00100000:1.0:1786002698.189972:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24413 00000100:00100000:1.0:1786002698.189981:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+109:22233:x1872758531140992:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:1.0:1786002698.190030:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786002698.190052:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999000/0x7cee4af5784176c0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1ba expref: 109 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002698.190071:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b1:0x0].0x0 (ffff9ed245644900) 00010000:00010000:1.0:1786002698.190076:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786002698.190234:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af5784182d6 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002698.190252:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af5784182d6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002698.190262:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af5784182d6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786002698.190295:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968852 00000004:00010000:1.0:1786002698.190312:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e3ae8dd reply state 00000000352afcf9 transno 4294968853 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af5784182d6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002698.190324:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af5784182d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002698.190330:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b1:0x0].0x0 (ffff9ed245644900) 00010000:00010000:1.0:1786002698.190333:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1786002698.190336:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786002698.191004:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+111:22233:x1872758531140992:12345-192.168.203.49@tcp:36:bash.0 Request processed in 1023us (1254us total) trans 4294968853 rc 0/0 00000100:00100000:1.0:1786002698.191012:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24413 00000020:00080000:1.0:1786002698.191016:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1786002698.220352:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002698.220436:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531141120 00000100:00100000:1.0:1786002698.220446:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531141120 00000100:00100000:1.0:1786002698.220508:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24414 00000100:00100000:1.0:1786002698.220519:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+111:22233:x1872758531141120:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:1.0:1786002698.220541:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002698.220559:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af5784182dd lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5b8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002698.220622:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af5784182dd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5b8 expref: 112 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002698.220636:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1800/0x7cee4af5784182dd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5b8 expref: 112 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002698.220663:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b1:0x0].0x0 (ffff9ed245644900) 00010000:00010000:1.0:1786002698.220666:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786002698.220670:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1800, rc 0) 00000100:00100000:1.0:1786002698.220720:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+112:22233:x1872758531141120:12345-192.168.203.49@tcp:101:bash.0 Request processed in 204us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002698.220727:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24414 00010000:00010000:3.0:1786002698.221163:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002698.255672:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.255810:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531141248 00000100:00100000:2.0:1786002698.255819:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531141248 00002000:00010000:2.0:1786002698.255889:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/10 (0->18446744073709551615) 00002000:00100000:2.0:1786002698.255907:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f690000 with x1872758531141248 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002698.255919:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f690000. 00000100:00100000:2.0:1786002698.255947:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 117 00000100:00100000:2.0:1786002698.255957:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2411:x1872758531141248:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:2.0:1786002698.256183:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002698.256187:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1786002698 00002000:00010000:2.0:1786002698.256190:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002698.256192:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1786002698 00002000:00010000:2.0:1786002698.256194:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002698.256250:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531141248:12345-192.168.203.49@tcp:10:bash.0 Request processed in 294us (586us total) trans 4294969992 rc 0/0 00000100:00100000:2.0:1786002698.256258:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 117 00002000:00010000:2.0:1786002698.256262:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/10 (0->18446744073709551615) 00002000:00100000:2.0:1786002698.256265:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37f690000 with x1872758531141248 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002698.256269:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37f690000. 00000100:00100000:1.0:1786002698.262421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.262545:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531141376 00000100:00100000:3.0:1786002698.262555:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531141376 00000100:00100000:3.0:1786002698.262623:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5449 00000100:00100000:3.0:1786002698.262633:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531141376:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:0.0:1786002698.264543:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969992 is committed 00000100:00100000:3.0:1786002698.264744:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531141376:12345-192.168.203.49@tcp:16:bash.0 Request processed in 2109us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002698.264754:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5449 00000100:00100000:1.0:1786002698.286264:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.286519:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531141632 00000100:00100000:3.0:1786002698.286530:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531141632 00000100:00100000:3.0:1786002698.286597:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5330 00000100:00100000:3.0:1786002698.286608:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+112:22233:x1872758531141632:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:3.0:1786002698.286843:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+113:22233:x1872758531141632:12345-192.168.203.49@tcp:35:bash.0 Request processed in 235us (587us total) trans 4294968854 rc 0/0 00000100:00100000:3.0:1786002698.286885:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5330 00000100:00100000:1.0:1786002698.303990:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002698.304168:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531141760 00000100:00100000:0.0:1786002698.304177:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531141760 00000100:00100000:0.0:1786002698.304242:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24415 00000100:00100000:0.0:1786002698.304254:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+113:22233:x1872758531141760:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:0.0:1786002698.304400:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+113:22233:x1872758531141760:12345-192.168.203.49@tcp:44:bash.0 Request processed in 148us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002698.304408:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24415 00000100:00100000:1.0:1786002698.312503:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.312584:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531142016 00000100:00100000:3.0:1786002698.312592:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531142016 00000100:00100000:3.0:1786002698.312646:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24416 00000100:00100000:3.0:1786002698.312656:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24351df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+113:22233:x1872758531142016:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002698.312675:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002698.312693:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7e00/0x7cee4af5784182e4 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5bf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.312789:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af5784182eb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.312802:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af5784182eb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.312813:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af5784182eb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002698.312824:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b2:0x0]: returning size 7 00010000:00010000:3.0:1786002698.313079:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7e00/0x7cee4af5784182e4 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5bf expref: 116 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.313104:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af5784182eb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5bf expref: 115 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.313114:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b2:0x0].0x0 (ffff9ed245644200) 00010000:00010000:3.0:1786002698.313117:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002698.313120:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca7000, rc 0) 00000100:00100000:3.0:1786002698.313175:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24351df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+115:22233:x1872758531142016:12345-192.168.203.49@tcp:101:bash.0 Request processed in 520us (678us total) trans 4294968855 rc 0/0 00000100:00100000:3.0:1786002698.313182:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24416 00000100:00100000:1.0:1786002698.326984:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002698.328477:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531142272 00000100:00100000:0.0:1786002698.328488:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531142272 00000100:00100000:0.0:1786002698.328549:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24417 00000100:00100000:0.0:1786002698.328559:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+115:22233:x1872758531142272:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:0.0:1786002698.328620:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1786002698.328644:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af5784182eb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5bf expref: 115 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.328666:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244999a00/0x7cee4af5784176e3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1c1 expref: 114 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.328677:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b2:0x0].0x0 (ffff9ed245644200) 00010000:00010000:0.0:1786002698.328681:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786002698.328866:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af5784182f9 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1b2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.328880:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af5784182f9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.328888:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af5784182f9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786002698.329165:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968856 00000004:00010000:0.0:1786002698.329189:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013a2a4bb reply state 00000000301b164d transno 4294968857 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af5784182f9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.329203:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af5784182f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1b2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.329210:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b2:0x0].0x0 (ffff9ed245644200) 00010000:00010000:0.0:1786002698.329213:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1786002698.329216:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786002698.329293:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+116:22233:x1872758531142272:12345-192.168.203.49@tcp:36:bash.0 Request processed in 735us (2321us total) trans 4294968857 rc 0/0 00000100:00100000:0.0:1786002698.329301:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24417 00000020:00080000:0.0:1786002698.329306:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1786002698.334647:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.335455:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531142400 00000100:00100000:3.0:1786002698.335465:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531142400 00000100:00100000:3.0:1786002698.335525:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24418 00000100:00100000:3.0:1786002698.335534:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+116:22233:x1872758531142400:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002698.335556:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002698.335588:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7e00/0x7cee4af578418300 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1b2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5c6 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.335640:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7e00/0x7cee4af578418300 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5c6 expref: 117 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.335654:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7e00/0x7cee4af578418300 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5c6 expref: 117 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.335672:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b2:0x0].0x0 (ffff9ed245644200) 00010000:00010000:3.0:1786002698.335675:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786002698.335679:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca7e00, rc 0) 00000100:00100000:3.0:1786002698.335737:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+117:22233:x1872758531142400:12345-192.168.203.49@tcp:101:bash.0 Request processed in 204us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002698.335744:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24418 00000100:00100000:1.0:1786002698.348177:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.348265:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531142528 00000100:00100000:2.0:1786002698.348274:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531142528 00002000:00010000:2.0:1786002698.348312:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/10 (0->18446744073709551615) 00002000:00100000:2.0:1786002698.348315:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed24322ea00 with x1872758531142528 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002698.348326:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed24322ea00. 00000100:00100000:2.0:1786002698.348357:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 118 00000100:00100000:2.0:1786002698.348367:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531142528:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:2.0:1786002698.348611:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002698.348615:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1786002698 00002000:00010000:2.0:1786002698.348617:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002698.348619:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1786002698 00002000:00010000:2.0:1786002698.348621:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xa:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002698.348681:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2411:x1872758531142528:12345-192.168.203.49@tcp:10:bash.0 Request processed in 314us (512us total) trans 4294970030 rc 0/0 00000100:00100000:2.0:1786002698.348689:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 118 00002000:00010000:2.0:1786002698.348692:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/10 (0->18446744073709551615) 00002000:00100000:2.0:1786002698.348695:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed24322ea00 with x1872758531142528 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002698.348700:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed24322ea00. 00000100:00100000:0.0:1786002698.379368:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.382267:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531142656 00000100:00100000:2.0:1786002698.382278:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531142656 00000100:00100000:2.0:1786002698.382337:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5450 00000100:00100000:2.0:1786002698.382346:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2410:x1872758531142656:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002698.394751:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970030 is committed 00000100:00100000:2.0:1786002698.398826:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2410:x1872758531142656:12345-192.168.203.49@tcp:16:bash.0 Request processed in 16471us (19457us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.398839:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5450 00000100:00100000:1.0:1786002698.402326:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.404126:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531142912 00000100:00100000:2.0:1786002698.404138:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531142912 00000100:00100000:2.0:1786002698.404202:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5331 00000100:00100000:2.0:1786002698.404213:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+117:22233:x1872758531142912:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1786002698.404649:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+118:22233:x1872758531142912:12345-192.168.203.49@tcp:35:bash.0 Request processed in 436us (2326us total) trans 4294968858 rc 0/0 00000100:00100000:2.0:1786002698.404658:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5331 00000100:00100000:1.0:1786002698.423776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.423890:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531143040 00000100:00100000:2.0:1786002698.423915:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531143040 00000100:00100000:2.0:1786002698.423979:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24419 00000100:00100000:2.0:1786002698.423989:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+118:22233:x1872758531143040:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:2.0:1786002698.424147:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+118:22233:x1872758531143040:12345-192.168.203.49@tcp:44:bash.0 Request processed in 158us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.424156:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24419 00000100:00100000:0.0:1786002698.438276:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.438368:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531143296 00000100:00100000:2.0:1786002698.438388:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531143296 00000100:00100000:2.0:1786002698.438453:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24420 00000100:00100000:2.0:1786002698.438464:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+118:22233:x1872758531143296:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:2.0:1786002698.438494:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002698.438515:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578418307 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5cd expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.438637:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af57841830e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.438650:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af57841830e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.438661:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af57841830e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002698.438672:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b3:0x0]: returning size 7 00010000:00010000:2.0:1786002698.438773:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c000/0x7cee4af578418307 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5cd expref: 121 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.438791:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af57841830e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5cd expref: 120 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.438799:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b3:0x0].0x0 (ffff9ed245735200) 00010000:00010000:2.0:1786002698.438802:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786002698.438805:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2dc00, rc 0) 00000100:00100000:2.0:1786002698.438915:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+120:22233:x1872758531143296:12345-192.168.203.49@tcp:101:bash.0 Request processed in 442us (636us total) trans 4294968859 rc 0/0 00000100:00100000:2.0:1786002698.438923:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24420 00000100:00100000:1.0:1786002698.450720:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.450800:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531143552 00000100:00100000:3.0:1786002698.450811:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531143552 00000100:00100000:3.0:1786002698.450913:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24421 00000100:00100000:3.0:1786002698.450923:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+120:22233:x1872758531143552:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:3.0:1786002698.450983:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1786002698.451008:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2dc00/0x7cee4af57841830e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5cd expref: 120 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.451027:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83a00/0x7cee4af578417706 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1c8 expref: 119 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.451037:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b3:0x0].0x0 (ffff9ed245735200) 00010000:00010000:3.0:1786002698.451041:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002698.451437:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841831c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.451450:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841831c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.451458:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841831c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002698.451493:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968860 00000004:00010000:3.0:1786002698.451511:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ece5ba4 reply state 0000000094062b9e transno 4294968861 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841831c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.451522:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841831c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.451528:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b3:0x0].0x0 (ffff9ed245735200) 00010000:00010000:3.0:1786002698.451531:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002698.451534:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002698.451623:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+121:22233:x1872758531143552:12345-192.168.203.49@tcp:36:bash.0 Request processed in 700us (912us total) trans 4294968861 rc 0/0 00000100:00100000:3.0:1786002698.451630:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24421 00000020:00080000:3.0:1786002698.451635:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002698.468414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002698.468533:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531143680 00000100:00100000:0.0:1786002698.468542:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531143680 00000100:00100000:0.0:1786002698.468608:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24422 00000100:00100000:0.0:1786002698.468618:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+121:22233:x1872758531143680:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002698.468639:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002698.468658:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578418323 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5d4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.468713:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578418323 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5d4 expref: 122 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.468729:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35e00/0x7cee4af578418323 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5d4 expref: 122 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.468745:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b3:0x0].0x0 (ffff9ed245735200) 00010000:00010000:0.0:1786002698.468750:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786002698.468754:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f35e00, rc 0) 00000100:00100000:0.0:1786002698.468810:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+122:22233:x1872758531143680:12345-192.168.203.49@tcp:101:bash.0 Request processed in 193us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002698.468817:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24422 00000100:00100000:0.0:1786002698.480518:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.480618:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531143808 00000100:00100000:2.0:1786002698.480628:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531143808 00002000:00010000:2.0:1786002698.480668:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/11 (0->18446744073709551615) 00002000:00100000:2.0:1786002698.480672:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455fd180 with x1872758531143808 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002698.480685:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2455fd180. 00000100:00100000:2.0:1786002698.480718:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 119 00000100:00100000:2.0:1786002698.480728:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2411:x1872758531143808:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:2.0:1786002698.481028:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786002698.481031:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1786002698 00002000:00010000:2.0:1786002698.481034:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1786002698.481037:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1786002698 00002000:00010000:2.0:1786002698.481039:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1786002698.481110:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531143808:12345-192.168.203.49@tcp:10:bash.0 Request processed in 383us (600us total) trans 4294969993 rc 0/0 00000100:00100000:2.0:1786002698.481118:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 119 00002000:00010000:2.0:1786002698.481121:0:8442:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/11 (0->18446744073709551615) 00002000:00100000:2.0:1786002698.481124:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455fd180 with x1872758531143808 ext(0->18446744073709551615) 00002000:00010000:2.0:1786002698.481129:0:8442:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2455fd180. 00000100:00100000:1.0:1786002698.523961:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.524108:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531143936 00000100:00100000:3.0:1786002698.524117:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531143936 00000100:00100000:3.0:1786002698.524170:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5451 00000100:00100000:3.0:1786002698.524180:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531143936:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:0.0:1786002698.538291:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969993 is committed 00000100:00100000:3.0:1786002698.538464:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2411:x1872758531143936:12345-192.168.203.49@tcp:16:bash.0 Request processed in 14279us (14505us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002698.538476:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5451 00000100:00100000:3.0:1786002698.542450:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002698.542581:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531144192 00000100:00100000:0.0:1786002698.542598:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531144192 00000100:00100000:0.0:1786002698.542651:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5332 00000100:00100000:0.0:1786002698.542661:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed342ac4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+122:22233:x1872758531144192:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:0.0:1786002698.542927:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed342ac4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+123:22233:x1872758531144192:12345-192.168.203.49@tcp:35:bash.0 Request processed in 267us (484us total) trans 4294968862 rc 0/0 00000100:00100000:0.0:1786002698.543363:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5332 00000100:00100000:0.0:1786002698.563618:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.563768:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531144320 00000100:00100000:3.0:1786002698.563777:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531144320 00000100:00100000:3.0:1786002698.563843:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24423 00000100:00100000:3.0:1786002698.563898:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+123:22233:x1872758531144320:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:3.0:1786002698.564246:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+123:22233:x1872758531144320:12345-192.168.203.49@tcp:44:bash.0 Request processed in 361us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002698.564254:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24423 00000100:00100000:1.0:1786002698.583535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.583740:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531144576 00000100:00100000:3.0:1786002698.583751:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531144576 00000100:00100000:3.0:1786002698.583813:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24424 00000100:00100000:3.0:1786002698.583823:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+123:22233:x1872758531144576:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002698.583842:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002698.583912:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af57841832a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5db expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.584180:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578418331 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.584193:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578418331 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.584204:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578418331 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002698.584214:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b4:0x0]: returning size 7 00010000:00010000:3.0:1786002698.584304:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af57841832a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5db expref: 126 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.584322:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578418331 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5db expref: 125 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.584331:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b4:0x0].0x0 (ffff9ed245735400) 00010000:00010000:3.0:1786002698.584334:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002698.584338:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca7800, rc 0) 00000100:00100000:3.0:1786002698.584402:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+125:22233:x1872758531144576:12345-192.168.203.49@tcp:101:bash.0 Request processed in 580us (874us total) trans 4294968863 rc 0/0 00000100:00100000:3.0:1786002698.584409:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24424 00000100:00100000:1.0:1786002698.593990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.594138:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531144704 00000100:00100000:3.0:1786002698.594148:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531144704 00000100:00100000:3.0:1786002698.594207:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1590 00000100:00100000:3.0:1786002698.594217:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed347f57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+125:2410:x1872758531144704:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002698.594232:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002698.594261:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578418331 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5db expref: 125 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.594278:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b4:0x0].0x0 (ffff9ed245735400) 00010000:00010000:3.0:1786002698.594283:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002698.594337:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed347f57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+124:2410:x1872758531144704:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 121us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002698.594344:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1590 00000100:00100000:1.0:1786002698.601790:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.601946:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531144960 00000100:00100000:2.0:1786002698.601956:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531144960 00000100:00100000:2.0:1786002698.602014:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24425 00000100:00100000:2.0:1786002698.602024:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+124:22233:x1872758531144960:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:2.0:1786002698.602077:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002698.602110:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245f83800/0x7cee4af578417729 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1cf expref: 124 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.602126:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b4:0x0].0x0 (ffff9ed245735400) 00010000:00010000:2.0:1786002698.602130:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002698.602271:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af57841833f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.602283:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af57841833f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.602292:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af57841833f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002698.602324:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968864 00000004:00010000:2.0:1786002698.602341:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005922f056 reply state 00000000e3f0bb37 transno 4294968865 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af57841833f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.602351:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af57841833f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.602356:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b4:0x0].0x0 (ffff9ed245735400) 00010000:00010000:2.0:1786002698.602359:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002698.602361:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002698.602446:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+126:22233:x1872758531144960:12345-192.168.203.49@tcp:36:bash.0 Request processed in 422us (665us total) trans 4294968865 rc 0/0 00000100:00100000:2.0:1786002698.602452:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24425 00000020:00080000:2.0:1786002698.602457:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002698.603712:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24322c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561088256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002698.603762:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002698.603860:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002698.603867:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561088256 00000100:00100000:0.0:1786002698.603869:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24322fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561088384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002698.603872:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561088256 00000100:00100000:0.0:1786002698.603911:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002698.603915:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:1.0:1786002698.603923:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561088256:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002698.603936:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561088384 00000100:00100000:0.0:1786002698.603940:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561088384 00002000:00000024:1.0:1786002698.603958:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484845248 pending 0 free 3923390464 avail 3691868160 00000100:00100000:0.0:1786002698.603959:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1786002698.603965:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561088384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1786002698.603975:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484845248 pending 0 free 3923390464 avail 3691868160 00000100:00100000:1.0:1786002698.603996:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561088256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002698.603996:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561088384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002698.604002:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1786002698.604154:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561088512:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002698.604208:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561089024:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002698.604248:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561089536:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002698.604295:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1786002698.604300:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561088640:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604323:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002698.604341:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561089152:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604361:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002698.604389:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561089664:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002698.604429:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561088512 00000100:00100000:2.0:1786002698.604433:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561088512 00000100:00100000:2.0:1786002698.604458:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1786002698.604464:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561088512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604495:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561088512:12345-0@lo:400:kworker.0 Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.604501:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1786002698.604536:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561088512:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604556:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561088640 00000100:00100000:2.0:1786002698.604559:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561088640 00000100:00100000:2.0:1786002698.604600:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561089152 00000100:00100000:2.0:1786002698.604604:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561089152 00000100:00100000:2.0:1786002698.604620:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561089664 00000100:00100000:2.0:1786002698.604623:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561089664 00000100:00100000:2.0:1786002698.604636:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:2.0:1786002698.604642:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561088640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604673:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1872758561088640:12345-0@lo:400:kworker.0 Request processed in 31us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.604680:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:2.0:1786002698.604691:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1786002698.604698:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561089152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604723:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1872758561089152:12345-0@lo:400:kworker.0 Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.604733:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1786002698.604743:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1786002698.604749:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561089664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604774:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1872758561089664:12345-0@lo:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.604781:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1786002698.604806:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1872758561088640:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604815:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1872758561089152:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604823:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1872758561089664:0@lo:400:kworker.0 00000100:00080000:2.0:1786002698.604902:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786002698.604907:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002698.604915:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561088896:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002698.604952:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561089408:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.604968:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002698.604983:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1786002698.604987:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed34b5a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561088768:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002698.605015:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561089280:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605031:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002698.605041:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561089792:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605057:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002698.605075:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561089536 00000100:00100000:2.0:1786002698.605078:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561089536 00000100:00100000:2.0:1786002698.605098:0:14691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561089408 00000100:00100000:2.0:1786002698.605101:0:14691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561089408 00000100:00100000:2.0:1786002698.605115:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1786002698.605120:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561089536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605151:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561089536:12345-0@lo:400:kworker.0 Request processed in 30us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.605157:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1786002698.605167:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1786002698.605173:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561089408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605196:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561089408:12345-0@lo:400:kworker.0 Request processed in 24us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.605202:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1786002698.605222:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561089408:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605238:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561089536:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605250:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561088896 00000100:00100000:2.0:1786002698.605253:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561088896 00000100:00100000:2.0:1786002698.605265:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561089280 00000100:00100000:2.0:1786002698.605267:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561089280 00000100:00100000:2.0:1786002698.605281:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561089792 00000100:00100000:2.0:1786002698.605283:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561089792 00000100:00100000:2.0:1786002698.605295:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1786002698.605300:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561088896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605328:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561088896:12345-0@lo:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.605334:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1786002698.605344:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1786002698.605350:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561089280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605371:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1872758561089280:12345-0@lo:400:kworker.0 Request processed in 21us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.605376:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1786002698.605385:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1786002698.605391:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561089792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605410:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1872758561089792:12345-0@lo:400:kworker.0 Request processed in 20us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.605416:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00080000:2.0:1786002698.605442:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1786002698.605456:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1872758561089280:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605465:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1872758561089792:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605473:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561088896:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605503:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561089024 00000100:00100000:2.0:1786002698.605506:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561089024 00000100:00100000:2.0:1786002698.605525:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561088768 00000100:00100000:2.0:1786002698.605528:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561088768 00000100:00100000:2.0:1786002698.605540:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4170 00000100:00100000:2.0:1786002698.605546:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561089024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605591:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561089024:12345-0@lo:400:kworker.0 Request processed in 45us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.605598:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4170 00000100:00100000:2.0:1786002698.605608:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4171 00000100:00100000:2.0:1786002698.605614:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561088768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605641:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3645:x1872758561088768:12345-0@lo:400:kworker.0 Request processed in 27us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.605647:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4171 00000100:00100000:2.0:1786002698.605668:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed34b5a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561088768:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605687:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561089024:0@lo:400:kworker.0 00000100:00100000:2.0:1786002698.605737:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24322fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561088384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002698.605750:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24322c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561088256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786002698.618781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.618817:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531145088 00000100:00100000:3.0:1786002698.618826:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531145088 00000100:00100000:3.0:1786002698.618917:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24426 00000100:00100000:3.0:1786002698.618928:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+126:22233:x1872758531145088:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:3.0:1786002698.618960:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002698.618979:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578418346 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5e2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.619031:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578418346 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5e2 expref: 127 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.619045:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7800/0x7cee4af578418346 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5e2 expref: 127 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.619063:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b4:0x0].0x0 (ffff9ed245735400) 00010000:00010000:3.0:1786002698.619067:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786002698.619070:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245ca7800, rc 0) 00000100:00100000:3.0:1786002698.620057:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+127:22233:x1872758531145088:12345-192.168.203.49@tcp:101:bash.0 Request processed in 1128us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002698.620066:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24426 00000100:00100000:1.0:1786002698.627043:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:0.0:1786002698.631028:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.631195:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531145216 00000100:00100000:3.0:1786002698.631204:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531145216 00002000:00010000:3.0:1786002698.631242:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/11 (0->18446744073709551615) 00002000:00100000:3.0:1786002698.631246:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455fd880 with x1872758531145216 ext(0->18446744073709551615) 00002000:00010000:3.0:1786002698.631257:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455fd880. 00000100:00100000:3.0:1786002698.631288:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 120 00000100:00100000:3.0:1786002698.631299:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531145216:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:3.0:1786002698.631546:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1786002698.631550:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1786002698 00002000:00010000:3.0:1786002698.631552:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786002698.631554:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1786002698 00002000:00010000:3.0:1786002698.631556:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1786002698.631635:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2411:x1872758531145216:12345-192.168.203.49@tcp:10:bash.0 Request processed in 338us (615us total) trans 4294970031 rc 0/0 00000100:00100000:3.0:1786002698.631644:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 120 00002000:00010000:3.0:1786002698.631648:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/11 (0->18446744073709551615) 00002000:00100000:3.0:1786002698.631650:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455fd880 with x1872758531145216 ext(0->18446744073709551615) 00002000:00010000:3.0:1786002698.631654:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455fd880. 00000100:00100000:0.0:1786002698.652295:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.652387:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531145344 00000100:00100000:2.0:1786002698.652396:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531145344 00000100:00100000:2.0:1786002698.652454:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5452 00000100:00100000:2.0:1786002698.652464:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2413:x1872758531145344:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:3.0:1786002698.663217:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970031 is committed 00000100:00100000:2.0:1786002698.665061:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531145344:12345-192.168.203.49@tcp:16:bash.0 Request processed in 12591us (12766us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.665073:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5452 00000100:00100000:1.0:1786002698.680775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.681033:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531145600 00000100:00100000:2.0:1786002698.681041:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531145600 00000100:00100000:2.0:1786002698.681137:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5333 00000100:00100000:2.0:1786002698.681146:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+127:22233:x1872758531145600:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:2.0:1786002698.681336:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+128:22233:x1872758531145600:12345-192.168.203.49@tcp:35:bash.0 Request processed in 190us (569us total) trans 4294968866 rc 0/0 00000100:00100000:2.0:1786002698.681343:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5333 00000100:00100000:0.0:1786002698.695249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002698.695332:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531145728 00000100:00100000:1.0:1786002698.695341:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531145728 00000100:00100000:1.0:1786002698.695403:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24427 00000100:00100000:1.0:1786002698.695413:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+128:22233:x1872758531145728:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:1.0:1786002698.695545:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+128:22233:x1872758531145728:12345-192.168.203.49@tcp:44:bash.0 Request processed in 134us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002698.695553:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24427 00000100:00100000:1.0:1786002698.714965:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002698.715102:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531145984 00000100:00100000:0.0:1786002698.715111:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531145984 00000100:00100000:0.0:1786002698.715167:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24428 00000100:00100000:0.0:1786002698.715176:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+128:22233:x1872758531145984:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002698.715194:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002698.715213:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af57841834d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5e9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.715312:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578418354 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.715326:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578418354 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.715336:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578418354 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002698.715347:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1b5:0x0]: returning size 7 00010000:00010000:0.0:1786002698.715449:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af57841834d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5e9 expref: 131 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.715465:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578418354 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5e9 expref: 130 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.715473:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b5:0x0].0x0 (ffff9ed2456aee00) 00010000:00010000:0.0:1786002698.715476:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002698.715479:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34400, rc 0) 00000100:00100000:0.0:1786002698.715535:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+130:22233:x1872758531145984:12345-192.168.203.49@tcp:101:bash.0 Request processed in 359us (579us total) trans 4294968867 rc 0/0 00000100:00100000:0.0:1786002698.715542:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24428 00000100:00100000:3.0:1786002698.723719:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.723835:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531146112 00000100:00100000:2.0:1786002698.723844:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531146112 00000100:00100000:2.0:1786002698.723941:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1591 00000100:00100000:2.0:1786002698.723953:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+130:2412:x1872758531146112:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786002698.723971:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002698.723995:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af578418354 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5e9 expref: 130 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002698.724012:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b5:0x0].0x0 (ffff9ed2456aee00) 00010000:00010000:2.0:1786002698.724017:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786002698.724068:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+129:2412:x1872758531146112:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 118us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002698.724076:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1591 00000100:00100000:1.0:1786002698.727805:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.738218:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531146368 00000100:00100000:3.0:1786002698.738232:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531146368 00000100:00100000:3.0:1786002698.738306:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24429 00000100:00100000:3.0:1786002698.738317:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+129:22233:x1872758531146368:12345-192.168.203.49@tcp:36:bash.0 00010000:00010000:3.0:1786002698.738392:0:10360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002698.738418:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716800/0x7cee4af57841774c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b1d6 expref: 129 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.738447:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b5:0x0].0x0 (ffff9ed2456aee00) 00010000:00010000:3.0:1786002698.738452:0:10360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786002698.741839:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af578418362 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.741871:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af578418362 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.741881:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af578418362 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786002698.741932:0:10360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968868 00000004:00010000:3.0:1786002698.741964:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c40be8d reply state 000000003b5ea333 transno 4294968869 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af578418362 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.741976:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af578418362 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002698.741983:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b5:0x0].0x0 (ffff9ed2456aee00) 00010000:00010000:3.0:1786002698.741986:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002698.741989:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786002698.742097:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+131:22233:x1872758531146368:12345-192.168.203.49@tcp:36:bash.0 Request processed in 3779us (14294us total) trans 4294968869 rc 0/0 00000100:00100000:3.0:1786002698.742105:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24429 00000020:00080000:3.0:1786002698.742110:0:10360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1786002698.747178:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002698.747290:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531146496 00000100:00100000:0.0:1786002698.747299:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531146496 00000100:00100000:0.0:1786002698.747353:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24430 00000100:00100000:0.0:1786002698.747361:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37f550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+131:22233:x1872758531146496:12345-192.168.203.49@tcp:101:bash.0 00010000:00010000:0.0:1786002698.747388:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002698.747406:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578418369 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.747462:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578418369 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5f0 expref: 132 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.747475:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34200/0x7cee4af578418369 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5f0 expref: 132 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002698.747490:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b5:0x0].0x0 (ffff9ed2456aee00) 00010000:00010000:0.0:1786002698.747493:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786002698.747496:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34200, rc 0) 00000100:00100000:0.0:1786002698.747546:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37f550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+132:22233:x1872758531146496:12345-192.168.203.49@tcp:101:bash.0 Request processed in 186us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002698.747553:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24430 00000100:00100000:3.0:1786002698.761407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002698.761569:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531146624 00000100:00100000:0.0:1786002698.761579:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531146624 00002000:00010000:0.0:1786002698.762130:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/12 (0->18446744073709551615) 00002000:00100000:0.0:1786002698.762136:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245c40700 with x1872758531146624 ext(0->18446744073709551615) 00002000:00010000:0.0:1786002698.762148:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed245c40700. 00000100:00100000:0.0:1786002698.762173:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 121 00000100:00100000:0.0:1786002698.762183:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2413:x1872758531146624:12345-192.168.203.49@tcp:10:bash.0 00002000:00010000:0.0:1786002698.764810:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786002698.764817:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb mtime from disk: 0 -> 1786002698 00002000:00010000:0.0:1786002698.764819:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786002698.764822:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb ctime from disk: 0 -> 1786002698 00002000:00010000:0.0:1786002698.764824:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1786002698.764914:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531146624:12345-192.168.203.49@tcp:10:bash.0 Request processed in 2729us (3511us total) trans 4294969994 rc 0/0 00000100:00100000:0.0:1786002698.764922:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 121 00002000:00010000:0.0:1786002698.764927:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/12 (0->18446744073709551615) 00002000:00100000:0.0:1786002698.764930:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed245c40700 with x1872758531146624 ext(0->18446744073709551615) 00002000:00010000:0.0:1786002698.764944:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed245c40700. 00000100:00100000:3.0:1786002698.816418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002698.816529:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531146752 00000100:00100000:2.0:1786002698.816539:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531146752 00000100:00100000:2.0:1786002698.816606:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5453 00000100:00100000:2.0:1786002698.816616:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531146752:12345-192.168.203.49@tcp:16:bash.0 00000001:00080000:2.0:1786002698.819468:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969994 is committed 00000100:00100000:3.0:1786002698.825230:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531146752:12345-192.168.203.49@tcp:16:bash.0 Request processed in 8606us (8808us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002698.825244:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5453 00000100:00100000:2.0:1786002698.836190:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.836678:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531147008 00000100:00100000:3.0:1786002698.836687:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531147008 00000100:00100000:3.0:1786002698.836743:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5334 00000100:00100000:3.0:1786002698.836753:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+132:22233:x1872758531147008:12345-192.168.203.49@tcp:35:bash.0 00000100:00100000:3.0:1786002698.837104:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+133:22233:x1872758531147008:12345-192.168.203.49@tcp:35:bash.0 Request processed in 352us (921us total) trans 4294968870 rc 0/0 00000100:00100000:3.0:1786002698.837113:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5334 00000100:00100000:3.0:1786002698.843391:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002698.843419:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531147136 00000100:00100000:3.0:1786002698.843426:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531147136 00000100:00100000:3.0:1786002698.843470:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24431 00000100:00100000:3.0:1786002698.843480:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+133:22233:x1872758531147136:12345-192.168.203.49@tcp:44:bash.0 00000100:00100000:3.0:1786002698.843614:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+133:22233:x1872758531147136:12345-192.168.203.49@tcp:44:bash.0 Request processed in 135us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002698.843622:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24431 00000100:00100000:3.0:1786002699.180129:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002699.180164:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531147392 00000100:00100000:3.0:1786002699.180172:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531147392 00000100:00100000:3.0:1786002699.180235:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24432 00000100:00100000:3.0:1786002699.180246:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+133:22478:x1872758531147392:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:3.0:1786002699.180265:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002699.180284:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af578418370 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5f7 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.180378:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578418377 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.180391:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578418377 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.180403:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578418377 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.180416:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621e00/0x7cee4af57841837e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.180423:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621e00/0x7cee4af57841837e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.180430:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621e00/0x7cee4af57841837e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183356:0:10360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620800/0x7cee4af578418385 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183373:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620800/0x7cee4af578418385 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183383:0:10360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620800/0x7cee4af578418385 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786002699.183393:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1dd:0x0]: returning size 0 00010000:00010000:3.0:1786002699.183418:0:10360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578418377 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183429:0:10360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578418377 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183435:0:10360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578418377 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183441:0:10360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578418377 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183447:0:10360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed3429ea000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1786002699.183451:0:10360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578418377 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183458:0:10360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578418377 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183478:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:3.0:1786002699.183481:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786002699.183486:0:10360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578418377 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183492:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed3429ea000/0x7cee4af578418377 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786002699.183505:0:10360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c56732f reply state 000000007ed021e4 transno 4294968871 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621e00/0x7cee4af57841837e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183514:0:10360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621e00/0x7cee4af57841837e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183519:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xdbd367d0 (ffff9ed366c05800) 00010000:00010000:3.0:1786002699.183521:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1786002699.183524:0:10360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786002699.183556:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6a00/0x7cee4af578418370 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5f7 expref: 136 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183581:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620800/0x7cee4af578418385 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5f7 expref: 135 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.183588:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1dd:0x0].0x0 (ffff9ed366c05b00) 00010000:00010000:3.0:1786002699.183590:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786002699.183592:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245620800, rc 0) 00000100:00100000:3.0:1786002699.183668:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed245c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+136:22478:x1872758531147392:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 3423us (3547us total) trans 4294968871 rc 0/0 00000100:00100000:3.0:1786002699.183677:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24432 00000100:00080000:2.0:1786002699.183987:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786002699.190838:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002699.191204:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531147648 00000100:00100000:0.0:1786002699.191215:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531147648 00000100:00100000:0.0:1786002699.191270:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24433 00000100:00100000:0.0:1786002699.191281:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+136:22478:x1872758531147648:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:0.0:1786002699.191304:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786002699.191321:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578418393 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b5fe expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.191426:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.191441:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620800/0x7cee4af578418385 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5f7 expref: 137 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.191453:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 4/0,1 mode: --/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.191483:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620800/0x7cee4af578418385 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5f7 expref: 137 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.191495:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620800/0x7cee4af578418385 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5f7 expref: 137 pid: 10360 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002699.191507:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758561089920:192.168.203.49@tcp:104: 00000100:00100000:0.0:1786002699.191595:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ed243642d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786002699.212069:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6522:1872758561089920:192.168.203.49@tcp:104: 00010000:00010000:0.0:1786002699.212106:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002699.224018:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002699.225279:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531147776 00000100:00100000:3.0:1786002699.225289:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531147776 00010000:00010000:3.0:1786002699.225329:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620800/0x7cee4af578418385 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5f7 expref: 138 pid: 10360 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786002699.225368:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1706 00000100:00100000:3.0:1786002699.225378:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+138:2413:x1872758531147776:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786002699.225392:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786002699.225399:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620800/0x7cee4af578418385 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5f7 expref: 138 pid: 10360 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.225412:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620800/0x7cee4af578418385 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5f7 expref: 138 pid: 10360 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.225439:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620800/0x7cee4af578418385 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5f7 expref: 138 pid: 10360 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.225455:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1dd:0x0].0x0 (ffff9ed366c05b00) 00010000:00010000:3.0:1786002699.225461:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.225479:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.225486:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.225518:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786002699.225581:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+137:2413:x1872758531147776:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 205us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002699.225589:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1706 00010000:00010000:0.0:1786002699.226729:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.226751:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002699.226771:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1dd:0x0]: returning size 0 00000004:00080000:0.0:1786002699.226981:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xd:0x0], index 0: 0 00000004:00080000:0.0:1786002699.226989:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xd:0x0], index 1: 0 00010000:00010000:0.0:1786002699.227101:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.227114:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.227121:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.227127:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f34400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.227131:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.227138:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.227148:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1dd:0x0].0x0 (ffff9ed366c05b00) 00010000:00010000:0.0:1786002699.227151:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786002699.227155:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 2/0,0 mode: --/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.227161:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34400/0x7cee4af57841839a lrc: 0/0,0 mode: --/EX res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.227220:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578418393 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5fe expref: 137 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.227230:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002699.227233:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786002699.227236:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f34000/0x7cee4af578418393 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b5fe expref: 137 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.227245:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed244f34000, rc 0) 00000100:00100000:0.0:1786002699.227291:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+136:22478:x1872758531147648:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 36012us (36466us total) trans 4294968872 rc 301/301 00000100:00100000:0.0:1786002699.227299:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24433 00010000:00010000:1.0:1786002699.242843:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002699.256984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002699.260004:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531148032 00000100:00100000:1.0:1786002699.260015:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531148032 00000100:00100000:1.0:1786002699.260063:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5335 00000100:00100000:1.0:1786002699.260073:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+136:22478:x1872758531148032:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:1.0:1786002699.260371:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+137:22478:x1872758531148032:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 298us (3391us total) trans 4294968873 rc 0/0 00000100:00100000:1.0:1786002699.260379:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5335 00000100:00100000:2.0:1786002699.267340:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002699.267401:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531148160 00000100:00100000:1.0:1786002699.267411:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531148160 00000100:00100000:1.0:1786002699.267467:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24434 00000100:00100000:1.0:1786002699.267476:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+137:22478:x1872758531148160:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002699.267498:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002699.267518:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af5784183a8 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b605 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.267578:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af5784183a8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b605 expref: 138 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.267593:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0600/0x7cee4af5784183a8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b605 expref: 138 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.267610:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1dd:0x0].0x0 (ffff9ed245644700) 00010000:00010000:1.0:1786002699.267613:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786002699.267617:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b0600, rc 0) 00000100:00100000:1.0:1786002699.267676:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+138:22478:x1872758531148160:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 200us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002699.267683:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24434 00000100:00100000:3.0:1786002699.289314:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002699.289347:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531148416 00000100:00100000:3.0:1786002699.289355:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531148416 00000100:00100000:3.0:1786002699.289398:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5336 00000100:00100000:3.0:1786002699.289407:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+138:22478:x1872758531148416:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1786002699.289608:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37bc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+139:22478:x1872758531148416:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 200us (302us total) trans 4294968874 rc 0/0 00000100:00100000:3.0:1786002699.289616:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5336 00000100:00100000:3.0:1786002699.303945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002699.303992:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531148544 00000100:00100000:3.0:1786002699.304007:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531148544 00000100:00100000:3.0:1786002699.304062:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24435 00000100:00100000:3.0:1786002699.304072:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+139:22478:x1872758531148544:12345-192.168.203.49@tcp:44:lfs.0 00000001:00080000:3.0:1786002699.319079:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968874 is committed 00000100:00100000:3.0:1786002699.319300:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+72:22478:x1872758531148544:12345-192.168.203.49@tcp:44:lfs.0 Request processed in 15224us (15362us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002699.319312:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24435 00010000:00010000:0.0:1786002699.323395:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7200/0x7cee4af578418155 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.323411:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7200/0x7cee4af578418155 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.323423:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7200/0x7cee4af578418155 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.323429:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.323434:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7200/0x7cee4af578418155 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.323445:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7200/0x7cee4af578418155 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.323469:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a6:0x0].0x0 (ffff9ed245644a00) 00010000:00010000:0.0:1786002699.323473:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.323477:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7200/0x7cee4af578418155 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.323489:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7200/0x7cee4af578418155 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.324979:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418178 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.324990:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418178 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325003:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418178 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325014:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.325017:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418178 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325025:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418178 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325036:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a7:0x0].0x0 (ffff9ed2456f9900) 00010000:00010000:0.0:1786002699.325039:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.325047:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418178 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325054:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6c00/0x7cee4af578418178 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325065:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af57841819b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325076:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af57841819b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325083:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af57841819b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325088:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2d200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.325091:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af57841819b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325106:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af57841819b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325114:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a8:0x0].0x0 (ffff9ed2456aef00) 00010000:00010000:0.0:1786002699.325116:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.325123:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af57841819b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325130:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2d200/0x7cee4af57841819b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325140:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1e00/0x7cee4af5784181be lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325150:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1e00/0x7cee4af5784181be lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325157:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1e00/0x7cee4af5784181be lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325162:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b1e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.325169:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1e00/0x7cee4af5784181be lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325175:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1e00/0x7cee4af5784181be lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325182:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a9:0x0].0x0 (ffff9ed245735700) 00010000:00010000:0.0:1786002699.325184:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.325188:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1e00/0x7cee4af5784181be lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325202:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1e00/0x7cee4af5784181be lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325213:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784181e1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325223:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784181e1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325230:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784181e1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325235:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.325238:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784181e1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325248:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784181e1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325255:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1aa:0x0].0x0 (ffff9ed2456f9200) 00010000:00010000:0.0:1786002699.325258:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.325260:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784181e1 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325272:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35000/0x7cee4af5784181e1 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325282:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af578418204 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325293:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af578418204 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325300:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af578418204 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325306:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b1c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.325312:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af578418204 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325319:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af578418204 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325326:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ab:0x0].0x0 (ffff9ed2456ae200) 00010000:00010000:0.0:1786002699.325328:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.325331:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af578418204 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325342:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1c00/0x7cee4af578418204 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325352:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af578418227 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325359:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af578418227 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325369:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af578418227 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325374:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca6600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.325377:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af578418227 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325393:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af578418227 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325400:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ac:0x0].0x0 (ffff9ed243d0bd00) 00010000:00010000:0.0:1786002699.325403:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.325406:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af578418227 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325417:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca6600/0x7cee4af578418227 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325428:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af57841824a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325439:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af57841824a lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325444:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af57841824a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325449:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.325451:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af57841824a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325463:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af57841824a lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325470:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ad:0x0].0x0 (ffff9ed245735600) 00010000:00010000:0.0:1786002699.325472:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.325475:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af57841824a lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325490:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af57841824a lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1ad:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325500:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af57841826d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325513:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af57841826d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325519:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af57841826d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325524:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.325527:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af57841826d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325538:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af57841826d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325545:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1ae:0x0].0x0 (ffff9ed245735500) 00010000:00010000:0.0:1786002699.325548:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.325550:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af57841826d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325567:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35a00/0x7cee4af57841826d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1ae:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325578:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578418290 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325584:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578418290 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325596:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578418290 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325601:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.325604:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578418290 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325610:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578418290 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325616:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1af:0x0].0x0 (ffff9ed2456f9100) 00010000:00010000:0.0:1786002699.325618:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.325625:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578418290 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.325631:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35800/0x7cee4af578418290 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.327953:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784182b3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.327961:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784182b3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.327967:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784182b3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.327972:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.327976:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784182b3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.327987:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784182b3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.327999:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b0:0x0].0x0 (ffff9ed245735c00) 00010000:00010000:0.0:1786002699.328001:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.328004:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784182b3 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.328009:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784182b3 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.328020:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af5784182d6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.328025:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af5784182d6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.328031:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af5784182d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.328035:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.328037:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af5784182d6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.328042:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af5784182d6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.328048:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b1:0x0].0x0 (ffff9ed245644900) 00010000:00010000:0.0:1786002699.328050:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.328053:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af5784182d6 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.328061:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0e00/0x7cee4af5784182d6 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.328070:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af5784182f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1b2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.328075:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af5784182f9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1b2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.333497:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af5784182f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1b2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.333505:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed244f35c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.333511:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af5784182f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1b2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.333520:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af5784182f9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1b2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.333547:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b2:0x0].0x0 (ffff9ed245644200) 00010000:00010000:0.0:1786002699.333550:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.333555:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af5784182f9 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1b2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.333623:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed244f35c00/0x7cee4af5784182f9 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1b2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350096:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841831c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350110:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841831c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350118:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841831c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350124:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245ca7000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.350129:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841831c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350136:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841831c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350151:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b3:0x0].0x0 (ffff9ed245735200) 00010000:00010000:0.0:1786002699.350154:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.350158:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841831c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350163:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245ca7000/0x7cee4af57841831c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350177:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af57841833f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350182:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af57841833f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350187:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af57841833f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350191:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.350193:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af57841833f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350201:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af57841833f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350207:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b4:0x0].0x0 (ffff9ed245735400) 00010000:00010000:0.0:1786002699.350209:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.350211:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af57841833f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350216:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af57841833f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350225:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af578418362 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350230:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af578418362 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350235:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af578418362 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350238:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed382166c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.350241:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af578418362 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350245:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af578418362 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350250:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1b5:0x0].0x0 (ffff9ed2456aee00) 00010000:00010000:0.0:1786002699.350252:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.350254:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af578418362 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350262:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed382166c00/0x7cee4af578418362 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350272:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621e00/0x7cee4af57841837e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350277:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621e00/0x7cee4af57841837e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350282:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621e00/0x7cee4af57841837e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350287:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245621e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.350289:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621e00/0x7cee4af57841837e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350294:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621e00/0x7cee4af57841837e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350301:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xdbd367d0 (ffff9ed366c05800) 00010000:00010000:0.0:1786002699.350303:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.350305:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621e00/0x7cee4af57841837e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.350310:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621e00/0x7cee4af57841837e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10360 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786002699.428965:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002699.429092:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531148800 00000100:00100000:1.0:1786002699.429102:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531148800 00000100:00100000:1.0:1786002699.429170:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24436 00000100:00100000:1.0:1786002699.429180:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+55:22479:x1872758531148800:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:1.0:1786002699.429199:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786002699.429217:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af5784183af lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b60c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429287:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af5784183b6 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429300:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af5784183b6 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429311:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af5784183b6 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429324:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784183bd lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429332:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784183bd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429338:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784183bd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429402:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af5784183b6 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429411:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af5784183b6 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429417:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af5784183b6 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429424:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af5784183b6 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429431:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002699.429436:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af5784183b6 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429444:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af5784183b6 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429465:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:1.0:1786002699.429469:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002699.429473:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af5784183b6 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429479:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0c00/0x7cee4af5784183b6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429490:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784183bd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429496:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784183bd lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429501:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784183bd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429506:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed2465b0200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1786002699.429509:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784183bd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429515:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784183bd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429522:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xdbd367d0 (ffff9ed245644f00) 00010000:00010000:1.0:1786002699.429524:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786002699.429528:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784183bd lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429533:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b0200/0x7cee4af5784183bd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429576:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af5784183af lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b60c expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429585:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:1.0:1786002699.429588:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786002699.429592:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed2465b1000/0x7cee4af5784183af lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b60c expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002699.429601:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed2465b1000, rc 0) 00000100:00100000:1.0:1786002699.429658:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2454c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+55:22479:x1872758531148800:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 478us (698us total) trans 0 rc 301/301 00000100:00100000:1.0:1786002699.429665:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24436 00000100:00100000:0.0:1786002699.444141:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002699.445122:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531149056 00000100:00100000:2.0:1786002699.445133:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531149056 00000100:00100000:2.0:1786002699.445193:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24437 00000100:00100000:2.0:1786002699.445202:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+55:22479:x1872758531149056:12345-192.168.203.49@tcp:101:lfs.0 00010000:00010000:2.0:1786002699.445223:0:10360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002699.445243:0:10360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af5784183c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b613 expref: -99 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786002699.445329:0:10360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1a1:0x0]: returning size 4096 00010000:00010000:2.0:1786002699.445430:0:10360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af5784183c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b613 expref: 57 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.445443:0:10360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ed2456f9d00) 00010000:00010000:2.0:1786002699.445455:0:10360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786002699.445461:0:10360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af5784183c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b613 expref: 57 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.445476:0:10360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2de00, rc 0) 00000100:00100000:2.0:1786002699.445523:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+56:22479:x1872758531149056:12345-192.168.203.49@tcp:101:lfs.0 Request processed in 322us (1390us total) trans 4294968875 rc 301/301 00000100:00100000:2.0:1786002699.445530:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24437 00000100:00100000:1.0:1786002699.450744:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002699.450812:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531149184 00000100:00100000:3.0:1786002699.450820:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531149184 00000100:00100000:0.0:1786002699.451651:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24438 00000100:00100000:0.0:1786002699.451663:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+56:22479:x1872758531149184:12345-192.168.203.49@tcp:34:lfs.0 00010000:00010000:0.0:1786002699.451726:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784183d2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.451741:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784183d2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.451752:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784183d2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.451765:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af5784183d9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.451772:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af5784183d9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.451779:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af5784183d9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.451831:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183e0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.451840:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.451866:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002699.451964:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1dd:0x0]: returning size 0 00000004:00200000:0.0:1786002699.451970:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1786002699.451983:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.451996:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784183d2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452003:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784183d2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452009:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784183d2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452015:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784183d2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452021:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.452024:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784183d2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452032:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784183d2 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452043:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002699.452046:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.452050:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784183d2 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452056:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717400/0x7cee4af5784183d2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452068:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af5784183d9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452075:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af5784183d9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452080:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af5784183d9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452086:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245717a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.452089:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af5784183d9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452097:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af5784183d9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452103:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xdbd367d0 (ffff9ed245e35300) 00010000:00010000:0.0:1786002699.452105:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.452108:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af5784183d9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452113:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245717a00/0x7cee4af5784183d9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452124:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183e0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452129:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183e0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452135:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452139:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed245716a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.452142:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452148:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183e0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452158:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1dd:0x0].0x0 (ffff9ed245644700) 00010000:00010000:0.0:1786002699.452160:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.452163:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183e0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.452169:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183e0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786002699.452235:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+56:22479:x1872758531149184:12345-192.168.203.49@tcp:34:lfs.0 Request processed in 574us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002699.452242:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24438 00000100:00100000:1.0:1786002699.461069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002699.464017:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531149440 00000100:00100000:3.0:1786002699.464028:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531149440 00000100:00100000:3.0:1786002699.464081:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5337 00000100:00100000:3.0:1786002699.464091:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+56:22479:x1872758531149440:12345-192.168.203.49@tcp:35:lfs.0 00000100:00100000:3.0:1786002699.464281:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+57:22479:x1872758531149440:12345-192.168.203.49@tcp:35:lfs.0 Request processed in 190us (3220us total) trans 4294968876 rc 0/0 00000100:00100000:3.0:1786002699.464289:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5337 00000100:00100000:3.0:1786002699.520114:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002699.520538:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531149696 00000100:00100000:2.0:1786002699.520547:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531149696 00000100:00100000:2.0:1786002699.520622:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24439 00000100:00100000:2.0:1786002699.520632:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+57:22482:x1872758531149696:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002699.520655:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002699.520673:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af5784183e7 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b61a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.520782:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af5784183ee lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.520795:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af5784183ee lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.520805:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af5784183ee lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.520824:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784183f5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.520831:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784183f5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.520837:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784183f5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521095:0:14496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183fc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521104:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183fc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521112:0:14496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183fc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786002699.521122:0:14496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x1dd:0x0]: returning size 0 00010000:00010000:0.0:1786002699.521192:0:14496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af5784183ee lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521199:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af5784183ee lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521205:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af5784183ee lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521211:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af5784183ee lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521217:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2c800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.521221:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af5784183ee lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521228:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af5784183ee lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521240:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed2456ef000) 00010000:00010000:0.0:1786002699.521242:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.521247:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af5784183ee lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521252:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2c800/0x7cee4af5784183ee lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521263:0:14496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784183f5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521269:0:14496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784183f5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521274:0:14496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784183f5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521280:0:14496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002699.521282:0:14496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784183f5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521288:0:14496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784183f5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521299:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0xdbd367d0 (ffff9ed2456f9d00) 00010000:00010000:0.0:1786002699.521301:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002699.521304:0:14496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784183f5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521310:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2ca00/0x7cee4af5784183f5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0xdbd367d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14496 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521347:0:14496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2de00/0x7cee4af5784183e7 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b61a expref: 60 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521359:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183fc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b61a expref: 59 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002699.521379:0:14496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1dd:0x0].0x0 (ffff9ed245644700) 00010000:00010000:0.0:1786002699.521381:0:14496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786002699.521383:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245716a00, rc 0) 00000100:00100000:0.0:1786002699.521439:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:07e0de48-2601-4cba-b1ae-c2d2039ff29a+59:22482:x1872758531149696:12345-192.168.203.49@tcp:101:dd.0 Request processed in 809us (1333us total) trans 4294968877 rc 0/0 00000100:00100000:0.0:1786002699.521445:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24439 00000100:00100000:1.0:1786002699.536800:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002699.536928:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531149824 00000100:00100000:3.0:1786002699.536936:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531149824 00000100:00100000:3.0:1786002699.536991:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24440 00000100:00100000:3.0:1786002699.537001:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+59:22482:x1872758531149824:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1786002699.537023:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002699.537041:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620a00/0x7cee4af57841840a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b621 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.537070:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621600/0x7cee4af578418411 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.537091:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621600/0x7cee4af578418411 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.537102:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621600/0x7cee4af578418411 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.537204:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245620a00/0x7cee4af57841840a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b621 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.537223:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245621600/0x7cee4af578418411 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b621 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.537232:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1dd:0x0].0x0 (ffff9ed245644700) 00010000:00010000:3.0:1786002699.537235:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786002699.537239:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245621600, rc 0) 00000100:00100000:3.0:1786002699.537294:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+60:22482:x1872758531149824:12345-192.168.203.49@tcp:101:dd.0 Request processed in 294us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002699.537301:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24440 00000100:00100000:1.0:1786002699.549177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002699.553969:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531150080 00000100:00100000:2.0:1786002699.553982:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531150080 00000100:00100000:2.0:1786002699.554059:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24441 00000100:00100000:2.0:1786002699.554070:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+60:22482:x1872758531150080:12345-192.168.203.49@tcp:36:dd.0 00010000:00010000:2.0:1786002699.554123:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786002699.554149:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed245716a00/0x7cee4af5784183fc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b61a expref: 60 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.554168:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1dd:0x0].0x0 (ffff9ed245644700) 00010000:00010000:2.0:1786002699.554173:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786002699.554341:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578418418 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.554355:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578418418 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.554810:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578418418 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786002699.554955:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968878 00000004:00010000:2.0:1786002699.554981:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000214c4d1c reply state 00000000ab5c73d4 transno 4294968879 ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578418418 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.554993:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578418418 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.554999:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1dd:0x0].0x0 (ffff9ed245644700) 00010000:00010000:2.0:1786002699.555002:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1786002699.555004:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786002699.555095:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+62:22482:x1872758531150080:12345-192.168.203.49@tcp:36:dd.0 Request processed in 1025us (5925us total) trans 4294968879 rc 0/0 00000100:00100000:2.0:1786002699.555103:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24441 00000020:00080000:2.0:1786002699.555108:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1786002699.558787:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002699.559154:0:14685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531150208 00000100:00100000:2.0:1786002699.559162:0:14685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531150208 00000100:00100000:2.0:1786002699.559210:0:14685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5454 00000100:00100000:2.0:1786002699.559220:0:14685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:22482:x1872758531150208:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:2.0:1786002699.559236:0:14685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786002699.559254:0:14685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca043eb7/0x7cee4af57841841f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b628 expref: -99 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786002699.559276:0:14685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1786002699.559294:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=1059s v=(0 0) 00010000:00010000:2.0:1786002699.559298:0:14685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786002699.559306:0:14685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca043eb7/0x7cee4af57841841f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b628 expref: 17 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.559321:0:14685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca043eb7/0x7cee4af57841841f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b628 expref: 17 pid: 14685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786002699.559340:0:14685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed366e2d200, rc 0) 00000100:00100000:2.0:1786002699.559386:0:14685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:22482:x1872758531150208:12345-192.168.203.49@tcp:101:dd.0 Request processed in 167us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002699.559393:0:14685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5454 00000100:00100000:1.0:1786002699.572511:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002699.572606:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531150336 00000100:00100000:3.0:1786002699.572616:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531150336 00000100:00100000:3.0:1786002699.572688:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5455 00000100:00100000:3.0:1786002699.572700:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:22482:x1872758531150336:12345-192.168.203.49@tcp:101:dd.0 00010000:00010000:3.0:1786002699.572716:0:14686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786002699.572736:0:14686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085f1d3d0/0x7cee4af578418426 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x510b4beac2b3b62f expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786002699.572768:0:14686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1786002699.572789:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=1059s v=(0 0) 00010000:00010000:3.0:1786002699.572794:0:14686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786002699.572802:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085f1d3d0/0x7cee4af578418426 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b62f expref: 18 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.572817:0:14686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085f1d3d0/0x7cee4af578418426 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b62f expref: 18 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786002699.572829:0:14686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ed245620a00, rc 0) 00000100:00100000:3.0:1786002699.572911:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:22482:x1872758531150336:12345-192.168.203.49@tcp:101:dd.0 Request processed in 214us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002699.572918:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5455 00000100:00080000:2.0:1786002699.573196:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002699.589091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002699.589132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002699.589210:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531150464 00000100:00100000:0.0:1786002699.589220:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531150464 00002000:00010000:0.0:1786002699.589260:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/13 (0->18446744073709551615) 00002000:00100000:0.0:1786002699.589265:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5ae300 with x1872758531150464 ext(0->18446744073709551615) 00002000:00010000:0.0:1786002699.589276:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed34b5ae300. 00000100:00100000:0.0:1786002699.589303:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531150592 00000100:00100000:0.0:1786002699.589307:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531150592 00002000:00010000:0.0:1786002699.589320:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/13 (0->18446744073709551615) 00002000:00100000:0.0:1786002699.589323:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5ac380 with x1872758531150592 ext(0->18446744073709551615) 00002000:00010000:0.0:1786002699.589329:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5ac380. 00000100:00100000:0.0:1786002699.589342:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 122 00000100:00100000:0.0:1786002699.589352:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2413:x1872758531150464:12345-192.168.203.49@tcp:10:dd.0 00002000:00010000:0.0:1786002699.589517:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786002699.589521:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb mtime from disk: 0 -> 1786002699 00002000:00010000:0.0:1786002699.589523:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786002699.589526:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb ctime from disk: 0 -> 1786002699 00002000:00010000:0.0:1786002699.589528:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1786002699.589596:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2413:x1872758531150464:12345-192.168.203.49@tcp:10:dd.0 Request processed in 245us (512us total) trans 4294969995 rc 0/0 00000100:00100000:0.0:1786002699.589604:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 122 00002000:00010000:0.0:1786002699.589608:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/13 (0->18446744073709551615) 00002000:00100000:0.0:1786002699.589610:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5ae300 with x1872758531150464 ext(0->18446744073709551615) 00002000:00010000:0.0:1786002699.589615:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed34b5ae300. 00000100:00100000:0.0:1786002699.589634:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 123 00000100:00100000:0.0:1786002699.589641:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2413:x1872758531150592:12345-192.168.203.49@tcp:10:dd.0 00002000:00010000:0.0:1786002699.589723:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786002699.589726:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb mtime from disk: 0 -> 1786002699 00002000:00010000:0.0:1786002699.589728:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1786002699.589730:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb ctime from disk: 0 -> 1786002699 00002000:00010000:0.0:1786002699.589732:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1786002699.589754:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531150592:12345-192.168.203.49@tcp:10:dd.0 Request processed in 113us (621us total) trans 4294970032 rc 0/0 00000100:00100000:0.0:1786002699.589764:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 123 00002000:00010000:0.0:1786002699.589767:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/13 (0->18446744073709551615) 00002000:00100000:0.0:1786002699.589769:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5ac380 with x1872758531150592 ext(0->18446744073709551615) 00002000:00010000:0.0:1786002699.589774:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed34b5ac380. 00000100:00100000:2.0:1786002700.141999:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561090048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1786002700.142067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002700.142269:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561090048 00000100:00100000:0.0:1786002700.142277:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561090048 00000100:00100000:0.0:1786002700.142326:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4172 00000100:00100000:0.0:1786002700.142336:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561090048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1786002700.142374:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445036032 avail 1298796544 00000100:00100000:0.0:1786002700.142424:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561090048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002700.142432:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4172 00000100:00100000:3.0:1786002700.142539:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561090048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002700.231505:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002700.231547:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002700.231642:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531150720 00000100:00100000:0.0:1786002700.231651:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531150720 00002000:00100000:0.0:1786002700.231718:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (0->1048575) req@ffff9ed34b5aed80 x1872758531150720/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:381/0 lens 488/0 e 0 to 0 dl 1786002711 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002700.231729:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5aed80 with x1872758531150720 ext(0->1048575) 00002000:00010000:0.0:1786002700.231734:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed34b5aed80 00000100:00100000:0.0:1786002700.231769:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 124 00000100:00100000:0.0:1786002700.231778:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2412:x1872758531150720:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:2.0:1786002700.232863:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531150848 00000100:00100000:2.0:1786002700.232869:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531150848 00000100:00100000:2.0:1786002700.232904:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5456 00000100:00100000:2.0:1786002700.232911:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531150848:12345-192.168.203.49@tcp:16:kworker.0 00000100:00080000:1.0:1786002700.233429:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786002700.255559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002700.255917:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531150976 00000100:00100000:0.0:1786002700.255927:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531150976 00000100:00100000:0.0:1786002700.255982:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5457 00000100:00100000:0.0:1786002700.255993:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531150976:12345-192.168.203.49@tcp:16:kworker.0 00000001:00080000:0.0:1786002700.256174:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969995 is committed 00000100:00100000:2.0:1786002700.256507:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2413:x1872758531150848:12345-192.168.203.49@tcp:16:kworker.0 Request processed in 23594us (24957us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002700.256517:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5456 00010000:00010000:1.0:1786002700.267824:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786002700.272648:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970032 is committed 00000100:00100000:0.0:1786002700.272836:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2412:x1872758531150976:12345-192.168.203.49@tcp:16:kworker.0 Request processed in 16838us (17289us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002700.272879:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5457 00000100:00100000:1.0:1786002700.280497:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002700.280590:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531151104 00000100:00100000:2.0:1786002700.280600:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531151104 00000100:00100000:2.0:1786002700.280650:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5458 00000100:00100000:2.0:1786002700.280659:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531151104:12345-192.168.203.49@tcp:16:kworker.0 00000100:00100000:2.0:1786002700.280767:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531151104:12345-192.168.203.49@tcp:16:kworker.0 Request processed in 108us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002700.280775:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5458 00000100:00100000:2.0:1786002700.317900:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2412:x1872758531150720:12345-192.168.203.49@tcp:4:dd.0 Request processed in 86071us (86351us total) trans 4294969996 rc 0/0 00000100:00100000:2.0:1786002700.317919:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 124 00002000:00100000:2.0:1786002700.317932:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (0->1048575) req@ffff9ed34b5aed80 x1872758531150720/t4294969996(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:381/0 lens 488/448 e 0 to 0 dl 1786002711 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002700.317943:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed34b5aed80 with x1872758531150720 ext(0->1048575) 00002000:00010000:2.0:1786002700.317948:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed34b5aed80 00000100:00100000:0.0:1786002700.381329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002700.381477:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531151232 00000100:00100000:3.0:1786002700.381486:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531151232 00002000:00100000:3.0:1786002700.381532:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xd:0x0] (0->1048575) req@ffff9ed2455ff800 x1872758531151232/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:381/0 lens 488/0 e 0 to 0 dl 1786002711 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002700.381542:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455ff800 with x1872758531151232 ext(0->1048575) 00002000:00010000:3.0:1786002700.381548:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455ff800 00000100:00100000:3.0:1786002700.381589:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 125 00000100:00100000:3.0:1786002700.381599:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2413:x1872758531151232:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:3.0:1786002700.423675:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2413:x1872758531151232:12345-192.168.203.49@tcp:4:dd.0 Request processed in 42067us (42345us total) trans 4294970033 rc 0/0 00000100:00100000:3.0:1786002700.423694:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 125 00002000:00100000:3.0:1786002700.423707:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xd:0x0] (0->1048575) req@ffff9ed2455ff800 x1872758531151232/t4294970033(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:381/0 lens 488/448 e 0 to 0 dl 1786002711 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786002700.423718:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455ff800 with x1872758531151232 ext(0->1048575) 00002000:00010000:3.0:1786002700.423724:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455ff800 00010000:00010000:3.0:1786002701.290168:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002702.186319:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561090176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786002702.186418:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002702.186654:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561090176 00000100:00100000:0.0:1786002702.186665:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561090176 00000100:00100000:0.0:1786002702.186745:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1786002702.186757:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561090176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786002702.186794:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 197465792 pending 1073152 free 3922477056 avail 3690954752 00000100:00080000:3.0:1786002702.186869:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002702.187201:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561090304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002702.187232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002702.187264:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561090304 00000100:00100000:1.0:1786002702.187267:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561090304 00000100:00100000:1.0:1786002702.187315:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1786002702.187321:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561090304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1786002702.187332:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 197465792 pending 1073152 free 3922477056 avail 3690954752 00000100:00100000:1.0:1786002702.187364:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561090304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002702.187372:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1786002702.187423:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561090304:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1786002702.187454:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002702.196072:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561090176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9303us (9638us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002702.196090:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1786002702.197227:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561090176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786002702.314570:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786002702.687951:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002702.688013:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002702.688057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002702.688098:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002702.688140:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531151872 00000100:00100000:3.0:1786002702.688151:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531151872 00000100:00100000:3.0:1786002702.688226:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 631 00000100:00100000:3.0:1786002702.688238:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758531151872:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002702.688326:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758531151872:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002702.688335:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 631 00000100:00080000:3.0:1786002702.688360:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786002702.688378:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531151488 00000100:00100000:3.0:1786002702.688382:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531151488 00000100:00100000:3.0:1786002702.688416:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531151616 00000100:00100000:3.0:1786002702.688419:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531151616 00000100:00100000:3.0:1786002702.688440:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1133 00000100:00100000:3.0:1786002702.688446:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2411:x1872758531151488:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002702.688475:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2411:x1872758531151488:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 29us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002702.688483:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1133 00000100:00100000:3.0:1786002702.688495:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1134 00000100:00100000:3.0:1786002702.688501:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+62:2410:x1872758531151616:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002702.688529:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+62:2410:x1872758531151616:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002702.688550:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1134 00000100:00080000:3.0:1786002702.688565:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1786002702.688569:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786002702.688648:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531151360 00000100:00100000:2.0:1786002702.688653:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531151360 00000100:00100000:2.0:1786002702.688691:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 581 00000100:00100000:2.0:1786002702.688697:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531151360:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:2.0:1786002702.688736:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2410:x1872758531151360:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 28us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002702.688744:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 581 00000100:00100000:1.0:1786002702.695736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002702.696551:0:8764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531151744 00000100:00100000:3.0:1786002702.696564:0:8764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531151744 00000100:00100000:3.0:1786002702.696667:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 632 00000100:00100000:3.0:1786002702.696679:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531151744:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002702.696825:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2411:x1872758531151744:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 148us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002702.696832:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 632 00000100:00080000:0.0:1786002702.696923:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002702.699606:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561090432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1786002702.699688:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002702.699820:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561090432 00000100:00100000:0.0:1786002702.699828:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561090432 00000100:00100000:0.0:1786002702.699923:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4173 00000100:00100000:0.0:1786002702.699932:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed34b5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561090432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1786002702.699981:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443897344 avail 1297657856 00000100:00100000:0.0:1786002702.700037:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed34b5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561090432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002702.700043:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4173 00000100:00100000:0.0:1786002702.700096:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561090432:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1786002703.338247:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786002703.478914:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002703.479012:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531152000 00000100:00100000:2.0:1786002703.479022:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531152000 00002000:00100000:2.0:1786002703.479071:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (4194304->8388607) req@ffff9ed2448fdc00 x1872758531152000/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:384/0 lens 488/0 e 0 to 0 dl 1786002714 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002703.479080:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2448fdc00 with x1872758531152000 ext(4194304->8388607) 00002000:00010000:2.0:1786002703.479085:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2448fdc00 00000100:00100000:2.0:1786002703.479124:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 126 00000100:00100000:2.0:1786002703.479134:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2448fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+19:2410:x1872758531152000:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:2.0:1786002703.593949:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2448fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2410:x1872758531152000:12345-192.168.203.49@tcp:4:dd.0 Request processed in 114805us (115033us total) trans 4294969997 rc 0/0 00000100:00100000:2.0:1786002703.593962:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 126 00002000:00100000:2.0:1786002703.593976:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (4194304->8388607) req@ffff9ed2448fdc00 x1872758531152000/t4294969997(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:384/0 lens 488/448 e 0 to 0 dl 1786002714 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002703.593985:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2448fdc00 with x1872758531152000 ext(4194304->8388607) 00002000:00010000:2.0:1786002703.593992:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed2448fdc00 00000100:00100000:0.0:1786002703.722441:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561090560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002703.722508:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002703.722676:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561090560 00000100:00100000:2.0:1786002703.722683:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561090560 00000100:00100000:2.0:1786002703.722743:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1786002703.722753:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561090560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786002703.722779:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 485918400 pending 1073152 free 3922345984 avail 3690823680 00000100:00100000:2.0:1786002703.722821:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561090560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002703.722827:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1786002703.722865:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561090688:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.722895:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002703.722895:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561090816:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.722916:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561091200:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.722935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002703.722935:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002703.722950:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561091328:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.722952:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561091712:0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.722969:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002703.722970:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002703.722981:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561091840:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.722993:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561090688 00000100:00100000:2.0:1786002703.722996:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561090688 00000100:00100000:1.0:1786002703.722999:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002703.723019:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1786002703.723020:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561090944:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.723026:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561090688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.723040:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002703.723055:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:338407c0-17ce-47f6-a10f-807d82c493cd+24:3646:x1872758561090688:12345-0@lo:400:kworker.0 Request processed in 30us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002703.723062:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1786002703.723089:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561090816 00000100:00100000:2.0:1786002703.723092:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561090816 00000100:00100000:2.0:1786002703.723116:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561091328 00000100:00100000:2.0:1786002703.723118:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561091328 00000100:00100000:2.0:1786002703.723136:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561091840 00000100:00100000:2.0:1786002703.723138:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561091840 00000100:00100000:2.0:1786002703.723152:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1786002703.723158:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561090816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.723168:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758561091456:0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.723189:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002703.723190:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561090816:12345-0@lo:400:kworker.0 Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002703.723196:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1786002703.723198:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758561091968:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.723206:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561091456 00000100:00100000:2.0:1786002703.723208:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561091456 00000100:00100000:1.0:1786002703.723216:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002703.723221:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561091968 00000100:00100000:2.0:1786002703.723223:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561091968 00000100:00100000:1.0:1786002703.723227:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1786002703.723233:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2448fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872758561091072:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.723236:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1786002703.723241:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561091328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.723250:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002703.723260:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561091584:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.723263:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561091328:12345-0@lo:400:kworker.0 Request processed in 22us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002703.723268:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1786002703.723276:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561091072 00000100:00100000:1.0:1786002703.723276:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002703.723279:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561091072 00000100:00100000:2.0:1786002703.723292:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1786002703.723292:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561092096:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.723297:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561091840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.723319:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561091840:12345-0@lo:400:kworker.0 Request processed in 22us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002703.723325:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1786002703.723336:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1786002703.723342:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758561091456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.723367:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1872758561091456:12345-0@lo:400:kworker.0 Request processed in 26us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002703.723368:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002703.723372:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1786002703.723383:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:2.0:1786002703.723389:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758561091968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.723468:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1872758561091456:0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.723498:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561091200 00000100:00100000:1.0:1786002703.723501:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561091200 00000100:00100000:1.0:1786002703.723522:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561090944 00000100:00100000:1.0:1786002703.723524:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561090944 00000100:00100000:1.0:1786002703.723554:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4174 00000100:00100000:1.0:1786002703.723559:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561091200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.723590:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561091200:12345-0@lo:400:kworker.0 Request processed in 31us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002703.723596:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4174 00000100:00100000:1.0:1786002703.723607:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4175 00000100:00100000:1.0:1786002703.723613:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561090944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.723646:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1872758561090944:12345-0@lo:400:kworker.0 Request processed in 32us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002703.723650:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4175 00000100:00100000:1.0:1786002703.723668:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561091712 00000100:00100000:1.0:1786002703.723671:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561091712 00000100:00100000:1.0:1786002703.723981:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561091584 00000100:00100000:1.0:1786002703.723985:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561091584 00000100:00100000:1.0:1786002703.724003:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1786002703.724009:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561091712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.724039:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3646:x1872758561091712:12345-0@lo:400:kworker.0 Request processed in 30us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002703.724377:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1786002703.724451:0:14678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561092096 00000100:00100000:1.0:1786002703.724455:0:14678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561092096 00000100:00100000:1.0:1786002703.724479:0:14678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1786002703.724484:0:14678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561091584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.724487:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1872758561091968:12345-0@lo:400:kworker.0 Request processed in 1099us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002703.724494:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:2.0:1786002703.724506:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1786002703.724512:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872758561091072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002703.724613:0:14691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1786002703.724623:0:14691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561092096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002703.724733:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561090816:0@lo:400:kworker.0 00000100:00100000:3.0:1786002703.724746:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561091328:0@lo:400:kworker.0 00000100:00100000:3.0:1786002703.724755:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561091840:0@lo:400:kworker.0 00000100:00100000:3.0:1786002703.724772:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786002703.724779:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561092224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002703.734083:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1872758561091072:12345-0@lo:400:kworker.0 Request processed in 9563us (10823us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002703.734097:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1786002703.734181:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561091712:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.734191:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:338407c0-17ce-47f6-a10f-807d82c493cd:3646:1872758561090688:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.734199:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1872758561091200:0@lo:400:kworker.0 00000100:00100000:2.0:1786002703.734282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002703.734306:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531152128 00000100:00100000:2.0:1786002703.735484:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531152128 00002000:00100000:2.0:1786002703.735610:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xd:0x0] (1048576->4194303) req@ffff9ed37136ea00 x1872758531152128/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:384/0 lens 488/0 e 0 to 0 dl 1786002714 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002703.735628:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37136ea00 with x1872758531152128 ext(1048576->4194303) 00002000:00010000:2.0:1786002703.735633:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37136ea00 00000100:00100000:2.0:1786002703.735656:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 127 00000100:00100000:2.0:1786002703.735665:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+21:2413:x1872758531152128:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002703.738830:0:14678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561091584:12345-0@lo:400:kworker.0 Request processed in 14337us (15544us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002703.738844:0:14678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1786002703.738933:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1872758561091072:0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.738945:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561091584:0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.742130:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2448fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561090944:0@lo:400:kworker.0 00000100:00100000:1.0:1786002703.742169:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1872758561091968:0@lo:400:kworker.0 00000100:00080000:1.0:1786002703.742338:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1786002703.742343:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786002703.742346:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786002703.742380:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561090560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786002703.742902:0:14691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561092096:12345-0@lo:400:kworker.0 Request processed in 18279us (19588us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002703.742912:0:14691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1786002703.743785:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561092096:0@lo:400:kworker.0 00000100:00100000:3.0:1786002703.748098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002703.749137:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561092224 00000100:00100000:2.0:1786002703.749147:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561092224 00000100:00100000:2.0:1786002703.749197:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1786002703.749206:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561092224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1786002703.749229:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 485918400 pending 1073152 free 3922345984 avail 3690823680 00000100:00100000:2.0:1786002703.749345:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1872758561092224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002703.749352:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1786002703.754838:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561092224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1786002703.796282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002703.805748:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1786002703.805766:0:8440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1786002703.806732:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531152256 00000100:00100000:2.0:1786002703.806742:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531152256 00002000:00100000:2.0:1786002703.806787:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xd:0x0] (4194304->8388607) req@ffff9ed2455fd500 x1872758531152256/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:384/0 lens 488/0 e 0 to 0 dl 1786002714 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786002703.806798:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455fd500 with x1872758531152256 ext(4194304->8388607) 00002000:00010000:2.0:1786002703.806805:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455fd500 00000100:00100000:0.0:1786002703.813161:0:23295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 128 00000100:00100000:0.0:1786002703.813177:0:23295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2455fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+20:2410:x1872758531152256:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:1.0:1786002703.838976:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002703.839069:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:2413:x1872758531152128:12345-192.168.203.49@tcp:4:dd.0 Request processed in 103401us (104784us total) trans 4294969998 rc 0/0 00000100:00100000:0.0:1786002703.839080:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 127 00002000:00100000:0.0:1786002703.839093:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0xd:0x0] (1048576->4194303) req@ffff9ed37136ea00 x1872758531152128/t4294969998(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:384/0 lens 488/448 e 0 to 0 dl 1786002714 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002703.839104:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed37136ea00 with x1872758531152128 ext(1048576->4194303) 00002000:00010000:0.0:1786002703.839111:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ed37136ea00 00000100:00100000:0.0:1786002703.839131:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531152384 00000100:00100000:0.0:1786002703.839137:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531152384 00002000:00100000:0.0:1786002703.839168:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xd:0x0] (1048576->4194303) req@ffff9ed244ffad80 x1872758531152384/t0(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:384/0 lens 488/0 e 0 to 0 dl 1786002714 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002703.839177:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ffad80 with x1872758531152384 ext(1048576->4194303) 00002000:00010000:0.0:1786002703.839181:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed244ffad80 00000100:00100000:0.0:1786002703.839201:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 129 00000100:00100000:0.0:1786002703.839210:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+22:2413:x1872758531152384:12345-192.168.203.49@tcp:4:dd.0 00000100:00100000:2.0:1786002703.839223:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1786002703.839232:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1786002703.913319:0:23295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2455fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:2410:x1872758531152256:12345-192.168.203.49@tcp:4:dd.0 Request processed in 100134us (117032us total) trans 4294970034 rc 0/0 00000100:00100000:0.0:1786002703.913333:0:23295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 128 00002000:00100000:0.0:1786002703.913346:0:23295:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xd:0x0] (4194304->8388607) req@ffff9ed2455fd500 x1872758531152256/t4294970034(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:384/0 lens 488/448 e 0 to 0 dl 1786002714 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002703.913357:0:23295:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed2455fd500 with x1872758531152256 ext(4194304->8388607) 00002000:00010000:0.0:1786002703.913364:0:23295:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed2455fd500 00000100:00100000:0.0:1786002703.959194:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:2413:x1872758531152384:12345-192.168.203.49@tcp:4:dd.0 Request processed in 119973us (120216us total) trans 4294970035 rc 0/0 00000100:00100000:0.0:1786002703.959209:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 129 00002000:00100000:0.0:1786002703.959221:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xd:0x0] (1048576->4194303) req@ffff9ed244ffad80 x1872758531152384/t4294970035(0) o4->07e0de48-2601-4cba-b1ae-c2d2039ff29a@192.168.203.49@tcp:384/0 lens 488/448 e 0 to 0 dl 1786002714 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786002703.959231:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ed244ffad80 with x1872758531152384 ext(1048576->4194303) 00002000:00010000:0.0:1786002703.959238:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ed244ffad80 00000100:00100000:2.0:1786002704.088012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002704.088069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:0.0:1786002704.088258:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531152512 00000100:00100000:0.0:1786002704.088268:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531152512 00000100:00100000:0.0:1786002704.088325:0:14687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531152640 00000100:00100000:0.0:1786002704.088328:0:14687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531152640 00000100:00100000:0.0:1786002704.088380:0:14687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5459 00000100:00100000:0.0:1786002704.088389:0:14687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+23:2412:x1872758531152512:12345-192.168.203.49@tcp:16:dd.0 00000100:00100000:0.0:1786002704.088825:0:8764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5460 00000100:00100000:0.0:1786002704.089017:0:8764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37be04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+24:2412:x1872758531152640:12345-192.168.203.49@tcp:16:dd.0 00000100:00080000:1.0:1786002704.089476:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786002704.089481:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1786002704.096126:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969998 is committed 00000100:00100000:0.0:1786002704.096350:0:14687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2412:x1872758531152512:12345-192.168.203.49@tcp:16:dd.0 Request processed in 7958us (8344us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002704.100331:0:14687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5459 00000001:00080000:3.0:1786002704.102653:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294970035 is committed 00000100:00100000:0.0:1786002704.111580:0:8764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37be04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2412:x1872758531152640:12345-192.168.203.49@tcp:16:dd.0 Request processed in 22556us (23499us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002704.111595:0:8764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5460 00000100:00100000:2.0:1786002704.124498:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002704.124617:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531152896 00000100:00100000:3.0:1786002704.124627:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531152896 00000100:00100000:3.0:1786002704.124696:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 5338 00000100:00100000:3.0:1786002704.124706:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed342ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+62:22482:x1872758531152896:12345-192.168.203.49@tcp:35:dd.0 00000001:00080000:3.0:1786002704.124954:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968880 00000100:00100000:3.0:1786002704.125060:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed342ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+64:22482:x1872758531152896:12345-192.168.203.49@tcp:35:dd.0 Request processed in 344us (558us total) trans 4294968881 rc 0/0 00000100:00100000:3.0:1786002704.125068:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 5338 00000020:00080000:3.0:1786002704.125072:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1786002704.125234:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1786002704.130598:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002704.130756:0:10360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531153024 00000100:00100000:3.0:1786002704.130766:0:10360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531153024 00000100:00100000:3.0:1786002704.130825:0:10360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 24442 00000100:00100000:3.0:1786002704.130842:0:10360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+64:22482:x1872758531153024:12345-192.168.203.49@tcp:44:dd.0 00000100:00100000:2.0:1786002704.131293:0:10360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e0de48-2601-4cba-b1ae-c2d2039ff29a+64:22482:x1872758531153024:12345-192.168.203.49@tcp:44:dd.0 Request processed in 451us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002704.131301:0:10360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 24442 00010000:00010000:3.0:1786002704.362067:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786002704.747167:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968881 is committed 00010000:00010000:0.0:1786002704.747249:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578418418 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002704.747261:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578418418 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002704.747268:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578418418 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002704.747274:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ed366e2da00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1786002704.747278:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578418418 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002704.747285:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578418418 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002704.747301:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1dd:0x0].0x0 (ffff9ed245644700) 00010000:00010000:0.0:1786002704.747304:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786002704.747308:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578418418 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786002704.747314:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9ed366e2da00/0x7cee4af578418418 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786002705.258299:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed24662a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561092352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1786002705.258366:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002705.258542:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561092352 00000100:00100000:2.0:1786002705.258550:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561092352 00000100:00100000:2.0:1786002705.258600:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4176 00000100:00100000:2.0:1786002705.258609:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561092352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1786002705.258639:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445036032 avail 1298796544 00000100:00100000:2.0:1786002705.258686:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1872758561092352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002705.258692:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4176 00000100:00100000:3.0:1786002705.258780:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed24662a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1872758561092352:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1786002705.387067:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786002706.411081:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786002707.085549:0:23347:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_63c: @@@@@@ FAIL: expect OST striped 91 == 86 + 2 00000100:00100000:1.0:1786002707.306100:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561092480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002707.306163:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002707.306234:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561092480 00000100:00100000:1.0:1786002707.306242:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561092480 00000100:00100000:1.0:1786002707.306286:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1786002707.306296:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561092480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786002707.306323:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 205878976 pending 0 free 3915137024 avail 3683614720 00000100:00100000:1.0:1786002707.306366:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561092480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002707.306374:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00080000:1.0:1786002707.306393:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002707.306430:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561092480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786002707.306552:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786002707.306561:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed37136ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561092608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1786002707.306588:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002707.306702:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561092608 00000100:00100000:2.0:1786002707.306707:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561092608 00000100:00100000:2.0:1786002707.306742:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:2.0:1786002707.306748:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561092608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1786002707.306758:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 205878976 pending 0 free 3915137024 avail 3683614720 00000100:00100000:2.0:1786002707.306791:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1872758561092608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002707.306798:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00080000:1.0:1786002707.306868:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786002707.306891:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed37136ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1872758561092608:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1786002707.444094:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002707.797185:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002707.797220:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002707.797314:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:2.0:1786002707.797345:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002707.797386:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531153152 00000100:00100000:3.0:1786002707.797396:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531153152 00000100:00100000:3.0:1786002707.797443:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 583 00000100:00100000:3.0:1786002707.797452:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758531153152:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002707.797523:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a78e214a-1eb9-4d43-aec8-1d83c5afbd78+10:2411:x1872758531153152:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 71us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002707.797531:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 583 00000100:00100000:1.0:1786002707.798623:0:14686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531153664 00000100:00100000:1.0:1786002707.798631:0:14686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531153664 00000100:00100000:1.0:1786002707.798695:0:14686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 636 00000100:00100000:1.0:1786002707.798704:0:14686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2411:x1872758531153664:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:1.0:1786002707.798744:0:14686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:07e0de48-2601-4cba-b1ae-c2d2039ff29a+18:2411:x1872758531153664:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 42us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002707.798751:0:14686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 636 00000100:00080000:3.0:1786002707.798947:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002707.804932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:3.0:1786002707.805069:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531153536 00000100:00100000:3.0:1786002707.805078:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531153536 00000100:00100000:3.0:1786002707.805150:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 637 00000100:00100000:3.0:1786002707.805161:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531153536:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002707.805223:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e0de48-2601-4cba-b1ae-c2d2039ff29a+17:2411:x1872758531153536:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 64us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002707.805230:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 637 00000100:00080000:2.0:1786002707.812806:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786002707.816889:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531153408 00000100:00100000:0.0:1786002707.816905:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531153408 00000100:00100000:3.0:1786002707.817077:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531153280 00000100:00100000:3.0:1786002707.817083:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531153280 00000100:00100000:3.0:1786002707.817121:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1141 00000100:00100000:3.0:1786002707.817131:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+56:2411:x1872758531153408:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002707.817210:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+56:2411:x1872758531153408:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 80us (19988us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002707.817218:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1141 00000100:00100000:3.0:1786002707.817238:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1142 00000100:00100000:3.0:1786002707.817244:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2411:x1872758531153280:12345-192.168.203.49@tcp:400:kworker.0 00000100:00100000:3.0:1786002707.817266:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2411:x1872758531153280:12345-192.168.203.49@tcp:400:kworker.0 Request processed in 23us (19921us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002707.817272:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1142 00000100:00080000:2.0:1786002707.817487:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786002707.817492:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1786002707.818465:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786002707.818482:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2455fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561092736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1786002707.818542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002707.818697:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561092736 00000100:00100000:1.0:1786002707.818702:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561092736 00000100:00100000:1.0:1786002707.818738:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4177 00000100:00100000:1.0:1786002707.818746:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561092736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1786002707.818773:0:15596:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1443897344 avail 1297657856 00000100:00100000:1.0:1786002707.818823:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed24662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561092736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002707.818829:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4177 00000100:00100000:3.0:1786002707.819004:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2455fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561092736:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1786002708.475383:0:14667:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786002708.842375:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786002708.842397:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed246628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561092864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1786002708.842464:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786002708.842662:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561092864 00000100:00100000:3.0:1786002708.842670:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561092864 00000100:00100000:3.0:1786002708.842735:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1786002708.842755:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37c0f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561092864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1786002708.842780:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 492234432 pending 0 free 3915005952 avail 3683483648 00000100:00100000:3.0:1786002708.842829:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37c0f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1872758561092864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002708.842837:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1786002708.842912:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561092992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002708.842949:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002708.842984:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561092992 00000100:00100000:1.0:1786002708.842987:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561092992 00000100:00100000:1.0:1786002708.843006:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1786002708.843012:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed244ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561092992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786002708.843021:0:14494:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 492234432 pending 0 free 3915005952 avail 3683483648 00000100:00100000:1.0:1786002708.843048:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed244ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1872758561092992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002708.843057:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1786002708.843079:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed246628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1872758561092864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1786002708.843079:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1872758561092992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786002708.843174:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561093376:0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.843202:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002708.843227:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561093888:0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.843250:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002708.843264:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561094400:0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.843283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002708.843302:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1786002708.843307:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561093248:0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.843328:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786002708.843354:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561093760:0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.843375:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002708.843383:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561093888 00000100:00100000:0.0:1786002708.843388:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561093888 00000100:00100000:1.0:1786002708.843391:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561094272:0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.843410:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786002708.843416:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561094400 00000100:00100000:0.0:1786002708.843419:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561094400 00000100:00100000:1.0:1786002708.843428:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561093248 00000100:00100000:1.0:1786002708.843430:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561093248 00000100:00100000:0.0:1786002708.843433:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561093760 00000100:00100000:0.0:1786002708.843435:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561093760 00000100:00100000:0.0:1786002708.843448:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561094272 00000100:00100000:0.0:1786002708.843450:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561094272 00000100:00100000:0.0:1786002708.843463:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1786002708.843469:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561093888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002708.843525:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1872758561093888:12345-0@lo:400:kworker.0 Request processed in 56us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002708.843531:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1786002708.843543:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1786002708.843548:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561094400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002708.843569:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1872758561094400:12345-0@lo:400:kworker.0 Request processed in 22us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002708.843574:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1786002708.843582:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1786002708.843587:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561093760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002708.843609:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1872758561093760:12345-0@lo:400:kworker.0 Request processed in 22us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002708.843613:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1786002708.843623:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:0.0:1786002708.843633:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561094272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786002708.843657:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1872758561094272:12345-0@lo:400:kworker.0 Request processed in 29us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1786002708.843663:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1786002708.843803:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561093376 00000100:00100000:3.0:1786002708.843807:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561093376 00000100:00100000:3.0:1786002708.843842:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4178 00000100:00100000:3.0:1786002708.843863:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561093376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786002708.843898:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3647:x1872758561093376:12345-0@lo:400:kworker.0 Request processed in 50us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002708.843904:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4178 00000100:00080000:2.0:1786002708.844348:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786002708.844353:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1786002708.844355:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786002708.844385:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561093120:0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.844416:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002708.844446:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561093632:0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.844466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002708.844503:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561094144:0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.844526:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002708.844544:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786002708.844550:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed244ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561093504:0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.844568:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002708.844581:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ed2419ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561094016:0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.844597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786002708.844620:0:15596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561093632 00000100:00100000:2.0:1786002708.844624:0:15596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561093632 00000100:00100000:2.0:1786002708.844650:0:15596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4179 00000100:00100000:2.0:1786002708.844657:0:15596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561093632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.844692:0:15596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561093632:12345-0@lo:400:kworker.0 Request processed in 35us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002708.844698:0:15596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4179 00000100:00100000:2.0:1786002708.844713:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561094144 00000100:00100000:2.0:1786002708.844717:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561094144 00000100:00100000:2.0:1786002708.844735:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561094016 00000100:00100000:2.0:1786002708.844822:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561094016 00000100:00100000:2.0:1786002708.844861:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1786002708.844868:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561094144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.844896:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1872758561094144:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002708.844901:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1786002708.844912:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:2.0:1786002708.844917:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561094016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.844937:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1872758561094016:12345-0@lo:400:kworker.0 Request processed in 20us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002708.844942:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:2.0:1786002708.844977:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1872758561094016:0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.844986:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561093632:0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.844994:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1872758561094144:0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.845014:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561093504 00000100:00100000:2.0:1786002708.845016:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561093504 00000100:00100000:1.0:1786002708.845030:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1786002708.845037:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed2419adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561093248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.845069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed2419adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1872758561093248:12345-0@lo:400:kworker.0 Request processed in 33us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1786002708.845072:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758561093120 00000100:00100000:3.0:1786002708.845075:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758561093120 00000100:00100000:2.0:1786002708.845378:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1786002708.845386:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed37136df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561093504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.845419:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed37136df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1872758561093504:12345-0@lo:400:kworker.0 Request processed in 35us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002708.845425:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1786002708.845448:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1872758561093504:0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.845507:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1786002708.845551:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1872758561093248:0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.845561:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1872758561093760:0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.845570:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1872758561094272:0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.845579:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1872758561093376:0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.845587:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1872758561093888:0@lo:400:kworker.0 00000100:00100000:1.0:1786002708.846019:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed2419aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1872758561094400:0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.846553:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1786002708.846562:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed36e5d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561093120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786002708.846616:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed36e5d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:338407c0-17ce-47f6-a10f-807d82c493cd+24:3645:x1872758561093120:12345-0@lo:400:kworker.0 Request processed in 56us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1786002708.846622:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1786002708.846693:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ed244ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:338407c0-17ce-47f6-a10f-807d82c493cd:3645:1872758561093120:0@lo:400:kworker.0 00000100:00100000:3.0:1786002709.269833:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.49@tcp (source: 12345-192.168.203.49@tcp) 00000100:00100000:1.0:1786002709.269923:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1872758531153792 00000100:00100000:1.0:1786002709.269940:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1872758531153792 00000100:00100000:1.0:1786002709.270005:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.49@tcp, seq: 1592 00000100:00100000:1.0:1786002709.270014:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ed246628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+16:2412:x1872758531153792:12345-192.168.203.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786002709.270027:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 9 locks, starting at 0 00010000:00010000:1.0:1786002709.270050:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed34556aa00/0x7cee4af578417451 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1a1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b12e expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002709.270069:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1a1:0x0].0x0 (ffff9ed245644800) 00010000:00010000:1.0:1786002709.270083:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245ed2a00/0x7cee4af5784173e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15b7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b112 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002709.270093:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15b7:0x0].0x0 (ffff9ed243d0b400) 00010000:00010000:1.0:1786002709.270103:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82000/0x7cee4af5784170d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b040 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002709.270115:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f83200/0x7cee4af5784170bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x15ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b039 expref: 13 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002709.270126:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f82800/0x7cee4af5784170ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15ac:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3b032 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002709.270135:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15ac:0x0].0x0 (ffff9ed2456f9c00) 00010000:00010000:1.0:1786002709.270144:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed243d2a000/0x7cee4af5784154ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1546:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3ad37 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002709.270152:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1546:0x0].0x0 (ffff9ed245ddc300) 00010000:00010000:1.0:1786002709.270161:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245f5ae00/0x7cee4af5783fe685 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x138d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b3647b expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002709.270169:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x138d:0x0].0x0 (ffff9ed351207f00) 00010000:00010000:1.0:1786002709.270178:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed245c8d800/0x7cee4af5783fe693 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b36482 expref: 9 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002709.270186:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff9ed351207a00) 00010000:00010000:1.0:1786002709.270195:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ed35a229c00/0x7cee4af578386b4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.49@tcp remote: 0x510b4beac2b1c9ff expref: 8 pid: 10360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786002709.270204:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ed24206a700) 00010000:00010000:1.0:1786002709.270208:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786002709.270251:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ed246628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e0de48-2601-4cba-b1ae-c2d2039ff29a+7:2412:x1872758531153792:12345-192.168.203.49@tcp:103:ldlm_bl.0 Request processed in 239us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1786002709.270259:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.49@tcp, seq: 1592 00000100:00080000:3.0:1786002709.270508:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786002709.482374:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 68601 lines, 68601 kept, 0 dropped, 0 bad.